Dremio-oss build error

1

Although the this topic is similar topic in Feb 24. But the errors are different

This is my first time try dremio.
I cloned the dremio-oss to Mac, and using mvn to build

mvn clean install -DskipTests

Got an error
[ERROR] Failed to execute goal on project dremio-hive2-exec-shaded: Could not resolve dependencies for project com.dremio.contrib:dremio-hive2-exec-shaded:jar:4.6.1-202007220122450047-62e084d0: Failure to find org.pentaho:pentaho-aggdesigner-algorithm:jar:5.1.5-jhyde in https://maven.dremio.com/free/ was cached in the local repository, resolution will not be reattempted until the update interval of dremio-free has elapsed or updates are forced -> [Help 1]

A bit surprised the build doest work. Since this is my first time playing with dremio, I don’t want to tweak the pom.xml. So I tried to keep the oss-only option

This time it failed at different place:

mvn clean install -DskipTests -Ddremio.oss-only=true

[ERROR] Failed to execute goal on project dremio-sabot-kernel: Could not resolve dependencies for project com.dremio.sabot:dremio-sabot-kernel:jar:4.6.1-202007220122450047-62e084d0: Failure to find com.dremio.data:dremio-tpch-sample-data:jar:1.0.0 in https://maven.dremio.com/public/ was cached in the local repository, resolution will not be reattempted until the update interval of dremio-public has elapsed or updates are forced -> [Help 1]

Questions:

  1. I am sure these code in master branch are already gone through the CI testing. not sure what I did wrong. Anyone can point me to the correct build method.

  2. I did not see a lot branch or tags. Where can I checkout the release build ?

java version “1.8.0_231”
maven-3.6.2
OS name: “mac os x”, version: “10.15.1”, arch: “x86_64”

Chester

2

Right now I have a similar experience while building Dremio with “-Ddremio.oss-only=true” flag.
Maven build of Dremio Release (4.8.0 --> latest on GitHub) without that OSS flag succeeds.
But if I am adding that OSS flag to mvn build command then it fails.

mvn clean install -DskipTests -Ddremio.oss-only=true

[ERROR]
Failed to execute goal on project dremio-sabot-kernel: Could not resolve dependencies for project com.dremio.sabot:dremio-sabot-kernel:jar:4.8.0-202009180238090394-b0a98b73: Failure to find com.dremio.data:dremio-tpch-sample-data:jar:1.0.0 in https://maven.dremio.com/public/ was cached in the local repository, resolution will not be reattempted until the update interval of dremio-public has elapsed or updates are forced -> [Help 1]

Using -U and -X generates same output / build error.

3

It’s old problem with tpch. I resolve it with manual upload to corporate repository.

4

Thanks for your quick response. Unfortunately it is not working right now (although I used -U to enforce maven to update local repository).
Is there any mistake / missing command on my site? (I am not really familiar with Maven.)

5

This dependency from close-source repo
https://maven.dremio.com/free/com/dremio/data/dremio-tpch-sample-data/1.0.0/dremio-tpch-sample-data-1.0.0.jar

6

Original repository definitions are

<repositories>
    <repository>
      <id>dremio-public</id>
      <url>https://maven.dremio.com/public/</url>
    </repository>
    <repository>
      <id>redshift</id>
      <url>https://s3.amazonaws.com/redshift-maven-repository/release</url>
    </repository>
  </repositories>

If I add https://maven.dremio.com/free then it is working

<repositories>
    <repository>
      <id>dremio-public</id>
      <url>https://maven.dremio.com/public/</url>
    </repository>
    <repository>
      <id>dremio-free</id>
      <url>https://maven.dremio.com/free/</url>
    </repository>
    <repository>
      <id>redshift</id>
      <url>https://s3.amazonaws.com/redshift-maven-repository/release</url>
    </repository>
  </repositories>

Thanks a lot.
Is it possible to commit this Maven repository within master branch? (to prevent that error in future releases!)

7

If I understand correctly, free repo contains artifacts without open source code, and by the way it is used when -Ddremio.oss-only=false