Prometheus exporter: struggle to compile

jjournet · March 16, 2023, 12:56pm

Hello,

I’m trying to compile the Prometheus exporter (GitHub - dremio-hub/dremio-prometheus-exporter)

I get the following error:

[WARNING] The POM for com.dremio.tools:errorprone-dremio:jar:24.0.0-202302100528110223-3a169b7c is missing, no dependency information available
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time:  2.220 s
[INFO] Finished at: 2023-03-15T21:42:57Z
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-compiler-plugin:3.10.1:compile (default-compile) on project dremio-telemetry-prometheus: Execution default-compile of goal org.apache.maven.plugins:maven-compiler-plugin:3.10.1:compile failed: Plugin org.apache.maven.plugins:maven-compiler-plugin:3.10.1 or one of its dependencies could not be resolved: Failure to find com.dremio.tools:errorprone-dremio:jar:24.0.0-202302100528110223-3a169b7c in https://maven.dremio.com/free/ was cached in the local repository, resolution will not be reattempted until the update interval of dremio-free has elapsed or updates are forced -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/PluginResolutionException

I think I’m failing to update the pom.xml correctly (I have 0 experience in Java)
what version should I put ? and where ?

Is there another Prometheus exporter ?

Thank you

balaji.ramaswamy · April 9, 2023, 8:25pm

@jjournet Sorry for the delay, any chance you tried to run it again with the -e switch?

[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.

balaji.ramaswamy · April 10, 2023, 4:33am

@jjournet

We dont need to do this any more. We automatically expose prometheus metrics via http endpoint.

Can you please try and let us know

Thanks
Bali

rs_trey · August 22, 2023, 8:42pm

I’ve also been trying to build this plugin as I was not aware that Dremio now exposed the metrics natively. Can you share the scrape endpoint? Also, is there any updated documentation that explains how to configure the build-in metrics?

balaji.ramaswamy · August 24, 2023, 5:35am

@rs_trey

Would the below 2 help?

github.com

dremio/dremio-oss/blob/07ab5d99b4fa14b77f12043f2640b1273f7886d5/services/telemetry-api/src/main/java/com/dremio/telemetry/api/metrics/Metrics.java

/*
 * Copyright (C) 2017-2019 Dremio Corporation
 *
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */
package com.dremio.telemetry.api.metrics;

import java.lang.management.ManagementFactory;
import java.time.Duration;
import java.util.Collection;

This file has been truncated. show original

rs_trey · August 24, 2023, 1:05pm

Whoa, thank you! The “Monitoring System Telemetry” page I kept reading still referenced the third-party exporter. I modified my StatefulSets and ConfigMap and can now see the metrics. Now to update my copy of the helm chart (since PRs aren’t accepted). Thanks again!

balaji.ramaswamy · August 29, 2023, 3:46am

Thanks for the update @rs_trey Glad you are unblocked