Error while creating reflections in Dremio OSS 25.0

Benny_Chow · May 11, 2024, 12:29am

I found the bug and this problem only affects OSS.

Since you can modify and rebuild the files.

Add the following:

  BooleanValidator EXCLUDE_INCREMENTAL_ICEBERG =
      new BooleanValidator(
          "reflections.planning.exclude.file_based_incremental.iceberg.accelerations", true);

To:

github.com

dremio/dremio-oss/blob/master/services/accelerator/src/main/java/com/dremio/service/reflection/ReflectionOptions.java

/*
 * Copyright (C) 2017-2019 Dremio Corporation
 *
 * Licensed under the Apache License, Version 2.0 (the "License");
 * you may not use this file except in compliance with the License.
 * You may obtain a copy of the License at
 *
 *     http://www.apache.org/licenses/LICENSE-2.0
 *
 * Unless required by applicable law or agreed to in writing, software
 * distributed under the License is distributed on an "AS IS" BASIS,
 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
 * See the License for the specific language governing permissions and
 * limitations under the License.
 */
package com.dremio.service.reflection;

import com.dremio.options.Options;
import com.dremio.options.TypeValidators.BooleanValidator;
import com.dremio.options.TypeValidators.PositiveLongValidator;

This file has been truncated. show original

Rebuild that jar and you should be good. The issue is that the option cannot be found here: dremio-oss/services/accelerator/src/main/java/com/dremio/service/reflection/refresh/RefreshHandler.java at master · dremio/dremio-oss · GitHub

I’ve logged a bug internally to fix this.

Topic		Replies	Views
Can't create any reflections - The option 'reflections.planning.exclude.file_based_incremental.iceberg.accelerations' does not exist	22	53	September 3, 2024
Unable to disable dremio.iceberg.enabled support key in 25.0 version	1	29	September 14, 2024
Failure to create Aggregation Reflections	5	1556	October 10, 2020
Reflection error	4	136	September 26, 2024
Issue with Querying Views Not Utilizing Reflections in Dremio 25.0 OSS	1	113	May 20, 2024

Error while creating reflections in Dremio OSS 25.0

Related topics