Cleanup failed: engine ARCTIC_OPTIMIZATION_ENGINE did not start (no active replicas)

Dremio Cloud
1

Hello,

I’m having trouble with table cleanup, with the following error:

was canceled as the _ARCTIC_OPTIMIZATION_ENGINE_ engine did not start. No active engine replicas available.

I configured an engine called _ARCTIC_OPTIMIZATION_ENGINE_ with the following settings:

  • Engine Name: ARCTIC_OPTIMIZATION_ENGINE
  • Instance Family: m6id
  • Size: 2XSmall (1 m6id.4xlarge node)
  • Max Concurrency per Replica: 2
  • Min Replicas: 1
  • Max Replicas: 2
  • Last Replica Auto-Stop (secs): 7200
  • Enqueued Time Limit: 20 minutes
  • Drain Time Limit: 1800

Even with the manually created engine and the configured table cleanup, the error persists in all jobs daily. Previously, I was using Instance Family: m5d and Enqueued Time Limit: 5 minutes and was getting the same error. After changing the settings, the error persisted.

2

Hi @barbara.brito Would you be able to check if there was an issue during engine startup? Might be possible the engine never came up and that could explain why the query is failing