Reflections don't seem to be refreshing

1

Reflections don’t seem to be refreshing, stuck on 0B footprint.

2

@gregory-drumwave Could be due to multiple reasons, does the job profile tell you something? Any error stack in server.log on the coord and executors?

3

I see I am getting this error:

`DATA_WRITE ERROR: CTAS query cancelled because it will generate more than the limit of 10000 partitions. You can retry the query using a different column for PARTITION BY.

SqlOperatorImpl PARQUET_WRITER
Location 2:45:1
ErrorOrigin: EXECUTOR
[Error Id: 509d70eb-5d46-413c-9fee-e0f90cef102b ]`

But I don’t set any column to be a partition

4

@gregory-drumwave Can you please upload the job profile?

5

fwiw, the max number of partitions in a single write job is limited to 10K which can be changed via:

store.max_partitions