Hi Everyone,
Can you please help me with this, Getting this error while running api,
I accepted json output.
Following This Document: Job Results | Dremio Documentation
Need quick help please let me know if you know how to solve this. We want to check the data that job has returned But there is no other way I found.
Just for update, We are using dremio cloud I was using dremio softeware url, But now we are using correct url and getting this error.
Url we are following: Job Results | Dremio Documentation
Let me know if you know what this error suggests and If there is way to solve this.
@balaji.ramaswamy can you please help me with this
Regards,
Fenil Jain.
@fenilj I am wondering if the engine scaled down, the results are available 1 day but if the engine stops before that, it will be lost
@balaji.ramaswamy We have configured engine setup like when it is in idle mode for 5 minutes it will scale down. so engine is online for approximately 9 or 10 minutes.
So If I understood correctly we can only run that job result api when we ran the query with that particular timespan of engine scale up time?
And I have tried to execute query after making the engine online but still got the error.
@fenilj Can you try to run the API right after the job completes, before the engine shuts down?
Hi @balaji.ramaswamy Thanks for reply, But I also raise the ticket in dremio support they said it is not possible with our configuration. and it stores the data if it is triggered from api and we are running from arrow flight apache sql driver. And after engine is scaled down I think it removes the data result.
So we are not looking into this anymore.
@fenilj That is correct, results are only available till you scale down. On a K8’s environment, if the disk is persistent then it should be available across restarts
