I installed Dremio CE (v 22.0.0-202206221430090603-1fa4049f
) on an EC2 instance.
Configured IAM Role profiles giving permissions to a S3 bucket for reading and writing (as said on Dremio docs).
Configured dremio.conf with the param:
Configured the file core-site.xml file with this content:
<?xml version="1.0"?> <configuration> <property> <name>fs.dremioS3.impl</name> <description>The FileSystem implementation. Must be set to com.dremio.plugins.s3.store.S3FileSystem</description> <value>com.dremio.plugins.s3.store.S3FileSystem</value> </property> <property> <name>fs.s3a.aws.credentials.provider</name> <description>The credential provider type.</description> <value>com.amazonaws.auth.InstanceProfileCredentialsProvider</value> </property> </configuration>
Connected a mongodb source and write some queries…
After creating the reflections (the files are shown in S3), I stopped to have results on my queries!
When I click “preview” button, I got data. Nice…
In the same query, when I click “Run”, the result panel “flashes” a little, and get the “No results” message.
I noticed this only happens when using the FLATTEN command… here is my query:
SELECT code, date_start, nested_0.group_platform.transactions AS platform_transactions, nested_0.group_platform.sessions AS platform_sessions, nested_0.group_platform."_id" AS platform_name FROM ( SELECT code, date_start, FLATTEN(group_platform) AS group_platform FROM MySource.summaries AS summaries ) nested_0
When using the default reflection storage method (in data folder), this behavior didn’t happen. Reflections are created and the data is shown correctly (more than 600k rows).
I’m new to Dremio and this is driving me nuts!
What may be causing this behavior? Maybe I could limit myself to store reflections on EBS…