Hi Team,
I am using dremio-community-25.0.5.x with SingleStore 5.7.x, and have a table called cust_rec_data , When I am executing a query as,
It’s push down as,
The highlighted CAST
syntax is supported in MySQL and Oracle, but not in SingleStore. I tried multiple ways it’s showing same, Please suggest a workaround. I am attaching the query profile and ARP file.
b47063c9-6836-487b-92af-0d011dfe82eb.zip (16.9 KB)
singlestore-arp.zip (6.3 KB)
ARP file was copied from MySQL since most of the SingleStore queries is compatible with MySQL.
Thanks,
Ajay Babu Maguluri.
Hi Team,
Any update?
Thanks,
Ajay Babu Maguluri.
@AjayBabuM Unfortunately SingleStore is not a source that we currently test on. I am not sure if all pushdowns to MySQL from the Dremio side would work on SingleStore.
Try running this pushdown on Singlestore and see where the issue is. That will narrow down of this is something that needs to fixed in ARP framework to SingleStore which you can try to implement
SELECT CAST(DATE '2024-09-30' AS DATE) AS `event_date`, `msisdn`, `rec_amount`
FROM (SELECT `cust_rec_data`.`event_date`, `cust_rec_data`.`msisdn`, `cust_rec_data`.`rec_amount`
FROM `cust_rec_data`) AS `cust_rec_data`
WHERE `event_date` = DATE '2024-09-30'
Hi @balaji.ramaswamy
I already executed query directly on Singlestore, As I highlighted in in my conversation DATE
at cast and where clause was making issue. If I run without DATE
like,
SELECT CAST('2024-09-30' AS DATE) AS `event_date`, `msisdn`, `rec_amount`
FROM (SELECT `cust_rec_data`.`event_date`, `cust_rec_data`.`msisdn`, `cust_rec_data`.`rec_amount`
FROM `cust_rec_data`) AS `cust_rec_data`
WHERE `event_date` = '2024-09-30'
It’s working fine. Is possible to handle it in ARP? actually I tried multiple changes in ARP but it’s pushdown as same. So please suggest want need to do.
Thanks,
Ajay Babu Maguluri.
@AjayBabuM Currently Singlestore is not in the roadmap. Even if this works, this query will not be efficient as compared to querying of Iceberg. Are there plans to move data to a lake in Iceberg format?
@balaji.ramaswamy As of now, there are no specific plans. We expect Dremio to provide a semantic interface for BI tools to interact with different datasets in the Singestore warehouse. It would be greatly appreciated if you could provide a workaround for this.
Thanks,
Ajay Babu Maguluri,
Hi Team,
Kindly help, It’s a showstopper to me. What changes required in ARP framework.
Thanks,
Ajay Babu Maguluri.
Hi Team,
Kindly update?
Thanks
Ajay Babu Maguluri.
@AjayBabuM Again, As explained earlier, Singlestore is currently not a supported source.