Problem with Mongo 4.0.13

[Bruno_Mata]

We have a dremio cluster running on EKS using a image of dremio oss 4.0.4 and we are facing a error with a mongo 4.0.13 when accessing data:

SYSTEM ERROR: UnsupportedOperationException

SqlOperatorImpl MONGO_SUB_SCAN
Location 0:0:7
Fragment 0:0

[Error Id: ce97f11c-7b8c-478f-b3a6-323af05ae040 on dremio-executor-0.dremio-cluster-pod.dremio.svc.cluster.local:-1]

(java.lang.UnsupportedOperationException) null
java.util.Collections$UnmodifiableMap.put():1459
com.dremio.plugins.mongo.execution.BsonRecordReader.writeDecimal():319
com.dremio.plugins.mongo.execution.BsonRecordReader.writeToListOrMap():145
com.dremio.plugins.mongo.execution.BsonRecordReader.writeToListOrMap():141
com.dremio.plugins.mongo.execution.BsonRecordReader.writeToListOrMap():141
com.dremio.plugins.mongo.execution.BsonRecordReader.write():65
com.dremio.plugins.mongo.execution.MongoRecordReader.next():251
com.dremio.sabot.op.scan.ScanOperator.outputData():231
com.dremio.sabot.driver.SmartOp$SmartProducer.outputData():521
com.dremio.sabot.driver.StraightPipe.pump():56
com.dremio.sabot.driver.Pipeline.doPump():109
com.dremio.sabot.driver.Pipeline.pumpOnce():99
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():320
com.dremio.sabot.exec.fragment.FragmentExecutor.run():273
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1200():87
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():658
com.dremio.sabot.task.AsyncTaskWrapper.run():104
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():226
com.dremio.sabot.task.slicing.SlicingThread.run():156

Is this mongo version fully supported? The connection work fine, how I said, the error is only thrown when selecting the data.

The profile is attached.

Let me know if have something that I can do.

Thanks;
Bruno Mata

127a3c4e-7bd4-4b07-9cff-ed962ade35d3.zip (9,3,KB)

[pbofonseca]

I have the same issue here!

[balaji.ramaswamy]

@Bruno_Mata @pbofonseca

Currently we do not support Mongo 4.x. It is certainly in our roadmap

Thanks
@balaji.ramaswamy

[pbofonseca]

Are you sure?

Cannot connect to MongoDB from Dremio

Just for feedback, I have managed to connect to MongoDB 4 with Dremio. I am not sure how it started working though. (I have not upgraded my version of Dremio yet when it started working again.) However, just providing feedback here that Dremio can connect to MongoDB 4 as well. Thanks!

Cannot connect to MongoDB from Dremio

Hi @ben , I am currently using Dremio Build 3.2.3, which connects to MongoDB 4 without a problem. (This is probably the wrong place to say this, but I just want to say that Dremio is awesome. I have tried many other alternatives to connect to and query MongoDB, but the features provided by Dremio is spot-on for our requirements. Thanks also for the Community Edition, which provides a very accessible and realistic way of getting up to speed with Dremio and getting real value from Dremio.)

[pbofonseca]

Hi, @ben!

Could you help us here?

Thanks!

[ben]

Hi @pbofonseca,

As @balaji.ramaswamy noted, we don’t currently support MongoDB 4.0.x, which basically means we do not test against it (currently). Again, support for the latest Mongo is on our roadmap.

[jveraduran]

Hi @balaji.ramaswamy @ben,

Any update about this? I’m working now with the community last version, and I’m able to connect with Mongodb 4.0 but not with 4.2.

I’m evaluating with Comercial Team to buy enterprise license but this is and stopper for my team now.

Please tell me if you have on roadmap deliver new version with this feature.

Thanks.