Uploading local CSV size limitations?

Hi everyone,

I’m trying to upload a local 3 GB csv file in my personal space (the top right + purple table button). When I drag and drop the file into the dialog box, I get a crash error (default Chrome webpage display error).

Is there a size limit to the local csv upload? Also, is my problem arising from browser issues? Should I be using another browser?

Thanks,
Jackson

Hi @Jackson

There is no hard coded limit, it depends on the memory limitations of your browser and system. typically files with up to millions of records and few hundred megabytes should work without issues.

Thanks,
@balaji.ramaswamy

1 Like

@Jackson if you are using a single node instance, a simple trick is to add your local FS as a NAS source.

To do this:

  • Add a new “NAS” source.
  • Configure Mount > Path to a local path. Use “/” if you want to mount to the root.
  • You can now browse your local FS in Dremio and browse datasets of any size.
1 Like

Thanks @can, using the NAS option helped!

Thanks @balaji.ramaswamy, I guess perhaps I was uploading more memory than I have. I used @can solution below and it worked.

1 Like

Glad @can’s workaround worked … Kindly let us know if any further questions

Thanks,
@balaji.ramaswamy