Not able to join VDM

1

Hi ,
I did windows local Dremio installation and uploaded three xls files and created three PDM.

1st
1st.png982×194 7.8 KB

  1. Master Data
  2. Product actuals
  3. product planned
    Then created three VDM for the same:
    2
    2.png741×345 7.46 KB

    1)Master
  4. Actuals
  5. Plan Data
    My intention is to create join between all three VDM. So first I clicked upon “Actuals” VDM then clicked upon Join icon. Then when I try to open my space my VDM’s are not listed I could see only the PDM at my Root level.
    3
    3.png1150×691 25.2 KB

    not sure why my VDM is not listed. AM I missing something here?
    Thanks & Regards
    A.Dinesh
2

Hi ,
Can anyone help me here? Currently we are evaluating Dremio for our project.In our POC basic Join and union operation itself has issues .This has put lot of questions in our mind …it will be great if someone help us here.

Thanks
A.Dinesh

3

As a tip, you could create a VDS that is a join of the three PDS. It isn’t necessary to first create a VDS before creating the join.

That aside, not sure what is happening. Did you create your VDS with the same user?

Can you try making your files accessible via the local filesystem instead of uploading into Dremio? You can read more about how to do this here: https://docs.dremio.com/data-sources/files-and-directories.html

Kelly

4

Hi Kelly,
Thanks for quick response, you do a great job by helping people and I am a big fan of you…
Coming to my question

  1. The erason for creating VDS 1st is, we are planning for a structured development process guideline. As a part of it we have to clean up the data first before we do any join operation.
  2. I am not sure about accessing data from local file system, will try exploring it. But in our current POC scope we have to upload it to Dremio only in the case it will not work we will re consider that option.

Thanks
A.Dinesh

5

  1. OK, that makes sense. :slight_smile:

  2. When you upload files to Dremio they are private to the user. Other users will not be able to see the data there. When you access data through any of the connectors, including the local file system, then 1) everyone can access them, and 2) you can update the data and Dremio will always see the latest.

6

Thanks Kelly ,I get you now, but in my case it was me who uploaded the data to dremio and created PDM ,VDM and then tried to join them . So I am not sure access comes into picture.

One stupid question- I have installed Dremio in my Laptop which is very much limited in terms of recourses . Will that come into play here?

Thanks
Dinesh

7

Yes, Dremio is designed for cluster deployments with plenty of memory across many instances. The single node downloads are for trying Dremio out.

You might have a better experience in Dremio University, and that will give you a private instance for 48 hours.

8

I have completed my Dremio fundamentals and Reflection Certifications … It was very useful, but believe me even there I faced many issues .
We are setting up our Dremio instance in a distributed landscape, should be ready sooner.
I have posted another question regarding the UNION operations in Dremio can you check and help me :slight_smile:

Thanks
Dinesh