Primary Key or avoid duplicate records

1

Hi there!!! :slight_smile:

We are loading some files inside a folder, and setting the format in the folder. Everythings is fine, until someone add a new file in the folder with same records…(with other filename)
How to avoid duplicate records ??
How to define a primary key??
There is some way, to validate that new records wasn’t loading before??

Thanks in advance

Regards
AJM

1 Like
2

Hi @AlejandroJMelo

We currently do not support primary key enforcement in Dremio. You can try and clean the data using SQL after it is promoted in Dremio

Thanks
@balaji.ramaswamy

1 Like
3

so now it’s available @balaji.ramaswamy or not cuase we desperately finding solution on this!

4

@mevadadhruv

It is not available