Formatted folder that has sub folders

1

My datasource from hdfs has subfolders for partition based on a date field. However, my metadata could be changed with more fields added. When I formatted the parent folder, it failed because some folders have more fields than others. How can this issue be resolved?

Regards,
Mark

2

@markylin What is the error you are getting, is the partition level different across folders?

3

Hi Balaji,

Interesting. I am not able to reproduce the error today. I remember it is a parsing error. Let me come back to you when it happens.

Regards,
Mark