Input Bytes size mismatch Reflection Footprint

1

Hi Dremio Team,

Iam using Dremio 13.x community version and I executed one test like,

Loaded 15 M records file size 1.1 GB into MySQL DB, the loaded data size in MySQL server was 1.7 GB, when raw reflection enables on that table it took 280.74 MB in Dremio reflection footprint this all are looks matching, but input bytes in refresh Job profile showing 8.12 GB. what it mean exactly, why size variation?

Thanks,
Ajay Babu Maguluri

2

@AjayBabuM Input bytes are the amount of data generated in Arrow format by the reader, not bytes scanned from disk so can be significantly large