# Option to skip invalid rows

**URL:** https://community.dremio.com/t/option-to-skip-invalid-rows/323
**Category:** Uncategorized
**Created:** [October 2, 2017, 3:42pm UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323 "2017-10-02T15:42:42Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![gerald](https://avatars.discourse-cdn.com/v4/letter/g/ea666f/32.png) [@gerald](https://community.dremio.com/u/gerald)
#### Post date: [October 2, 2017, 3:42pm UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323/1 "2017-10-02T15:42:42Z")

</div>

Hello,

It seems that Dremio immediately stops processing local files that contain things like invalid UTF-8 sequences (DATA\_READ ERROR: Error parsing JSON - Invalid UTF-8 middle byte).

It would be convenient to have an option to be able to skip invalid rows like this, instead of pre-processing the files first before being able to use them in Dremio.

best,  
Gerald

---

<div class="post-metadata">

### Author: ![can](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/can/32/40_2.png) [@can](https://community.dremio.com/u/can)
#### Post date: [October 11, 2017, 8:42pm UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323/2 "2017-10-11T20:42:48Z")

</div>

@gerald, makes sense – actually something we’ve been internally discussing. We don’t have a timeline for this yet, but we’ll announce on the community when it’s available.

---

<div class="post-metadata">

### Author: ![gerald](https://avatars.discourse-cdn.com/v4/letter/g/ea666f/32.png) [@gerald](https://community.dremio.com/u/gerald)
#### Post date: [October 22, 2017, 3:03pm UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323/3 "2017-10-22T15:03:18Z")

</div>

here is one more case i just ran into:

Numeric value (9223372036854776000) out of range of long (-9223372036854775808 - 9223372036854775807) at [Source: com.dremio.exec.store.dfs.FSDataInputStreamWrapper@6e312551: com.dremio.exec.store.dfs.FSDataInputStreamWrapper$WrappedInputStream@7c8729e5; line: 2, column: 4530]

---

<div class="post-metadata">

### Author: ![Sukku](https://avatars.discourse-cdn.com/v4/letter/s/e0b2c6/32.png) [@Sukku](https://community.dremio.com/u/Sukku)
#### Post date: [April 10, 2023, 11:50am UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323/4 "2023-04-10T11:50:41Z")

</div>

Do we have any option to skip invalid rows in the latest version of Dremio?

---

<div class="post-metadata">

### Author: ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)
#### Post date: [April 11, 2023, 3:46pm UTC](https://community.dremio.com/t/option-to-skip-invalid-rows/323/5 "2023-04-11T15:46:05Z")

</div>

@Sukku What is the file format? If CSV, JSON, you can use the COPY INTO feature in 24.0 and see if any of the options help? Are you able to send a sample if CSV or JSON that contains the bad record?

[https://docs.dremio.com/cloud/sql/commands/copy-into-table/](https://docs.dremio.com/cloud/sql/commands/copy-into-table/)
