# IOException: No space left on device in the Dremio like AWS Service

**URL:** <https://community.dremio.com/t/ioexception-no-space-left-on-device-in-the-dremio-like-aws-service/8912>\
**Category:** Uncategorized\
**Created:** [March 21, 2022, 1:08pm UTC](https://community.dremio.com/t/ioexception-no-space-left-on-device-in-the-dremio-like-aws-service/8912 "2022-03-21T13:08:36Z")\
**Posts on this page:** 2\
**Page:** 1

<div class="post-metadata">

**Author:** ![lucasft](https://avatars.discourse-cdn.com/v4/letter/l/df788c/32.png) [@lucasft](https://community.dremio.com/u/lucasft)\
**Post date:** [March 21, 2022, 1:08pm UTC](https://community.dremio.com/t/ioexception-no-space-left-on-device-in-the-dremio-like-aws-service/8912/1 "2022-03-21T13:08:36Z")

</div>

This problem occured in Dremio like AWS Service. Why occured this and how I can fixed?  
 ![image](https://us1.discourse-cdn.com/flex020/uploads/dremio/original/2X/e/e3fff23432397919790e9b1313702494d1072d2d.png)  
Job Profile:  
SYSTEM ERROR: IOException: No space left on device

SqlOperatorImpl EXTERNAL\_SORT  
Location 4:9:1  
Fragment 4:0

[Error Id: ec47f97d-af30-4d97-b13c-631d08ab9140 on 192.168.5.134:0]

(java.io.IOException) No space left on device  
java.io.FileOutputStream.writeBytes():-2  
java.io.FileOutputStream.write():326  
java.io.BufferedOutputStream.flushBuffer():82  
java.io.BufferedOutputStream.write():126  
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream.write():224  
com.dremio.exec.store.OutputStreamWithStats.write():70  
net.jpountz.lz4.LZ4BlockOutputStream.flushBufferedData():223  
net.jpountz.lz4.LZ4BlockOutputStream.write():176  
com.dremio.exec.store.OutputStreamWithStats.write():70  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeViaCopy():233  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeToStream():204  
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream.writeBatch():256  
com.dremio.sabot.op.sort.external.DiskRunManager.spillBatch():636  
com.dremio.sabot.op.sort.external.DiskRunManager.spillNextBatch():578  
com.dremio.sabot.op.sort.external.MemoryRun.spillNextBatch():327  
com.dremio.sabot.op.sort.external.ExternalSortOperator.outputData():354  
com.dremio.sabot.driver.SmartOp$SmartSingleInput.outputData():188  
com.dremio.sabot.driver.StraightPipe.pump():56  
com.dremio.sabot.driver.Pipeline.doPump():108  
com.dremio.sabot.driver.Pipeline.pumpOnce():98  
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():345  
com.dremio.sabot.exec.fragment.FragmentExecutor.run():294  
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1600():94  
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():747  
com.dremio.sabot.task.AsyncTaskWrapper.run():112  
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():243  
com.dremio.sabot.task.slicing.SlicingThread.run():171

Failure node: 192.168.21.228:31010  
Error ID: fa4e8dcc-8d91-4338-888a-e0e3f3dd156c

Verbose:  
SYSTEM ERROR: IOException: No space left on device

SqlOperatorImpl EXTERNAL\_SORT  
Location 4:9:1  
Fragment 4:0

[Error Id: ec47f97d-af30-4d97-b13c-631d08ab9140 on 192.168.5.134:0]

(java.io.IOException) No space left on device  
java.io.FileOutputStream.writeBytes():-2  
java.io.FileOutputStream.write():326  
java.io.BufferedOutputStream.flushBuffer():82  
java.io.BufferedOutputStream.write():126  
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream.write():224  
com.dremio.exec.store.OutputStreamWithStats.write():70  
net.jpountz.lz4.LZ4BlockOutputStream.flushBufferedData():223  
net.jpountz.lz4.LZ4BlockOutputStream.write():176  
com.dremio.exec.store.OutputStreamWithStats.write():70  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeViaCopy():233  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeToStream():204  
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream.writeBatch():256  
com.dremio.sabot.op.sort.external.DiskRunManager.spillBatch():636  
com.dremio.sabot.op.sort.external.DiskRunManager.spillNextBatch():578  
com.dremio.sabot.op.sort.external.MemoryRun.spillNextBatch():327  
com.dremio.sabot.op.sort.external.ExternalSortOperator.outputData():354  
com.dremio.sabot.driver.SmartOp$SmartSingleInput.outputData():188  
com.dremio.sabot.driver.StraightPipe.pump():56  
com.dremio.sabot.driver.Pipeline.doPump():108  
com.dremio.sabot.driver.Pipeline.pumpOnce():98  
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():345  
com.dremio.sabot.exec.fragment.FragmentExecutor.run():294  
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1600():94  
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():747  
com.dremio.sabot.task.AsyncTaskWrapper.run():112  
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():243  
com.dremio.sabot.task.slicing.SlicingThread.run():171

SqlOperatorImpl EXTERNAL\_SORT  
Location 4:9:1  
Fragment 4:0

…(:0)  
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream(LocalSyncableFileSystem.java:224)  
com.dremio.exec.store.OutputStreamWithStats(OutputStreamWithStats.java:70)  
net.jpountz.lz4.LZ4BlockOutputStream(LZ4BlockOutputStream.java:223)  
net.jpountz.lz4.LZ4BlockOutputStream(LZ4BlockOutputStream.java:176)  
com.dremio.exec.store.OutputStreamWithStats(OutputStreamWithStats.java:70)  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable(VectorAccessibleFlatBufSerializable.java:233)  
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable(VectorAccessibleFlatBufSerializable.java:204)  
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream(SpillManager.java:256)  
com.dremio.sabot.op.sort.external.DiskRunManager(DiskRunManager.java:636)  
com.dremio.sabot.op.sort.external.DiskRunManager(DiskRunManager.java:578)  
com.dremio.sabot.op.sort.external.MemoryRun(MemoryRun.java:327)  
com.dremio.sabot.op.sort.external.ExternalSortOperator(ExternalSortOperator.java:354)  
com.dremio.sabot.driver.SmartOp$SmartSingleInput(SmartOp.java:188)  
com.dremio.sabot.driver.StraightPipe(StraightPipe.java:56)  
com.dremio.sabot.driver.Pipeline(Pipeline.java:108)  
com.dremio.sabot.driver.Pipeline(Pipeline.java:98)  
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper(FragmentExecutor.java:345)  
com.dremio.sabot.exec.fragment.FragmentExecutor(FragmentExecutor.java:294)  
com.dremio.sabot.exec.fragment.FragmentExecutor(FragmentExecutor.java:94)  
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl(FragmentExecutor.java:747)  
com.dremio.sabot.task.AsyncTaskWrapper(AsyncTaskWrapper.java:112)  
com.dremio.sabot.task.slicing.SlicingThread(SlicingThread.java:243)  
com.dremio.sabot.task.slicing.SlicingThread(SlicingThread.java:171)

---

<div class="post-metadata">

**Author:** ![balaji.ramaswamy](https://sea2.discourse-cdn.com/flex020/user_avatar/community.dremio.com/balaji.ramaswamy/32/843_2.png) [@balaji.ramaswamy](https://community.dremio.com/u/balaji.ramaswamy)\
**Post date:** [March 21, 2022, 10:58pm UTC](https://community.dremio.com/t/ioexception-no-space-left-on-device-in-the-dremio-like-aws-service/8912/2 "2022-03-21T22:58:26Z")

</div>

@lucasft Your query started to spill and there was no space left on disk. Are you spilling to default location? `/var/lib/dremio`? Can you please look at your dremio.conf on the executor and see if you specified a spill location