This problem occured in Dremio like AWS Service. Why occured this and how I can fixed?
Job Profile:
SYSTEM ERROR: IOException: No space left on device
SqlOperatorImpl EXTERNAL_SORT
Location 4:9:1
Fragment 4:0
[Error Id: ec47f97d-af30-4d97-b13c-631d08ab9140 on 192.168.5.134:0]
(java.io.IOException) No space left on device
java.io.FileOutputStream.writeBytes():-2
java.io.FileOutputStream.write():326
java.io.BufferedOutputStream.flushBuffer():82
java.io.BufferedOutputStream.write():126
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream.write():224
com.dremio.exec.store.OutputStreamWithStats.write():70
net.jpountz.lz4.LZ4BlockOutputStream.flushBufferedData():223
net.jpountz.lz4.LZ4BlockOutputStream.write():176
com.dremio.exec.store.OutputStreamWithStats.write():70
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeViaCopy():233
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeToStream():204
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream.writeBatch():256
com.dremio.sabot.op.sort.external.DiskRunManager.spillBatch():636
com.dremio.sabot.op.sort.external.DiskRunManager.spillNextBatch():578
com.dremio.sabot.op.sort.external.MemoryRun.spillNextBatch():327
com.dremio.sabot.op.sort.external.ExternalSortOperator.outputData():354
com.dremio.sabot.driver.SmartOp$SmartSingleInput.outputData():188
com.dremio.sabot.driver.StraightPipe.pump():56
com.dremio.sabot.driver.Pipeline.doPump():108
com.dremio.sabot.driver.Pipeline.pumpOnce():98
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():345
com.dremio.sabot.exec.fragment.FragmentExecutor.run():294
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1600():94
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():747
com.dremio.sabot.task.AsyncTaskWrapper.run():112
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():243
com.dremio.sabot.task.slicing.SlicingThread.run():171
Failure node: 192.168.21.228:31010
Error ID: fa4e8dcc-8d91-4338-888a-e0e3f3dd156c
Verbose:
SYSTEM ERROR: IOException: No space left on device
SqlOperatorImpl EXTERNAL_SORT
Location 4:9:1
Fragment 4:0
[Error Id: ec47f97d-af30-4d97-b13c-631d08ab9140 on 192.168.5.134:0]
(java.io.IOException) No space left on device
java.io.FileOutputStream.writeBytes():-2
java.io.FileOutputStream.write():326
java.io.BufferedOutputStream.flushBuffer():82
java.io.BufferedOutputStream.write():126
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream.write():224
com.dremio.exec.store.OutputStreamWithStats.write():70
net.jpountz.lz4.LZ4BlockOutputStream.flushBufferedData():223
net.jpountz.lz4.LZ4BlockOutputStream.write():176
com.dremio.exec.store.OutputStreamWithStats.write():70
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeViaCopy():233
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable.writeToStream():204
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream.writeBatch():256
com.dremio.sabot.op.sort.external.DiskRunManager.spillBatch():636
com.dremio.sabot.op.sort.external.DiskRunManager.spillNextBatch():578
com.dremio.sabot.op.sort.external.MemoryRun.spillNextBatch():327
com.dremio.sabot.op.sort.external.ExternalSortOperator.outputData():354
com.dremio.sabot.driver.SmartOp$SmartSingleInput.outputData():188
com.dremio.sabot.driver.StraightPipe.pump():56
com.dremio.sabot.driver.Pipeline.doPump():108
com.dremio.sabot.driver.Pipeline.pumpOnce():98
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper.run():345
com.dremio.sabot.exec.fragment.FragmentExecutor.run():294
com.dremio.sabot.exec.fragment.FragmentExecutor.access$1600():94
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl.run():747
com.dremio.sabot.task.AsyncTaskWrapper.run():112
com.dremio.sabot.task.slicing.SlicingThread.mainExecutionLoop():243
com.dremio.sabot.task.slicing.SlicingThread.run():171
SqlOperatorImpl EXTERNAL_SORT
Location 4:9:1
Fragment 4:0
…(:0)
com.dremio.exec.store.LocalSyncableFileSystem$LocalSyncableOutputStream(LocalSyncableFileSystem.java:224)
com.dremio.exec.store.OutputStreamWithStats(OutputStreamWithStats.java:70)
net.jpountz.lz4.LZ4BlockOutputStream(LZ4BlockOutputStream.java:223)
net.jpountz.lz4.LZ4BlockOutputStream(LZ4BlockOutputStream.java:176)
com.dremio.exec.store.OutputStreamWithStats(OutputStreamWithStats.java:70)
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable(VectorAccessibleFlatBufSerializable.java:233)
com.dremio.exec.cache.VectorAccessibleFlatBufSerializable(VectorAccessibleFlatBufSerializable.java:204)
com.dremio.sabot.op.sort.external.SpillManager$SpillOutputStream(SpillManager.java:256)
com.dremio.sabot.op.sort.external.DiskRunManager(DiskRunManager.java:636)
com.dremio.sabot.op.sort.external.DiskRunManager(DiskRunManager.java:578)
com.dremio.sabot.op.sort.external.MemoryRun(MemoryRun.java:327)
com.dremio.sabot.op.sort.external.ExternalSortOperator(ExternalSortOperator.java:354)
com.dremio.sabot.driver.SmartOp$SmartSingleInput(SmartOp.java:188)
com.dremio.sabot.driver.StraightPipe(StraightPipe.java:56)
com.dremio.sabot.driver.Pipeline(Pipeline.java:108)
com.dremio.sabot.driver.Pipeline(Pipeline.java:98)
com.dremio.sabot.exec.fragment.FragmentExecutor$DoAsPumper(FragmentExecutor.java:345)
com.dremio.sabot.exec.fragment.FragmentExecutor(FragmentExecutor.java:294)
com.dremio.sabot.exec.fragment.FragmentExecutor(FragmentExecutor.java:94)
com.dremio.sabot.exec.fragment.FragmentExecutor$AsyncTaskImpl(FragmentExecutor.java:747)
com.dremio.sabot.task.AsyncTaskWrapper(AsyncTaskWrapper.java:112)
com.dremio.sabot.task.slicing.SlicingThread(SlicingThread.java:243)
com.dremio.sabot.task.slicing.SlicingThread(SlicingThread.java:171)