Disk Error Exception

1

Hi, guys! After a long time without using it, I’m getting this error below when trying to do any operation (even trying to open the Node Activity section) on Dremio 1.1 EC2 using S3 as datastore:

I have 2 machines, 1 executor/master + 1 executor only.

Profile:
f558f09e-04b4-4f8e-9e8c-0fa5d934659e.zip (4.8 KB)

SYSTEM ERROR: DiskErrorException: No space available in any of the local directories.

SqlOperatorImpl ARROW_WRITER
Location 0:0:3
SqlOperatorImpl ARROW_WRITER
Location 0:0:3
Fragment 0:0

[Error Id: 4198aac1-3441-470a-a2c2-e32951ad862a on dremio-master-01:31010]

Any ideas?

2

Hi @allan.sene,

Can you please send me the df -h output of both the servers? it looks like you are running out of space on one of your local file systems

Thanks
@balaji.ramaswamy

3

Hi @balaji.ramaswamy,

I’d already check disk space on both servers. Seems to be ok. Look:

[ec2-user@dremio-master-01 ~]$ df -h
Sist. Arq.      Tam. Usado Disp. Uso% Montado em
devtmpfs         15G   60K   15G   1% /dev
tmpfs            15G     0   15G   0% /dev/shm
/dev/xvda1       40G  2,2G   38G   6% /

[ec2-user@dremio-executor-01 ~]$ df -h
Sist. Arq.      Tam. Usado Disp. Uso% Montado em
devtmpfs         15G   60K   15G   1% /dev
tmpfs            15G     0   15G   0% /dev/shm
/dev/xvda1       40G  2,2G   38G   6% /
4

That’s odd… just rebooted both machines and all come back to normal. lol :thinking: :joy:

Thanks anyway, Balaji!