Does COPY INTO ... from a bunch of files provide $file?

1

Hello all,

I’m doing a
copy into somewhere.something AT BRANCH “main”
from ‘@thither.yon’ REGEX ‘c2…_a.csv’ FILE_FORMAT ‘csv’ (EXTRACT_HEADER TRUE);

and provided a “$file” column in the target table, but it’s always null. Does COPY INTO from a flock of files support the $file field? If so, what am I missing? Thanks!

Brent Laminack

2

@ibrentlam

Can you please send us

  • Create table DDL of the Iceberg table
  • Job profile of the COPY INTO that is having issues
3

Thanks! see below. Anything else I can do to help, please let me know.
brent

copy into “metadata”.working.completions AT BRANCH “main”
from ‘@dcipeds/dcipeds/completions_test’ REGEX ‘c2…_a.csv’ FILE_FORMAT ‘csv’ (EXTRACT_HEADER TRUE);

drop table if exists “metadata”.working.completions;

create table “metadata”.working.completions (
unitid int,
cipcode varchar,
awlevel INTEGER,
xcrace01 varchar,
crace01 varchar,
xcrace02 varchar,
crace02 varchar,
xcrace03 varchar,
crace03 varchar,
xcrace04 varchar,
crace04 varchar,
xcrace05 varchar,
crace05 varchar,
xcrace06 varchar,
crace06 varchar,
xcrace07 varchar,
crace07 varchar,
xcrace08 varchar,
crace08 varchar,
xcrace09 varchar,
crace09 varchar,
xcrace10 varchar,
crace10 varchar,
xcrace11 varchar,
crace11 varchar,
xcrace12 varchar,
crace12 varchar,
xcrace13 varchar,
crace13 varchar,
xcrace14 varchar,
crace14 varchar,
xcrace15 varchar,
crace15 varchar,
xcrace16 varchar,
crace16 varchar,
majornum varchar,
xctotalt varchar,
ctotalt varchar,
xctotalm varchar,
ctotalm varchar,
xctotalw varchar,
ctotalw varchar,
xcaiant varchar,
caiant varchar,
xcaianm varchar,
caianm varchar,
xcaianw varchar,
caianw varchar,
xcasiat varchar,
casiat varchar,
xcasiam varchar,
casiam varchar,
xcasiaw varchar,
casiaw varchar,
xcbkaat varchar,
cbkaat varchar,
xcbkaam varchar,
cbkaam varchar,
xcbkaaw varchar,
cbkaaw varchar,
xchispt varchar,
chispt varchar,
xchispm varchar,
chispm varchar,
xchispw varchar,
chispw varchar,
xcnhpit varchar,
cnhpit varchar,
xcnhpim varchar,
cnhpim varchar,
xcnhpiw varchar,
cnhpiw varchar,
xcwhitt varchar,
cwhitt varchar,
xcwhitm varchar,
cwhitm varchar,
xcwhitw varchar,
cwhitw varchar,
xc2mort varchar,
c2mort varchar,
xc2morm varchar,
c2morm varchar,
xc2morw varchar,
c2morw varchar,
xcunknt varchar,
cunknt varchar,
xcunknm varchar,
cunknm varchar,
xcunknw varchar,
cunknw varchar,
xcnralt varchar,
cnralt varchar,
xcnralm varchar,
cnralm varchar,
xcnralw varchar,
cnralw varchar,
xcrace17 varchar,
crace17 varchar,
xcrace18 varchar,
crace18 varchar,
xcrace19 varchar,
crace19 varchar,
xcrace20 varchar,
crace20 varchar,
xcrace21 varchar,
crace21 varchar,
xcrace22 varchar,
crace22 varchar,
xcrace23 varchar,
crace23 varchar,
xcrace24 varchar,
crace24 varchar,
part varchar,
bal_m varchar,
bal_w varchar,
imprac01 varchar,
imprac02 varchar,
imprac03 varchar,
imprac04 varchar,
imprac05 varchar,
imprac06 varchar,
imprac07 varchar,
imprac08 varchar,
imprac09 varchar,
imprac10 varchar,
imprac11 varchar,
imprac12 varchar,
imprac13 varchar,
imprac14 varchar,
imprac15 varchar,
imprac16 varchar,
ix01 varchar,
ix02 varchar,
ix03 varchar,
ix04 varchar,
ix05 varchar,
ix06 varchar,
ix07 varchar,
ix08 varchar,
ix09 varchar,
ix10 varchar,
ix11 varchar,
ix12 varchar,
ix13 varchar,
ix14 varchar,
ix15 varchar,
ix16 varchar,
cbalm varchar,
cbalw varchar,
$file varchar
);

(Attachment Unconfirmed 196498.crdownload is missing)

4

Emailer wasn’t happy with the profile. try again.

and verified:

SELECT distinct($file) FROM “metadata”.working.completions AT BRANCH “main” ;
null

(attachments)

profile.zip (29.9 KB)

5

@ibrentlam Sorry for the dumb question, Can you please run below query and send us the profile?

SELECT distinct $file from ‘@thither.yon’ REGEX ‘c2…_a.csv’ FILE_FORMAT ‘csv’