Why is the data loader job failing with an "Failed to copy" error message?

Question

Data load in Stage tenant is failing completely.  The error message we are getting is:

ERROR: Failed to copy reltio_customer-facing_consolejobs:
[a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_1.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_2.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_3.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_4.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_5.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_6.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_7.csv] file to GBQ. 
Please look into inner error for more details.

Answer

Look in LogDNA to check for the full error message

Jan 21 11:03:25console-jobs-api-5c869646fb-72tx8console-jobs-apiINFOLoading
 file [a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_1.csv, 
a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_2.csv, a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_3.csv, a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_4.csv, a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_5.csv, a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_6.csv, a171dc6a-e41b-415a-89e2-e146de9b2dfe/SourceFile_7.csv] from bucket reltio_customer-facing_consolejobs to table a171dc6a_e41b_415a_89e2_e146de9b2dfe
Jan 21 11:03:27console-jobs-api-5c869646fb-72tx8console-jobs-api
ERRORJob a171dc6a-e41b-415a-89e2-e146de9b2dfe failed

You will notice further down into that message it will point to a more comprehensive message in LogDNA.

Caused by: com.google.cloud.bigquery.BigQueryException: Error while reading data, error message: 
Error detected while parsing row starting at position: 0. 
Error: Bad character (ASCII 0) encountered. File: gs://reltio_customer-facing_consolejobs/fef9f02c-d7ec-4242-a19e-7e8566bc8f44/SourceFile_4.csv

The problem in this case is caused by an invalid character in SourceFile_4.csv. Please make sure that your  file is in valid UTF-8 format  Since CSV is not a well-defined format,  Here are some hints on how to upload .CSV files in this RFC 4180.

• Encoding: UTF-8
• Line separator: CRLF
• Values in a line are separated by a comma
• The first line represents the field names
• Each field might be enclosed in double quotes
• Double quotes inside of quoted fields must be escaped with another double quote