BigQuery Load

(env) TDog:tsv tdang$ bq --nosync load -F "\t" --source_format=CSV omni_compressed.headertestramya one_row.tsv

Upload complete.

Successfully started load maximal-ace-162822:bqjob_rb3c950b3b46f118_0000015dc85d99b0_1

(env) TDog:tsv tdang$

(env) TDog:tsv tdang$

(env) TDog:tsv tdang$

(env) TDog:tsv tdang$ bq wait bqjob_rb3c950b3b46f118_0000015dc85d99b0_1

Waiting on bqjob_rb3c950b3b46f118_0000015dc85d99b0_1 ... (0s) Current status: DONE

Job maximal-ace-162822:bqjob_rb3c950b3b46f118_0000015dc85d99b0_1

Job Type State Start Time Duration User Email Bytes Processed Bytes Billed Billing Tier Labels

load FAILURE 09 Aug 14:59:32 0:00:02 [email protected]

Error encountered during job execution:

CSV table encountered too many errors, giving up. Rows: 1; errors: 1.

Failure details:

• file-00000000: Too many values in row starting at position: 0.

(env) TDog:tsv tdang$

(env) TDog:tsv tdang$

(env) TDog:tsv tdang$ bq load --autodetect omni_compressed.toantest hit_data_sample_20.csv

Upload complete.

Waiting on bqjob_r1823ead5fac4666d_0000015dc869b78c_1 ... (2s) Current status: DONE

(env) TDog:tsv tdang

tdang@instance-1:/mnt/disks/adobe$ bq load -F "\t" --max_bad_records=1000 --encoding=UTF-8 omni_compressed.hitdata_20170610 gs://adobe_trial/hit_data_2017-06-10.tsv hit_data_schema.json

Waiting on bqjob_r2fdf32d2d733d2a0_0000015dcd969ad6_1 ... (65s) Current status: DONE   
Warnings encountered during job execution:

[gs://adobe_trial/hit_data_2017-06-10.tsv] Too many values in row starting at position: 4644360152.

[gs://adobe_trial/hit_data_2017-06-10.tsv] Too many values in row starting at position: 4660069148.

[gs://adobe_trial/hit_data_2017-06-10.tsv] Too many values in row starting at position: 4681485168.

[gs://adobe_trial/hit_data_2017-06-10.tsv] Too many values in row starting at position: 4681489797.

[gs://adobe_trial/hit_data_2017-06-10.tsv] Too many values in row starting at position: 4719267724.