data-science-onramp.data-cleaning.clean_test: test_clean failed

[flaky-bot]

This test failed!

To configure my behavior, see the Flaky Bot documentation.

If I'm commenting on this issue too often, add the flakybot: quiet label and
I will stop commenting.

---

commit: c3a6599
buildURL: Build Status, Sponge
status: failed

Test output

Traceback (most recent call last):
  File "/workspace/data-science-onramp/data-cleaning/clean_test.py", line 75, in setup_and_teardown_table
    operation = bq_client.load_table_from_dataframe(df, BQ_TABLE, job_config=job_config)
  File "/workspace/data-science-onramp/data-cleaning/.nox/py-3-7/lib/python3.7/site-packages/google/cloud/bigquery/client.py", line 2333, in load_table_from_dataframe
    parquet_compression=parquet_compression,
  File "/workspace/data-science-onramp/data-cleaning/.nox/py-3-7/lib/python3.7/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 472, in dataframe_to_parquet
    arrow_table = dataframe_to_arrow(dataframe, bq_schema)
  File "/workspace/data-science-onramp/data-cleaning/.nox/py-3-7/lib/python3.7/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 436, in dataframe_to_arrow
    bq_to_arrow_array(get_column_or_index(dataframe, bq_field.name), bq_field)
  File "/workspace/data-science-onramp/data-cleaning/.nox/py-3-7/lib/python3.7/site-packages/google/cloud/bigquery/_pandas_helpers.py", line 218, in bq_to_arrow_array
    return pyarrow.Array.from_pandas(series, type=arrow_type)
  File "pyarrow/array.pxi", line 887, in pyarrow.lib.Array.from_pandas
  File "pyarrow/array.pxi", line 292, in pyarrow.lib.array
  File "pyarrow/array.pxi", line 83, in pyarrow.lib._ndarray_to_array
  File "pyarrow/error.pxi", line 107, in pyarrow.lib.check_status
pyarrow.lib.ArrowTypeError: Did not pass numpy.dtype object

[flaky-bot]

Looks like this issue is flaky. 😟

I'm going to leave this open and stop commenting.

A human should fix and close this.

---

When run at the same commit (c3a6599), this test passed in one build (Build Status, Sponge) and failed in another build (Build Status, Sponge).

[leahecole]

@bradmiro do you have bandwidth to take a look at this? I'm wondering if it's happening because of the updated pyarrow dependency

[tmatsuo]

It's OOSLO on our dashboard, I'll try to fix this.

[tmatsuo]

It doesn't seem that this error is deterministic.

[tmatsuo]

It's not clear what was the problem from the current logs.

It failed in this line:

operation = bq_client.load_table_from_dataframe(df, BQ_TABLE, job_config=job_config)

Maybe we can add debugging output before this call.

[tmatsuo]

This failure seems very rare. I don't see same failure in days in our periodic builds. I'm adding some debug output with #5343.
Downgrading to p2

[bradmiro]

@leahecole @tmatsuo apologies, this completely slipped through my inbox. I'll take a look at this later today.

PyArrow dependencies are pinned in some older versions of Dataproc, perhaps we should update to Dataproc 2.0 in our samples. I will double check compatibility.