- BigQuery Export

Exporting BigQuery results to Google Cloud Storage.

Exporting the results

The first step we’ll perform is exporting the results of a BigQuery query to GCS, which can be performed manually using the BigQuery UI.

This is possible to perform directly in Spark, but as I mentioned, the setup is quite involved to configure using the current version of the connector library. We’ll use the natality dataset for this pipeline, which lists attributes about child deliveries, such as birth weight.

Get hands-on with 1200+ tech skills courses.