Skip to content

Google Cloud Storage (GCS)

GCS

Lyftdata supports reading from and writing to Google Cloud Storage (GCS)

Configure Lyftdata to read data from GCS

Add Lyftdata input gcs to a job and configure:

  • Bucket Name: The storage service container.
  • Object Name: The objects names.
  • Application Credentials:
  • Service Account:

Configure Lyftdata to write data to GCS

Add Lyftdata output gcs to a job and configure:

  • Bucket Name: The storage service container.
  • Object Name: The objects names.
  • Application Credentials:
  • Service Account:

Recommendations for files and folders

  • each file should not be larger than 100MB-150MB (compressed gzip or parquet)
  • Y/M/ or Y/M/D/ or Y/M/D/H/ folders