Platform Engineering Team/Data Value Stream/Scheduled Dataset Creation

Scheduled Dataset Creation

The Generated Data Platform team provides capabilities to schedule automated processes to run to support dataset creation.

Data Pipeline Onboarding contains some documentation to help you move your project to our system.

Airflow Coding Conventions describes the coding conventions of batch jobs, such as algorithms, intended to run on Platform Engineering’s datapipelines.