Jump to content

Platform Engineering Team/Data Value Stream/Scheduled Dataset Creation

From mediawiki.org

Scheduled Dataset Creation

[edit]

The Generated Data Platform team provides capabilities to schedule automated processes to run to support dataset creation.

Data Pipeline Onboarding contains some documentation to help you move your project to our system.

Airflow Coding Conventions describes the coding conventions of batch jobs, such as algorithms, intended to run on Platform Engineering’s datapipelines.