Back to Glossary
Data Pipeline
Tech & Tools
Automated flow from data collection to delivery.
Data pipelines automate the process of collecting, cleaning, transforming, and delivering data for analysis or training.
- Tools: Apache Airflow, Prefect, Luigi.
- Goal: Ensure reproducibility, scalability, and data quality.