Description
You will design, develop, and maintain data pipelines and ETL workflows.
This role is hybrid.
Responsibilities
- Design and build data pipelines and ETL workflows using Python and Pandas.
- Implement, schedule, and monitor workflows with Apache Airflow.
- Manage data storage, processing, and orchestration using Azure Cloud Services.
- Optimize existing pipelines for scalability and performance.
- Collaborate with data scientists, analysts, and business teams to deliver reliable data solutions.
Required Skills
- 4–7 years of hands-on experience in Data Engineering.
- Strong programming experience in Python.
- Proficiency with Pandas for data manipulation and transformation.
- Expertise in Apache Airflow for workflow orchestration.
- Experience with Azure Cloud Services for data storage and compute.
- Solid understanding of ETL/ELT processes, data modeling, and data lifecycle management.
- Bachelor's degree.
Preferred Skills
- Experience with PySpark for distributed data processing.
- Familiarity with Kubernetes for container orchestration.