Description

You will build, implement, and operate a new cloud data pipeline from the ground up.

Responsibilities

• Build and deploy a new cloud data pipeline, managing the migration to the new state.
• Design and develop ETL mappings, procedures, and schedules to ensure data quality and availability.
• Resolve data ingestion issues and implement automated integrations with proper exception handling.
• Optimize queries, ETL processes, and table schemas to meet end-user requirements.
• Maintain technical documentation for new data sources, intermediate structures, and core data processing.

Required Skills

• 4 to 8 years of experience in data engineering.
• Strong proficiency in SQL and Python.
• Hands-on experience with Apache Airflow.
• Experience working with AWS S3 and EC2.
• Proven ability to design and develop ETL processes.
• Experience developing business intelligence and data warehousing solutions.
• Ability to support EST business hours.

Key Skills

Education

ANY GRADUATE