Description

You will design and build distributed ETL/ELT pipelines for large datasets, ensuring batch and near real-time processing.

This role is on-site.

Responsibilities

• Develop and optimize data models using dimensional and warehouse patterns to support self-serve analytics.
• Implement data quality controls, reconciliation checks, and monitoring/alerting for pipeline reliability.
• Build and maintain CI/CD for data pipelines, including testing, deployment, and rollback practices.
• Troubleshoot performance and data issues such as skew, partitioning, late data, and duplicates.

Required Skills

• 7+ years of experience in data engineering with hands-on Big Data exposure.
• Strong SQL skills, including window functions, tuning, and complex transformations.
• Hands-on experience with Spark and at least one ecosystem component (Hive/Hadoop) in production.
• Experience with data modeling and warehousing patterns (star schema, SCD, ETL design).
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree