Description

You will design and maintain enterprise data pipelines using Databricks, Spark, and Python on AWS or Azure. You own the ETL/ELT workflow, ensuring data quality, integration, and reliable modeling.

This role is on-site.

Responsibilities

• Build and optimize enterprise ETL/ELT pipelines using Databricks and Spark/PySpark.
• Develop data models and integration layers ensuring high data quality.
• Implement CI/CD practices and version control with Git.
• Maintain and scale infrastructure on AWS or Azure.
• Collaborate on problem-solving and technical communication.

Required Skills

• 7+ years of Data Engineering experience.
• Strong Python and advanced SQL skills.
• Hands-on experience with Databricks and Spark/PySpark.
• Experience building enterprise ETL/ELT pipelines.
• Strong experience with AWS or Azure.
• Experience with data modeling, data integration, and data quality.
• Experience with Git and CI/CD practices.

Preferred Skills

• Experience with Snowflake, Kafka, Airflow, or dbt.
• Experience with real-time/streaming data pipelines.

Key Skills

Education

Bachelor's degree