Description

You will own the design, development, and optimization of large-scale data pipelines.

This role is hybrid.

Responsibilities

• Design and build ETL/ELT solutions for data ingestion and transformation.
• Tune and maintain high-volume data processing jobs using PySpark.
• Develop and optimize data workflows within Databricks environments.
• Ensure data integrity and performance across distributed data systems.
• Document data pipeline architecture and operational procedures.

Required Skills

• 12+ years of professional experience in Data Engineering.
• Advanced proficiency in PySpark and Spark SQL.
• Deep expertise with Databricks development and optimization.
• Strong command of Delta Lake.
• Proven experience with ETL/ELT design and large-scale data pipelines.
• Experience with cloud platforms (AWS, Azure, or GCP).
• Strong performance tuning skills for distributed systems.
• Solid documentation and communication abilities.

Key Skills

Education

Any Graduate