Description

You will own the design, development, and optimization of large-scale data pipelines.

Responsibilities

• Design and build robust ETL/ELT solutions for data ingestion and transformation.
• Tune and maintain high-volume data processing jobs using PySpark.
• Develop and optimize data workflows within Databricks environments.
• Ensure data integrity and performance across distributed data systems.
• Document data pipeline architecture and operational procedures.

Required Skills

• 12+ years of professional experience in Data Engineering.
• Advanced proficiency in PySpark.
• Deep expertise with Databricks development and optimization.
• Strong command of Spark SQL and Delta Lake.
• Proven experience with ETL/ELT Design and large-scale data pipelines.
• Experience with cloud platforms (AWS, Azure, or GCP).
• Demonstrable skill in Performance Tuning.
• Solid documentation and communication abilities.

Key Skills

Education

Any Graduate