Description

You will lead large-scale data processing initiatives and design robust data architectures.

Responsibilities

• Design and implement scalable ETL/ELT pipelines and data lake architectures.
• Optimize data processing performance through hands-on debugging and tuning.
• Manage end-to-end data workflows using orchestration tools.
• Own the development and maintenance of large-scale data processing systems.

Required Skills

• 12+ years of experience in Data Engineering.
• Extensive hands-on expertise with Databricks and Apache Spark.
• Proficiency in PySpark and SQL.
• Proven experience with Azure or AWS cloud platforms.
• Experience with Azure Data Factory or Airflow.
• Strong background in data lake management and large-scale processing.
• Ability to work independently on complex pipeline designs.
• Any Graduate degree.

Preferred Skills

• Databricks Certification.

Key Skills

Education

Any Graduate