Description

Build and maintain scalable data engineering systems using Python and Databricks.

This role is on-site.

Responsibilities

• Design and develop high-performance, stable ETL pipelines and data systems in production.
• Implement CI/CD workflows and manage code versioning with Git.
• Troubleshoot production issues by analyzing logs, metrics, and stack traces.
• Mentor junior engineers and enforce clean code principles and design best practices.
• Drive data validation strategies and operational support processes.

Required Skills

• 5+ years of experience in software or data engineering.
• Proficiency in Python and PySpark for data processing.
• Hands-on experience with Databricks platforms.
• Strong understanding of ETL processes and Data Engineering principles.
• Experience with CI/CD tools and Git.
• Knowledge of data validation techniques.
• Bachelor's degree in Computer Science, Engineering, or related field.

Preferred Skills

• Experience with distributed data platforms and schema management.
• Familiarity with unit testing, integration testing, and monitoring/logging frameworks.

Key Skills

Education

Any Graduate