Description

You will lead the technical direction and architecture of data systems and ETL pipelines.

This role is on-site.

Responsibilities

• Design, implement, and maintain backend systems and ETL pipelines using Python and PySpark.
• Lead technical direction, including system architecture, design, and resource management.
• Mentor engineers through technical guidance, coaching, and rigorous code reviews.
• Collaborate with product owners and cross-functional teams to define and prioritize requirements.
• Partner with DevOps and Operations to manage CI/CD pipelines and ensure smooth application deployment.

Required Skills

• 10+ years of professional experience in software or data engineering.
• Expertise in Python and PySpark for building scalable data pipelines.
• Proven experience leading technical teams and making architectural decisions.
• Hands-on experience with ETL pipeline design and implementation.
• Strong knowledge of DevOps practices and CI/CD pipeline management.
• Experience working with cloud platforms such as AWS or GCP.
• Proficiency in Agile methodologies like Scrum or Kanban.
• Ability to develop technical documentation, including architecture diagrams.
• Strong problem-solving skills for debugging complex issues and optimizing performance.

Preferred Skills

• Experience with Microsoft Azure cloud platforms.
• Familiarity with containerization using Docker and orchestration via Kubernetes.

Key Skills

Education

Any Graduate