Description

You build and maintain data processing and integration systems.

Responsibilities

• Develop and implement data pipelines using Python and PySpark.
• Manage version control and CI/CD processes for data applications.
• Write and maintain unit tests for data processing logic.

Required Skills

• 13+ years of professional experience.
• Proficiency in Python and PySpark.
• Experience with SQL and Databricks.
• Strong understanding of Data Pipelines implementation.
• Familiarity with Git and general Version Control practices.
• Experience setting up and maintaining CI/CD workflows.
• Ability to write effective Unit Tests.

Preferred Skills

• Experience with Azure Cloud Performance Tuning & Optimization.

Key Skills

Education

Any Gradute