Description

Design, develop, and deliver large-scale data systems and end-to-end pipelines for digital transformation projects.

Responsibilities

• Translate client requirements into system designs and technical solutions that deliver business value.
• Lead the design and delivery of data processing and data transformation projects.
• Automate data platform operations and manage post-production systems and processes.
• Conduct technical feasibility assessments and provide accurate project estimates.
• Mentor junior team members and perform code reviews.

Required Skills

• 5+ years of experience implementing end-to-end data pipelines.
• Hands-on experience with Azure, AWS, or Google Cloud platforms.
• Proficiency in Python, Spark, PySpark, Java, Javascript, Scala, or SQL.
• Experience with DBT and data processing programming.
• Implementation experience with column-oriented, NoSQL, and traditional database systems.
• Expertise in data modeling, warehouse design, and fact/dimension implementations.
• Experience building streaming and batch integration pipelines using tools like Azure Data Factory or Spark.
• Knowledge of cloud-native data platform design with a focus on event-driven architectures.
• Experience with code repositories and continuous integration.

Preferred Skills

• Developer certifications in Azure cloud services.
• Understanding of development and project methodologies.

Key Skills

Education

Any Graduate