Description

You will design, build, and deploy data pipelines across multiple environments, transforming complex SQL scripts into PySpark or Snowpark code.

This role is on-site.

Responsibilities

• Develop and maintain ETL/ELT processes using Python, PySpark, and Snowpark.
• Write and optimize complex SQL scripts for large-scale data extraction and analysis.
• Implement CI/CD pipelines and ensure robust unit testing for all code deliverables.
• Apply data science libraries like pandas and NumPy to transform and analyze data efficiently.
• Collaborate with cross-functional teams to integrate micro-architecture components and resolve technical challenges.

Required Skills

• 5+ years of professional experience in Python development.
• Strong proficiency in PySpark or Snowpark for data processing.
• Deep understanding of ETL/ELT patterns and data pipeline architecture.
• Advanced SQL skills with experience handling extensive data volumes.
• Hands-on experience with CI/CD tools and unit testing frameworks.
• Ability to design code with a focus on performance and scalability.
• Proven track record as an individual contributor in micro-services environments.

Key Skills

Education

Any Graduate