Description

You will design and build optimized data pipelines in a cloud environment to drive analytical insights.

This role is on-site.

Responsibilities

• Construct infrastructure for efficient ETL processes from various sources and storage systems.
• Architect and maintain database pipeline architectures, ensuring readiness for AI/ML transformations.
• Collaborate with Product and Business Managers to design technical solutions aligned with business requirements.
• Create data validation methods and analysis tools to enhance data quality.
• Ensure compliance with data governance and security policies across all data operations.

Required Skills

• 8+ years of experience designing, building, deploying, testing, maintaining, monitoring, and owning scalable data pipelines.
• High proficiency in Python, Scala, and Spark for applied large-scale data processing.
• Expert ability to write complex, optimized SQL queries across extensive data volumes.
• Experience with Big Data and ETL processes.
• Proficiency in Data Pipelines and Cloud Computing.
• Experience with MySQL and Snowflake.
• Knowledge of Data Lifecycle Management processes.
• Familiarity with Agile methodologies.

Preferred Skills

• Experience with Data Lake, Delta Lake, and Hive.
• Knowledge of batch and streaming data processing techniques.

Key Skills

Education

Any Graduate