Description

You design, build, and maintain scalable and reliable data pipelines to support analytics and reporting.

Responsibilities

• Leverage Maestro for job orchestration, ensuring efficient execution, monitoring, and error handling.
• Collaborate with business analysts, data scientists, and application teams to gather requirements and deliver data solutions.
• Perform root cause analysis of pipeline failures and implement preventive measures.
• Optimize and tune ETL jobs for performance and cost efficiency.
• Ensure data quality, governance, and security compliance across all solutions.

Required Skills

• 8+ years of experience in Data Engineering with strong ETL workflow exposure.
• Strong hands-on experience with ETL processes, data integration, and pipeline development.
• Expertise in SQL (complex queries, performance tuning, stored procedures).
• Proficiency in Python or Scala for data processing.
• Experience with big data platforms (Hadoop, Spark, Hive) or cloud platforms (AWS/GCP/Azure).
• Experience in Maestro for batch/real-time pipeline execution and monitoring.
• Knowledge of data modeling and data warehousing concepts (Star, Snowflake schema).
• Familiarity with Git, CI/CD, and Agile/Scrum methodology.

Key Skills

Education

Any Gradute