Description

You will build and maintain data pipeline architectures for batch and real-time ETL processes.

Responsibilities

• Design and implement complex data warehousing solutions, including HLD and LLD documentation.
• Build infrastructure for extracting, transforming, and loading data from diverse sources.
• Own end-to-end delivery, including requirement analysis, time estimation, and code reviews.
• Develop, test, and debug performant SQL and automate reporting processes.
• Orchestrate and automate CI/CD pipelines and monitor system flows.

Required Skills

• Extensive experience with SQL, specifically writing and debugging complex queries for large data volumes.
• Proven expertise in Microsoft Azure and Azure Data Factory.
• Strong knowledge of data warehousing concepts and large-scale data modeling.
• Hands-on experience with PowerShell scripting.
• Practical experience installing, configuring, and operating CI/CD pipeline tools.
• Deep understanding of the SDLC, from requirement analysis to maintenance.
• Bachelor's degree in Computer Science, Engineering, IT, Mathematics, or a related field.

Preferred Skills

• Knowledge of distributed systems such as Hadoop, Hive, and Spark.
• Proficiency in Python.

Key Skills

Education

Bachelor's degree