Description

Design and build data systems to handle large datasets, including end-to-end pipeline development and complex SQL query optimization.

This role is on-site.

Responsibilities

• Design and implement end-to-end data pipelines using Cosmos and Azure Data Factory.
• Write complex and efficient SQL queries for large-scale data operations.
• Analyze and troubleshoot data issues within complex, large-volume datasets.
• Perform problem analysis related to data ingestion and processing.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong proficiency in SQL and ANSI-SQL.
• Experience with Azure Data Factory, ADLS, and Azure Synapse Analytics.
• Proficiency in Python and Java.
• Experience with data warehousing concepts and large volume data analysis.
• Competency in Azure SQL and Azure Functions.
• Familiarity with Snowflake.

Preferred Skills

• Experience with Scala.

Key Skills

Education

Any Graduate