Description

You will design and maintain data pipeline architectures to support complex business requirements.

Responsibilities

• Assemble large, complex datasets that meet functional and non-functional business requirements.
• Automate manual processes and optimize data delivery to improve internal workflows.
• Redesign infrastructure to increase scalability and improve data extraction, transformation, and loading.
• Build analytics tools that utilize data pipelines to provide insights into operational efficiency and business metrics.
• Troubleshoot Azure cloud services and resolve production issues including performance tuning.

Required Skills

• 4+ years of hands-on experience building data pipelines and transformations on Azure.
• Proficiency with Azure Data Factory, Databricks, and Azure Data Lake.
• Ability to read and write data to Snowflake.
• Strong experience using SQL and Azure big data technologies.
• Solid understanding of data structures and algorithms.
• Proven track record in troubleshooting and enhancing Azure cloud services.

Preferred Skills

• Experience optimizing infrastructure for large-scale data processing.

Key Skills

Education

Bachelor's degree