Description

Senior Data Engineer designing and developing cloud-native data integrations and architecting complex data solutions across Azure and AWS.

Responsibilities

• Design and develop cloud-native data integrations on Azure and AWS platforms.
• Integrate various data sources into data warehouses including Azure Synapse, AWS Redshift, or Snowflake.
• Optimize the performance and cost of key cloud services.
• Troubleshoot and solve complex data pipeline issues.
• Lead and guide team members through technical mentorship.

Required Skills

• 8+ years of experience in data engineering.
• Hands-on experience with ADLS, ADF, Azure Databricks, Azure SQL, Key Vault, Azure Synapse, and Power BI.
• Proficiency in AWS Glue.
• Strong scripting skills in PySpark, Spark-SQL, T-SQL, and Python.
• Experience with source control using GitHub or Azure DevOps.
• Experience with Infrastructure as Code and scripting using YAML, PowerShell, or Terraform.
• Bachelor’s Degree.

Preferred Skills

• Experience architecting complex cloud-native data solutions.

Key Skills

Education

Bachelor’s Degree