Description
Design and develop cloud-native data integrations on Azure and AWS, architecting complex data solutions and optimizing performance and cost.
This role is on-site.
Responsibilities
- Design and develop cloud-native data integrations across Azure and AWS platforms.
- Integrate diverse data sources into warehouses like Azure Synapse, AWS Redshift, or Snowflake.
- Optimize performance and cost of key cloud services and troubleshoot complex pipeline issues.
- Lead and guide team members through technical mentorship.
Required Skills
- 8+ years of experience in data engineering.
- Hands-on experience with ADLS, ADF, Azure Databricks, Azure SQL, Key Vault, Azure Synapse, and Power BI.
- Proficiency in AWS Glue.
- Strong scripting skills in PySpark, Spark-SQL, T-SQL, and Python.
- Experience with source control using GitHub or Azure DevOps.
- Experience with Infrastructure as Code using YAML, PowerShell, or Terraform.
- Bachelor’s Degree.
Preferred Skills
- Experience architecting complex cloud-native data solutions.