Description

You will build and manage large-scale, cloud-native data pipelines and platforms.

Responsibilities

• Design, build, and maintain cloud-based data pipelines for batch and real-time processing.
• Develop ETL/ELT workflows using DBT, Apache Airflow, or AWS Glue.
• Optimize data storage and retrieval across AWS, Azure, or GCP environments.
• Implement data security, governance, and compliance best practices.
• Monitor and troubleshoot data pipelines to ensure reliability and scalability.

Required Skills

• 10+ years of experience in Data Engineering with at least 7 years focused on cloud data platforms.
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Strong expertise in SQL and data modeling.
• Hands-on experience with AWS (S3, Redshift, Glue, EMR), GCP (BigQuery), or Azure (Data Factory).
• Proficiency in Python, Scala, or Java.
• Experience with streaming technologies such as Kafka, Kinesis, or Pub/Sub.
• Knowledge of CI/CD for data pipelines and Infrastructure as Code using Terraform or CloudFormation.
• Familiarity with Data Governance, Security, and Compliance frameworks.

Preferred Skills

• Experience with Snowflake or Azure Synapse.

Key Skills

Education

Bachelor's degree