Description

You will own the design and implementation of core data ingestion and architecture patterns.

This role is on-site.

Responsibilities

• Design and build ingestion pipelines for streaming and event-based data, handling time-window logic and event-to-state transformations.
• Develop and optimize data pipelines using AWS Glue, Lambda, and Step Functions for ingestion, transformation, and curation.
• Maintain data lakes (S3 + Lake Formation) and data warehouses (Redshift), integrating Aurora for serving layers.
• Define data models, partitioning strategies, and schema evolution best practices for scalability.
• Implement data security policies, access controls using AWS IAM, and maintain data cataloging and lineage.

Required Skills

• 12+ years of experience in data engineering and AWS data architecture.
• Strong expertise with AWS Glue, Redshift, S3, Lake Formation, and Aurora (Postgres/MySQL).
• Strong programming proficiency in Python and SQL.
• Proven experience building APIs or exposing curated datasets for web applications.
• Experience with data modeling, ETL/ELT frameworks, and performance optimization.
• Working knowledge of Terraform/CloudFormation and CI/CD practices.
• Understanding of data security, IAM policies, encryption, and governance frameworks.
• Experience with Spark or PySpark.
• Familiarity with Step Functions.

Preferred Skills

• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Bachelor's degree