Description

Design, build, and maintain reliable data architectures and ingestion pipelines on AWS.

Responsibilities

• Design and build efficient, reusable architecture and code for data applications.
• Develop and maintain data ingestion pipelines from on-premises and cloud sources to AWS.
• Migrate data from relational databases, file systems, NAS shares, and APIs to AWS services.
• Implement CI/CD strategies for Enterprise Data Platforms.
• Perform hands-on development and unit testing for end-to-end data solutions.

Required Skills

• 6+ years of experience in data engineering or related roles.
• Proficiency in Python, SQL, and Shell scripting.
• Extensive experience with AWS services: S3, Athena, Glue, Lambda, and Step Functions.
• Hands-on experience with EMR/Spark, RDS, Redshift, and DynamoDB.
• Experience implementing data lakes, data warehouses, and ETL/ELT processes on AWS.
• Proven ability to design end-to-end data solutions covering ingestion, storage, integration, and processing.
• Experience with CloudFormation for infrastructure management.
• Ability to work across the full software development lifecycle with product and QA teams.

Preferred Skills

• AWS Solutions Architect or AWS Developer Certification.
• Experience with high-velocity streaming using Amazon Kinesis, SQS, or Kafka.
• Knowledge of Snowflake.

Key Skills

Education

Any Graduate