Description

Design and implement scalable, secure cloud-based solutions for data ingestion, transformation, storage, and analysis on AWS.

Responsibilities

• Architect secure, cost-effective data pipelines using S3, Redshift, Glue, EMR, Kinesis, and Lambda.
• Develop data transformation workflows using Microservices, NodeJS, or AWS Glue.
• Automate infrastructure provisioning and configuration management using Terraform or CloudFormation.
• Implement data security, governance, and compliance protocols throughout the data lifecycle.
• Monitor and optimize the performance and cost efficiency of existing data pipelines.

Required Skills

• 12+ years of experience in data engineering or data architecture.
• Expertise in AWS services including S3, Redshift, Glue, EMR, Kinesis, and Lambda.
• Proficiency in Python or Java.
• Experience with data processing frameworks such as Spark or PySpark.
• Hands-on experience with Microservices and NodeJS.
• Strong knowledge of data modeling, storage solutions, and engineering principles.
• Experience with Infrastructure as Code (IaC) using Terraform or CloudFormation.
• Deep understanding of data security and governance best practices.

Key Skills

Education

Any Graduate