Description

You will design and implement scalable end-to-end data pipelines on AWS.

Responsibilities

• Develop and manage data solutions using AWS services like S3, Lambda, Glue, Redshift, Step Functions, and CloudWatch.
• Perform data cleansing, transformation, and validation to ensure data quality.
• Build automated workflows and scheduling processes for efficient data processing.
• Integrate and manage data from multiple vendor systems and external sources.
• Monitor pipeline performance and troubleshoot data processing issues.

Required Skills

• 5+ years of experience in Data Engineering with strong AWS expertise.
• Hands-on experience with AWS services: S3, Glue, Lambda, Redshift, and Step Functions.
• Experience building and maintaining ETL/ELT pipelines in cloud environments.
• Strong knowledge of data integration, transformation, and data quality techniques.
• Experience working with large-scale datasets and distributed data systems.
• Familiarity with monitoring tools such as AWS CloudWatch.
• Understanding of data governance and data validation frameworks.
• Experience working in agile development environments.

Key Skills

Education

Any Graduate