Description

You will design and implement scalable data pipelines and warehousing solutions using AWS services.

This role is on-site.

Responsibilities

• Design and develop data pipelines using AWS Glue, Lambda, S3, Kinesis, and Redshift for large-scale data processing.
• Build and maintain ETL processes to ensure data quality and integrity across systems.
• Manage scalable data lake solutions using AWS S3 and Glue for structured, unstructured, and streaming data.
• Implement data security best practices, including access control, encryption, and regulatory compliance.
• Optimize data workflows and storage for cost and performance while setting up monitoring and alerting.

Required Skills

• 10+ years of experience in data engineering.
• Hands-on experience with AWS Glue, Lambda, S3, Kinesis, and Redshift.
• Proven track record in ETL process development and maintenance.
• Experience in data warehousing design and management.
• Experience in data lake implementation.
• Ability to implement data security best practices.
• Strong understanding of data optimization for cost and performance.

Preferred Skills

• Experience with streaming data processing using Kinesis.

Key Skills

Education

Any Graduate