Description

Build and scale data pipelines and infrastructure to process large-scale datasets in Plano, TX.

Responsibilities

• Design, develop, and maintain ETL processes to extract, transform, and load data from multiple sources.
• Build and optimize scalable data pipelines and infrastructure for efficient data handling.
• Develop cloud-based big data solutions using AWS services including S3, EMR, Lambda, Glue, Redshift, and Kinesis.
• Implement data management, security, and compliance practices within AWS cloud infrastructure.
• Monitor system performance and resolve issues to maintain big data system reliability.

Required Skills

• 5+ years of experience in big data engineering.
• Strong Python programming skills for data automation and workflow development.
• Expertise in designing and maintaining ETL processes.
• Hands-on experience with AWS S3.
• Proficiency with AWS EMR.
• Experience using AWS Lambda.
• Experience with AWS Glue.
• Experience with AWS Redshift.
• Experience with AWS Kinesis.

Key Skills

Education

Any Graduate