Description

You will build and manage data pipelines and cloud infrastructure within an AWS environment.

Responsibilities

• Design and implement ETL processes, data migrations, and cloud migrations.
• Develop software using Python object-oriented programming and APIs.
• Manage enterprise data lakes, data warehouses, and data marts.
• Diagnose operating errors and implement corrective actions.
• Maintain data integrity across big data environments.

Required Skills

• 5+ years of experience in data engineering or software development.
• Strong proficiency in Python and object-oriented programming.
• Extensive experience with AWS Compute services including EC2, Lambda, Elastic Beanstalk, Batch, or ECS.
• Deep knowledge of AWS Storage services: S3, EFS, and Glacier.
• Hands-on experience with AWS Analytics: Athena, EMR, Glue, Redshift, and Kinesis.
• Expertise in AWS Database services: RDS and DynamoDB.
• Proficiency in SQL and JSON.
• Experience with AWS Application Integration: SNS, SQS, and Step Functions.
• Experience with AWS Management and Governance: CloudTrail and CloudWatch.
• Familiarity with AWS Developer tools: CodeDeploy and CodePipeline.

Preferred Skills

• Experience managing large-scale big data architectures.

Key Skills

Education

Any Graduate