Description

You will build and maintain data pipelines using Python and AWS services.

This role is remote.

Responsibilities

• Implement real-time and batch data ingestion using AWS Lambda and Fargate in Python.
• Manage data flows from various sources and own the data ingestion process.
• Design scalable solutions focusing on quality and performance for data cloud efforts.
• Develop and tune SQL queries against MongoDB and Postgres.
• Provide post-production support and deliver features within an Agile environment.

Required Skills

• 5+ years of professional software development experience.
• Expert proficiency in Python programming.
• Extensive experience with AWS services: S3, RDS, EMR, ECS, and Athena.
• Hands-on experience implementing ETL data movement using Lambda and Fargate.
• Strong understanding of MongoDB and Postgres data storage platforms.
• Experience with big data technologies such as HDFS.
• Proficiency in problem-solving and algorithm design.

Key Skills

Education

Any Graduate