Description

You will build and manage data pipelines and distributed systems within an AWS environment.

Responsibilities

• Develop and maintain data processing workflows using Python and SQL.
• Manage cloud resources including S3, EC2, and ECS via command line and shell utilities.
• Deploy and orchestrate containerized applications using Docker.
• Implement parallel processing and distributed data systems.
• Write clear and concise technical documentation in English.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency in Python.
• Experience with AWS services including S3, EC2, and ECS.
• Working knowledge of SQL and Java.
• Hands-on experience with Docker and Git.
• Ability to use Bash/zsh and command-line interfaces for cloud resource interaction.
• Familiarity with orchestration tools like Airflow.
• Experience with distributed data systems such as Databricks.
• Bachelor of Computer Science, Engineering, or equivalent experience.

Preferred Skills

• Experience with distributed data systems such as Databricks.

Key Skills

Education

Any Graduate