Description

You will engineer and maintain data pipelines for large-scale data processing across AWS and Azure environments.

This role is remote.

Responsibilities

• Design and build ETL processes for reliable data ingestion.
• Manage data infrastructure on AWS and Azure cloud platforms.
• Develop data processing jobs using Python and Databricks.
• Write and optimize complex SQL queries for data extraction and transformation.
• Maintain and scale existing data pipelines.

Required Skills

• 5 to 8 years of professional experience in Data Engineering.
• Strong command of Python for scripting and data manipulation.
• Hands-on experience with AWS services, specifically AWS Glue.
• Proficiency in Azure data services.
• Expertise in SQL.
• Experience with Databricks.
• Proven proficiency in ETL design and implementation.

Preferred Skills

• Experience with large-scale distributed data processing.
• Background in building real-time or near-real-time data pipelines.

Key Skills

Education

Any graduate