Description

You will build, test, and support scalable data pipelines and distributed systems.

This role is remote.

Responsibilities

• Build and evolve data integrations, including APIs, to handle increasing data volume and complexity.
• Design, implement, and automate deployment of distributed systems for streaming event processing.
• Establish and enforce data governance processes to ensure data integrity and security.
• Collaborate with business teams to improve data models feeding BI tools.

Required Skills

• 5+ years of relevant experience in data engineering or business intelligence.
• Strong proficiency in Python, PySpark, and SQL.
• Experience with Databricks.
• Experience developing integrations across multiple systems and APIs.
• Experience with Azure technologies: Azure Data Lake, ADF, and Azure DevOps.
• Experience creating ETL and/or ELT jobs.
• Familiarity with Agile software development methodologies.
• Experience with Kafka and Flink.

Preferred Skills

• Excellent problem-solving and troubleshooting skills related to data issues.

Key Skills

Education

Any Graduate