Description

You will own core data engineering functions for large-scale data infrastructure, ensuring integrity and performance across analytics and reporting pipelines.

This role is hybrid.

Responsibilities

• Manage and optimize cloud data infrastructure using AWS services including EMR, DynamoDB, S3, and Lambda.
• Develop and maintain Python scripts to automate data processing and improve system efficiency.
• Implement and manage large-scale data processing workflows using PySpark and Databricks.
• Design, implement, and maintain SQL databases to ensure data integrity and performance.
• Integrate data from disparate sources to guarantee consistency for downstream analytics.

Required Skills

• 5+ years of proven experience in data engineering and big data technologies.
• Proficiency with AWS services (EMR, DynamoDB, S3, Lambda).
• Expertise in Python programming for automation and processing.
• Hands-on experience with PySpark and Databricks.
• Strong SQL database design and management skills.
• Demonstrated ability to troubleshoot and resolve complex technical issues.
• Experience integrating data from various sources.

Preferred Skills

• Any Graduate degree required.

Key Skills

Education

Any Graduate