Description

Design and build large-scale data infrastructure and scalable batch pipelines.

This role is hybrid.

Responsibilities

• Build large datasets and scalable batch pipelines.
• Develop and maintain large-scale distributed data processing systems.
• Manage data architecture using SQL and NoSQL databases.
• Implement data processing workflows within distributed environments.

Required Skills

• 12+ years of relevant data engineering experience.
• Deep coding knowledge of Python.
• Deep coding knowledge of Snowflake.
• Deep coding knowledge of Databricks.
• Expertise in SQL and NoSQL databases.
• Experience with large-scale distributed data processing systems.
• Bachelor's degree in Computer Science, Software Engineering, or a related field.

Preferred Skills

• Experience with Airflow or other data pipeline orchestration tools.
• Experience designing and implementing cross-cloud data pipelines in AWS, Snowflake, and Databricks delta lake files.

Key Skills

Education

Any Graduate