Description

You will design and build large-scale data pipelines and distributed processing systems.

Responsibilities

• Develop and maintain large-scale data pipelines using orchestration tools.
• Build and manage distributed processing systems in production environments.
• Write complex SQL queries to analyze and extract large datasets.
• Implement data modeling techniques and warehousing methodologies.
• Apply algorithmic problem-solving to data service engineering.

Required Skills

• 7+ years of data engineering experience.
• Proficiency in Python, Java, or Kotlin.
• Hands-on experience with Spark and Airflow.
• Strong SQL and data extraction capabilities.
• Experience with AWS or other cloud providers and infrastructure as code.
• Deep understanding of OLTP vs OLAP environments.
• Practical knowledge of Airflow, Spark, Data Brick, Snowflake, Deltalake, or Kafka.
• Familiarity with Scrum and Agile methodologies.
• Bachelor’s Degree in Computer Science, Information Systems, or equivalent industry experience.

Preferred Skills

• Experience with Graph Databases.
• Realtime Event Streaming experience.

Key Skills

Education

Any Graduate