Description

You will design and build automated batch and streaming data pipelines within a hybrid cloud environment.

This role is on-site.

Responsibilities

• Design and build automated batch and streaming data pipelines.
• Implement modern cloud technologies into the enterprise domain.
• Develop efficient, scalable, and robust data pipelines.
• Collaborate with cross-functional agile teams to iterate on product objectives.

Required Skills

• 5+ years of experience with cloud platforms (Microsoft Azure, AWS, or GCP).
• 5+ years of experience with SQL and scripting languages (Python or Scala).
• 3+ years of experience with data pipeline tools (Azure Data Factory, Databricks, Spark, or Dataflow).
• Hands-on experience with the Apache Spark engine.
• Working experience with Kafka and streaming technologies.
• Proficiency in SQL, Python, and Databricks.
• Knowledge of modern data lake, data warehousing, and ETL/ELT concepts.
• Understanding of data modeling, data access, and data storage techniques.

Preferred Skills

• Degree in engineering, computer science, mathematics, or a related field.

Key Skills

Education

Any Graduate