Description

You will design, code, and maintain scalable data pipelines and solutions in the cloud.

Responsibilities

• Ingest and transform data from APIs, streaming sources, files, and databases.
• Develop reusable patterns to increase team velocity.
• Design and develop applications in an agile environment using CI/CD.
• Participate in prototyping, design reviews, and code reviews.
• Own or assist with incident and problem management.

Required Skills

• 5+ years of experience in Data Warehouse/Data Lake design and implementation using Databricks or Snowflake.
• 5+ years of experience in data architecture and data modelling.
• 3+ years of experience with Databricks, Python, Spark, PySpark, SQL, and Azure Data Factory.
• 2+ years of experience with GitHub Actions, Jenkins, or similar CI/CD tools.
• 2+ years of experience with GitHub and Cloud CI/CD.
• 2+ years of experience with scheduling tools such as Airflow or Tivoli Work Scheduler.
• 2+ years of experience with NoSQL and relational databases.
• Any Graduate degree.

Preferred Skills

• Experience with Apache Kafka and data ingestion from various APIs.
• Experience working in an Agile/Scrum environment.

Key Skills

Education

Any Graduate