Description

You will build and maintain scalable Big Data applications on distributed platforms.

Responsibilities

  • Develop scalable Big Data applications and solutions on distributed platforms.
  • Architect data products using Streaming, Serverless, and Microservices Architecture.
  • Design and implement data pipelines utilizing EMR, Airflow, and Databricks.
  • Configure Jenkins pipelines for CI/CD processes targeting Managed Spark jobs.
  • Partner with teams to solve complex problems and influence stakeholders.

Required Skills

  • 10+ years developing scalable Big Data applications.
  • Proficiency in distributed technologies including Spark, Python, and Scala.
  • Experience with AWS services: S3, Managed Airflow, EMR/EC2, IAM.
  • Hands-on experience with Data warehousing tools: SQL database, Presto, and Snowflake.
  • Experience architecting data products using Data platforms like EMR and Airflow.
  • Familiarity with CI/CD practices, including building Docker images.
  • Working knowledge of Data modelling, Data Governance, and Data Architecture.
  • Experience with reporting tools such as Tableau and Quicksite.
  • Bachelor's degree in Computer Science or a relevant field.

Key Skills
Education

Bachelor's degree

Back To Jobs