Description

You will architect and build scalable Big Data applications and data products on distributed platforms.

Responsibilities

• Architect data products using streaming, serverless, and microservices patterns.
• Develop scalable Big Data solutions on distributed technology tools.
• Configure Jenkins pipelines to manage CI/CD processes for Managed Spark jobs and Docker image builds.
• Implement data warehousing, data modelling, and governance practices.
• Collaborate within Agile and Scrum development processes.

Required Skills

• 6+ years of experience developing scalable Big Data applications.
• 4+ years of experience with Spark, Python, and Scala.
• 3+ years of experience with AWS, specifically S3, Managed Airflow, EMR, EC2, and IAM.
• Hands-on experience with Databricks and Data Platforms.
• Proficiency in Jenkins for CI/CD pipelines.
• Working knowledge of Data Architecture and Data Modelling.
• Experience with reporting and analytical tools like Tableau or QuickSight.
• Any Graduate degree.

Key Skills

Education

Any Graduate