Description

You will design and maintain data pipeline architectures and custom data models to ensure data integrity and scalability.

Responsibilities

• Create and maintain optimal data pipeline architecture and implement curated data products.
• Optimize pipelines for performance, scalability, and cost-effectiveness.
• Develop detailed solution designs, functional specifications, and technical documentation.
• Conduct code reviews, Operational Readiness Reviews, and support design sign-offs.
• Provide technical support to resolve escalated incidents and outages.

Required Skills

• 10+ years of relevant experience in a related field.
• Strong backend experience with Java and Spring.
• Hands-on experience with Azure Databricks and cloud integration.
• Proficiency with big data tools including Hadoop, HDFS, ADLS, ADF, Spark, and Kafka.
• Experience with relational SQL and NoSQL databases, specifically Cassandra.
• Proven track record designing production-grade, scalable applications and microservices.
• Experience working within Agile teams.
• Graduate Degree.

Preferred Skills

• Experience with Python or Scala.

Key Skills

Education

Any Graduate