Description

You will build AC360 and Zafin data pipelines in Azure using Spark technologies.

Responsibilities

• Develop Azure solutions to identify requirements for RMS replacement and retrofit rules with AC360.
• Register data pipelines, onboard datasets, and build Airflow DAGs for integrated scheduling.
• Own production success by implementing automation, active alerting, self-healing, and DevOps practices.
• Write high-quality code, perform peer reviews, and document technical designs, flowcharts, and system diagrams.
• Execute end-to-end development and testing within an agile lifecycle, supporting software through production deployment.

Required Skills

• 10+ years of experience in Big Data Management and technical problem-solving.
• 5+ years of experience with Spark-Scala, Spark-SQL, or Spark-Py.
• 5+ years of experience with microservices-based applications.
• 4+ years of experience with Maven, Docker, Kubernetes, Kibana, ELK, Jenkins, and Spring Boot.
• 4+ years of experience with CI/CD processes (Maven, Git, Jenkins) and Cloud technologies.
• 3+ years of experience with Airflow, Elastic, and Azure.
• 3+ years of experience with server-side languages including Python, Java, or GoLang.
• Experience with Azure, Kubernetes, and PostgreSQL.
• Knowledge of Mainframe COBOL to understand rules in the Strata rules engine.

Preferred Skills

• Deep experience with the Spark, Scala, Python, and Azure stack.

Key Skills

Education

Any Graduate