Description

Lead a team of engineers building data pipelines for medium to large scale datasets.

Responsibilities

• Lead engineering teams in building data pipelines using Java, Python, Spark, and Kafka.
• Design and build distributed streaming data pipelines and analytics data stores.
• Develop software solutions using Java, Python, and AWS cloud services.
• Improve software engineering practices and implement TDD and design patterns.
• Maintain and optimize distributed systems and microservices.

Required Skills

• 10+ years of experience developing software solutions with Java and Python.
• Extensive experience with Spark, ETL, Kafka, and AWS Glue.
• Proficiency with AWS cloud services including ECS, ECR, EC2, S3, SNS, SQS, and Lambda.
• Strong knowledge of Spring, Spring Boot, and J2EE.
• Experience with SQL, Oracle, PostgreSQL, MongoDB, and Postgres databases.
• Hands-on experience with microservices and RESTful services.
• Practical knowledge of Docker and Kubernetes.
• Experience implementing CI/CD systems and TDD.
• Background in distributed systems and streaming frameworks like Spark Streaming.

Preferred Skills

• Experience with Go (GoLang) frameworks and tools.
• Experience working in the Banking or Finance domain.

Key Skills

Education

Any Gradute