Description

You will define the architectural vision and technical roadmap for migrating from Sybase IQ to a modern Big Data platform, leading the design and development of large-scale data processing pipelines.

This role is on-site.

Responsibilities

• Define the end-to-end architectural vision and technical roadmap for migrating from Sybase IQ to a modern Big Data platform, ensuring scalable and secure solutions.
• Lead the design, development, and deployment of robust, large-scale data processing pipelines using Apache Spark, Kafka, and distributed data stores.
• Oversee the design and development of Java-based microservices that interact with the new data platform, ensuring seamless integration with the broader application ecosystem.
• Lead, inspire, and mentor a team of Java and Big Data engineers while fostering a culture of engineering excellence and accountability.
• Remain deeply technical, contributing to coding, design, and architectural decisions, and lead by example in hands-on development work.

Required Skills

• 10+ years of progressive experience in professional software engineering, with at least 3 years in a technical leadership or architect role.
• Deep, hands-on experience with the Big Data ecosystem, including mastery of Apache Spark, Hadoop (HDFS), and real-time data streaming with Kafka.
• Proven track record of designing and building complex, high-performance, scalable server-side applications using Java and Spring Boot.
• Extensive experience with relational databases, data modeling, and data warehousing concepts.
• Experience with Docker and containerization technologies.
• Strong background in data migration strategies, ensuring data integrity and minimal downtime.
• Experience with microservices architecture and distributed systems.

Preferred Skills

• Experience with cloud-native data services on platforms like AWS (EMR, S3, Glue), Google Cloud Platform (Dataflow, BigQuery), or Azure.
• Knowledge of containerization technologies and OpenShift.
• Experience using AI-powered development tools (GitHub Copilot, Claude, Devin) to accelerate development.

Key Skills

Education

Any Graduate