Description

You will lead the design and construction of enterprise-level, scalable, and fault-tolerant streaming data platforms.

Responsibilities

• Lead a group of engineers in building data pipelines using big data technologies on medium to large scale datasets.
• Influence best practices for data pipeline design, data architecture, and the processing of structured and unstructured data.
• Collaborate across Agile teams to design, develop, test, and implement technical solutions using full-stack tools.
• Build and maintain large-scale data processing systems and streaming frameworks.
• Develop data applications within an AWS environment using distributed data processing frameworks.

Required Skills

• 10+ years of experience in software development.
• Expertise in Java, Scala, or Python.
• Hands-on experience with Apache Spark and Spark Streaming.
• Proficiency with Kafka or AWS Kinesis for messaging and streaming.
• Experience with AWS services including Glue, Lambda, and SQS.
• Strong knowledge of ETL/ELT data movement technologies.
• Experience building highly scalable distributed systems.
• Background in full-stack development with Angular, Node, or TypeScript.
• Bachelor's degree in a relevant field.

Key Skills

Education

Bachelor's degree