Description

You will design and develop streaming data pipelines handling large stream volumes.

Responsibilities

• Develop and operate cloud-native data streaming systems emphasizing scalability, low latency, and data quality.
• Architect and optimize AWS data system infrastructure using Infrastructure as Code and automation.
• Ensure operational reliability of production cloud-native data systems.
• Develop systems to monitor data loss and enforce data quality control.
• Apply relational database concepts and SQL tuning across big data and NoSQL environments.

Required Skills

• 8+ years of experience designing and developing streaming data pipelines.
• 5+ years in a cloud-native real-time streaming data ecosystem (Spark, Flink, Kafka, Kinesis, Lambda).
• 5+ years optimizing AWS data system architecture and deployment automation.
• 5+ years experience in Scala, Py-Spark, or Python for data system development.
• Experience with containerization using Docker, Kubernetes, and Helm.
• Solid knowledge of SQL and relational database concepts.
• Experience with Databricks.
• Familiarity with Java.

Key Skills

Education

Any Gradute