Description

You will design and develop streaming data pipelines handling large stream volumes.

Responsibilities

• Develop and operate cloud-native, real-time streaming data systems emphasizing scalability and low latency.
• Design and optimize AWS data system architecture, including IaC and deployment automation.
• Ensure operational reliability for production cloud-native data systems.
• Develop systems to monitor data loss and maintain data quality control.
• Implement foundations for operational excellence within data platforms.

Required Skills

• 8+ years of experience in designing and developing streaming data pipelines.
• 5+ years of experience with Kafka, Flink, Spark, or similar real-time streaming ecosystems.
• 5+ years developing and operating cloud-native data streaming systems.
• Strong experience with AWS native services.
• 5+ years of experience with Python, Java, or Spark-Scala.
• Experience with containerization using Docker, Kubernetes, and Helm.
• 5+ years working with SQL, SQL Tuning, and Big Data NoSQL technologies.
• Demonstrated knowledge of data structures and algorithms.
• Experience with Databricks or Snowflake.

Key Skills

Education

Any Gradute