Description

You will design and build scalable data cloud solutions for IoT telemetry processing.

This role is on-site.

Responsibilities

• Develop data processing pipelines on AWS using MSK, EMR (Spark Streaming), DynamoDB, Lambda, Glue, and Athena.
• Manage device data ingestion and processing leveraging AWS IoT Core, IoT rules, and EventBridge.
• Design, implement, and optimize Kafka and Spark-based near real-time data processing pipelines.
• Establish real-time versus batch processing architectures for IoT telemetry data.
• Develop reusable, cloud-native, scalable frameworks and tools.

Required Skills

• 5+ years of experience in a Data Engineer capacity.
• Strong expertise in AWS Cloud services (MSK, EMR, Glue, Lambda, DynamoDB).
• Proficiency in Python/PySpark for big data processing.
• Experience with real-time data streaming technologies like Kafka and Spark.
• Solid background in Data Modelling and IoT telemetry data processing.
• Familiarity with Design Patterns and cloud-native architecture principles.
• Knowledge of data governance, security, and cost optimization on AWS.

Preferred Skills

• Experience with large-scale IoT device fleets.
• Contributions to open-source data engineering tools.

Key Skills

Education

Any Graduate