Description

You will design and maintain scalable data pipelines integrating on-prem and AWS cloud environments. You own the technical delivery of data ingestion, synchronization, and analytics architecture.

Responsibilities

• Design and implement event-driven architectures using AWS EventBridge, Kafka, or SNS/SQS for real-time data streaming.
• Develop Python services and scripts using pandas and NumPy to ingest data and process large datasets.
• Maintain NoSQL databases (MongoDB, Cassandra, DynamoDB) and transition existing pipelines to MSSQL.
• Create technical architectures, POCs, and document target data pipelines and processing logic.
• Monitor workflows, troubleshoot issues, and optimize performance for reliability and scalability.

Required Skills

• 5+ years of experience with AWS data services and cloud-native architecture.
• Strong proficiency in Python, including pandas and NumPy for data manipulation.
• Hands-on experience with ETL tools and data ingestion from multiple sources.
• Proficiency with NoSQL databases: MongoDB, Cassandra, and DynamoDB.
• Experience implementing event-driven systems using Kafka, SNS/SQS, or AWS EventBridge.
• Ability to design hybrid architectures connecting on-prem systems to AWS.
• Strong technical leadership skills to guide teams and manage delivery milestones.

Preferred Skills

• Experience with MSSQL server and transitioning legacy pipelines.
• Background in decomposing business logic and data transformation patterns.

Key Skills

Education

Any Gradute