Description

You will design and build scalable data pipelines for batch and real-time processing, ensuring data quality and reliability for downstream analytics and AI consumption.

This role is on-site.

Responsibilities

• Design and develop scalable data pipeline architectures for batch and real-time processing.
• Build and maintain API-based ingestion frameworks and event-driven data streams.
• Develop robust Python-based data processing workflows and optimize data models.
• Integrate data from multiple sources and implement transformations for downstream consumption.
• Contribute to AI-ready infrastructure, including embedding pipelines and vector database integrations.

Required Skills

• 5+ years of experience with Python for data engineering.
• Hands-on experience designing data pipelines (batch and/or streaming).
• Strong SQL skills and understanding of data warehousing concepts.
• Experience with API integrations and ingestion frameworks.
• Experience with cloud-based data platforms (OCI, AWS, or GCP).
• Solid understanding of data modeling and pipeline optimization.

Key Skills

Education

Any Graduate