Description

Job Description

Design and develop scalable data pipeline architectures for batch and real-time processing

Build and maintain API-based ingestion frameworks and event-driven data streams

Develop robust Python-based data processing workflows

Integrate data from multiple sources

Implement and optimize data models and transformations for downstream consumption

Contribute to building AI-ready data infrastructure, including:

Embedding pipelines

Vector database integrations

Collaborate with analytics, BI, and AI teams to enable data accessibility and reuse

Ensure data quality, monitoring, and reliability across pipelines

Follow best practices for performance, scalability, and governance

Additional Job Description

Strong experience with Python for data engineering

Hands-on experience designing data pipelines (batch and/or streaming)

Experience with API integrations and ingestion frameworks

Strong SQL skills and understanding of data warehousing concepts

Experience with cloud-based data platforms (OCI, AWS, or GCP)

Solid understanding of data modeling and pipeline optimization

Key Skills

Education

Any Graduate