Description

You will design and operate scalable data architectures on Azure, owning the full lifecycle from ingestion to consumption.

Responsibilities

• Architect and implement data lakes, warehouses, and real-time pipelines aligned with business domains.
• Build batch and real-time data pipelines for ingestion, transformation, and enrichment using Azure Data Factory and Synapse.
• Manage Azure storage (Blob/Data Lake), Cosmos DB, SQL databases, and Redis for optimal performance and cost efficiency.
• Design vector storage and indexing strategies to support AI engineers in building RAG systems.
• Implement data quality checks, governance policies, and observability dashboards using Azure Monitor and Log Analytics.

Required Skills

• 8+ years of experience in Data Engineering with enterprise-scale platforms.
• Strong proficiency in Azure Cloud services, specifically Data Lake, Blob Storage, and Data Factory/Synapse.
• Hands-on experience with ETL/ELT tools and data modeling techniques.
• Proficiency in SQL and managing relational databases.
• Experience with NoSQL databases, specifically Cosmos DB.
• Programming skills in Python.
• Knowledge of .NET for backend integration.
• Familiarity with Spark for data processing.

Preferred Skills

• Experience with real-time streaming platforms like RabbitMQ or Kafka.
• Understanding of vector databases and embedding strategies for AI/LLM pipelines.

Key Skills

Education

Any Gradute