Description

Lead the architecture for large-scale Data Lake and Data Warehouse environments. Design ETL, ELT, and data acquisition strategies for structured and unstructured data. Manage data ingestion pipelines including full loads, CDC, and micro-batches. Implement real-time streaming and API-based ingestion using microservices. Lead data modeling efforts and oversee CI/CD, DevOps, and release management within agile processes. Provision environments and set up analytical sandboxes for one-click deployment.

Responsibilities

• Design and lead architecture for Data Lake and Data Warehouse solutions.
• Develop ETL/ELT pipelines and real-time streaming ingestion mechanisms.
• Oversee CI/CD workflows, GitHub integration, and production deployments.
• Provision environments and configure analytical sandboxes for rapid deployment.

Required Skills

• 15+ years of IT industry experience.
• 5+ years leading data modeling and architecture for Data Lakes and Warehouses.
• 10+ years of hands-on development in Data Warehouse and Data Lake technologies.
• Expertise in Google Cloud Data Ecosystem: BigQuery, DataProc, and Dataflow.
• Experience with Kafka for data flow development.
• Strong understanding of Advanced Analytics, Data Science, AI, and Machine Learning.
• Proficiency with GitHub and DevOps/CI/CD workflows.

Preferred Skills

• 2+ years of experience with SAP S3/S4 HANA.
• Domain knowledge in HR, Finance, Supply Chain, or Utilities.

Key Skills

Education

Any Graduate