Description

You will design, develop, and maintain scalable batch and real-time data pipelines.

Responsibilities

• Design and optimize data architectures using Databricks, Delta Lake, and Spark.
• Develop and manage enterprise data warehouse solutions using Snowflake.
• Implement data models to support BI, analytics, and AI workloads.
• Integrate Generative AI models and support Agentic AI systems with data orchestration.
• Automate CI/CD pipelines for data engineering workflows and ensure data governance.

Required Skills

• 10+ years of experience in enterprise-scale data platform development.
• Strong expertise in Apache Spark (PySpark/Scala).
• Hands-on experience with Databricks (Lakehouse architecture, Delta Lake).
• Expertise in Snowflake (data modeling, performance tuning).
• Experience with Hadoop ecosystem components (Hive, HDFS, HBase).
• Strong SQL and data modeling capabilities.
• Experience with ETL/ELT frameworks.
• Cloud platform experience (Azure, AWS, or GCP).
• Knowledge of Kafka and Kubernetes.

Key Skills

Education

Bachelor's or Master's degrees