Description

Own the design, operations, and continuous improvement of the Customer Data Warehouse infrastructure.

Responsibilities

• Engineer solutions to aggregate and automate large-scale data flows from diverse internal and external sources.
• Construct complex data sources and build real-time streaming pipelines to support algorithms and machine learning models.
• Gather business requirements and deliver technical solutions through the full development lifecycle, ensuring scalability and high availability.
• Automate reporting and analysis processes to provide self-service support for customers.
• Create and maintain technical documentation for all development activities.

Required Skills

• 5+ years of experience in the Data Engineering domain.
• Hands-on experience implementing data solutions in Microsoft Azure, specifically Azure SQL, Azure Synapse, Cosmos DB, and Databricks.
• Proficiency in configuring Delta Lake on Azure Databricks.
• Strong expertise in Python for data engineering tasks.
• Advanced SQL knowledge (MSSQL, MySQL, PostgreSQL, or Presto).
• Experience with big data technologies including Spark, Hadoop, Hive, or HBase.
• Proven strength in data modeling, ETL development, and data warehousing.
• Experience designing for scalability, data distribution, partitioning, disaster recovery, and data lake optimization.
• Knowledge of cron job scheduling and file formats like Parquet and CSV.

Preferred Skills

• Experience working in agile setups using proven project management methodologies.
• Ability to coach team members and communicate technical concepts to senior management and business stakeholders.

Key Skills

Education

Any Graduate