Description

You will design and implement enterprise-scale data architectures, managing big data deployments and complex system integrations.

This role is on-site.

Responsibilities

• Architect enterprise-wide data initiatives, including migration, transformation, and lake implementations.
• Design and implement streaming data pipelines with windowing, late data handling, and freshness controls.
• Develop and optimize ETL/ELT processes, data warehouses, and data marts.
• Debug and resolve complex technical issues within big data environments.
• Communicate technical constraints and solutions to stakeholders and senior management.

Required Skills

• 8+ years of IT experience in enterprise data architecture and management.
• Expertise in Conceptual, Logical, and Physical Data Modeling (Relational and Dimensional).
• Proficiency in Spark, Scala, and Java programming.
• Deep knowledge of Databricks, Structured Streaming, Delta Lake, and Delta Live Tables.
• Advanced SQL skills, including joins, aggregations, windowing functions, CTEs, and schema optimization.
• Hands-on experience with S3, AWS Lambda, and CI/CD pipelines using GitLab and CloudWatch.
• Strong understanding of indexing, partitioning strategies, and incremental data loads (tumbling/sliding windows).
• Experience with Schema Registry and message formats such as Avro or ORC.

Preferred Skills

• Experience with Great Expectations or other data quality frameworks.
• AWS architecture experience and familiarity with AWS tools for massive-scale data processing.

Key Skills

Education

Any Graduate