Description
You will design and manage enterprise data architecture solutions.
This role is on-site.
Responsibilities
- Architect enterprise-wide initiatives covering system integration, data migration, transformation, and data warehouse/mart builds.
- Implement solutions for large-scale big data applications, addressing complex technical challenges.
- Define and execute data modeling (conceptual, logical, physical) for relational and dimensional designs.
- Develop and maintain advanced streaming data pipelines, handling late data and time windows.
- Lead data migration and system integration projects.
Required Skills
- 6-8 years of IT experience in enterprise data architecture and management.
- Expertise in Scala, Spark, and Java programming.
- Deep understanding of Databricks, Delta Lake concepts, and on-prem structured streaming.
- Advanced SQL skills: Joins, Aggregation, Windowing functions, CTEs, and RDBMS schema optimization.
- Proven experience with Data Lake concepts, including time travel and schema evolution.
- Advanced understanding of ETL and ELT processes and associated tools.
- Familiarity with Avro and ORC message formats and Schema Registry concepts.
Preferred Skills
- Experience with on-prem structured streaming environments.