Description
You will design, build, and manage enterprise data architecture solutions.
Responsibilities
- Architect enterprise-wide initiatives covering system integration, data migration, transformation, data warehouse and data mart builds, and data lake implementation.
- Design and implement solutions to complex technical issues within large-scale, high-performance enterprise big data applications.
- Define and implement data modeling, including conceptual, logical, and physical modeling for relational and dimensional designs.
- Develop and maintain advanced streaming data pipelines, addressing concepts like late data handling and defining time windows.
Required Skills
- 6-8 years of IT experience focused on enterprise data architecture and management.
- Expertise in Scala, Spark, and Java programming.
- Deep understanding of Data Bricks, Delta Lake concepts, and on-prem structured streaming.
- Advanced SQL skills including Joins, Aggregation, Windowing functions, CTEs, and RDBMS schema optimization.
- Proven experience with Data Lake concepts, including time travel and schema evolution.
- Advanced understanding of ETL and ELT processes and associated tools.
- Experience leading data migration and system integration projects.
- Familiarity with message formats such as Avro and ORC, and Schema Registry concepts.