Description
You will design and implement data warehousing solutions using Big Data technologies.
Responsibilities
- Develop and maintain data pipelines using PySpark and Python.
- Manage and optimize Teradata data warehouse environments.
- Implement scheduled workflows using AutoSys.
- Write and optimize complex SQL queries for data retrieval and transformation.
- Deliver rapid solutions for big data and warehousing projects.
Required Skills
- 7+ years of experience as a Data Engineer.
- Proficiency with Big Data and Hadoop ecosystems.
- Strong experience in data warehousing architecture and implementation.
- Hands-on expertise with PySpark and Python.
- Deep knowledge of Teradata.
- Advanced SQL skills.
- Familiarity with AutoSys job scheduling.
Preferred Skills
- Experience with SAS.
- Exposure to Banking and AML compliance domains.