Description
You will design and implement data solutions in large-scale big data and data warehousing environments.
Responsibilities
- Build and maintain data pipelines using PySpark and Python.
- Manage and optimize data workflows within Hadoop ecosystems.
- Execute complex data transformations and queries using SQL and Teradata.
- Schedule and monitor batch processes using Autosys.
Required Skills
- 7+ years of experience in Data Engineering.
- Proficiency with PySpark and Python.
- Extensive experience with Teradata and SQL.
- Hands-on experience with Big Data and Hadoop architectures.
- Strong background in Data Warehousing (DWH) projects.
- Experience managing job scheduling with Autosys.
- Bachelor's degree or equivalent graduate qualification.
Preferred Skills
- Experience with SAS.
- Background in Banking and AML compliance environments.