Description
You will design, build, and maintain large-scale ETL pipelines and data solutions for enterprise programs.
This role is on-site.
Responsibilities
- Design and implement complex, large-scale technology solutions aligned with business objectives.
- Build and maintain ETL pipelines using Ab Initio and SQL-based methods.
- Analyze technical challenges and collaborate with senior teams to resolve complex issues.
- Document data solutions and ensure rigorous testing and debugging.
- Manage job orchestration and deployment workflows.
Required Skills
- 5+ years of Database Engineering and Development experience.
- 5+ years of ETL development using Ab Initio pipelines and SQL.
- 3+ years of Oracle development, including complex SQL, stored procedures, functions, and triggers.
- 3+ years of Hadoop and Hive development, including HiveQL.
- 3+ years of Apache Spark and Spark SQL, specifically using PySpark and Scala/Java Spark APIs.
- 3+ years of Teradata development for physical and semantic databases.
- 3+ years of data modeling, mapping, and analysis.
- 3+ years of AutoSys experience for job orchestration.
- 4+ years of Agile experience.
Preferred Skills
- Experience with Kafka and Microservices.
- 3+ years of SDLC tool experience including GitHub, Jenkins, Artifactory, Sonar, Maven, or Gradle.
- Working knowledge of Unix and Linux, and understanding of TDD/BDD.