Description

You will own the development and maintenance of large-scale data processing applications, ensuring production data requirements meet established ETAs.

Responsibilities

• Implement ETL/ELT methodologies, Data Quality strategies, and Data Principles.
• Support large data processing applications within Hadoop and Spark environments.
• Deploy code using EME and CI/CD methods via Bitbucket, Jenkins, and Jules pipelines.
• Manage deployments for GAIA apps using Kubernetes, Static Scanning, and Open Source Scanning.
• Write and optimize SQL and PL/SQL queries across various database platforms.

Required Skills

• 8+ years of IT experience.
• 5+ years of experience with Ab Initio Version 5, including GDE, EME, and Conduct>IT.
• Experience with Hadoop, Spark, HDFS, Cassandra, NoSQL, and Hortonworks/Cloudera environments.
• Proficiency in writing SQL and PL/SQL for Teradata, Netezza, Oracle, or SQL Server.
• Hands-on experience with UNIX/Linux environments and Shell Scripting.
• Proficiency in Perl, awk, C, or Python.
• Experience with DevOps tools including Bitbucket, Jenkins, and Kubernetes.
• Knowledge of AIM/NIO deployment director and scanning tools like Raven/Synk.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate