Description

What you’ll do

Build complex batch and streaming pipelines to ingest data from upstream Equifax cloud systems.

Design and implement data engineering frameworks to scale the development and deployment of data pipelines across the Ignite landscape.

Leverage AI-powered coding assistants to accelerate development, optimize code, and generate documentation for data pipelines and infrastructure.

Develop and refine prompts for Large Language Models (LLMs) to assist in data-related tasks such as data cleansing, transformation logic generation, and automated data documentation.

Design, build, and maintain scalable data pipelines that support AI/ML applications.

Explore and implement AI agents to automate repetitive data management tasks, monitor data quality, and orchestrate complex data workflows.

Play an active role in setting engineering standards and best practices.

You will get to work on our high visibility Ignite AI advisor project.

What experience you need  

Bachelor's degree or equivalent experience.

5+ years of experience in data engineering, data science, data architecture, or a related data field.

A strong understanding of data engineering principles and best practices, including data modeling, data warehousing, and data integration.

5+ years experience working with software design with Java, Python, SQL, and JavaScript programming languages.

5+ years experience with software build management tools like Maven or Gradle.

5+ years experience with Cloud technology: GCP, AWS, or Azure.

Proficiency with continuous integration and continuous delivery tooling and practices - Jenkins, Docker, Kubernetes. 

What could set you apart

Building and maintaining complex data pipelines and solutions.

Self-starter that identifies/responds to priority shifts with minimal supervision.

Demonstrated experience with prompt engineering to interact with and guide AI models for optimal outputs.

Hands-on experience with AI-assisted coding tools.

Familiarity with frameworks for building AI applications or agents (e.g., LangChain, LlamaIndex).

Experience integrating AI services and models into data pipelines via APIs.

DevOps/CICD experience (Jenkins and GitHub) and IaC experience using Terraform for managing GCP infrastructure.

GCP Associate Cloud Engineer or Professional Data Engineer certification

Key Skills

Education

Any Graduate