Description

You will own the data ingestion, integration, and egress pipelines for UKS operational needs, ensuring reliable data flow from third-party providers and internal sources into Data 360.

This role is remote.

Responsibilities

• Build and manage new data integrations for third-party providers and internal sources.
• Design and implement data egress patterns to distribute outputs to multiple downstream destinations.
• Monitor, maintain, and troubleshoot existing ingestion pipelines to ensure uptime and performance.
• Track and report KPIs including data volume, stream counts, and ingestion metrics.
• Establish new integrations, such as G2 and Moody's, and manage assigned vendor data sources.

Required Skills

• 10+ years of experience in data engineering, ETL, and data architecture.
• Strong proficiency in SQL with Snowflake and other relational databases.
• Hands-on experience with Apache Airflow and MuleSoft for orchestration and integration.
• Expertise in writing complex Python modules for custom ETL workflows.
• Experience building batch and real-time data pipelines.
• Familiarity with dbt for data transformation and modeling.
• Knowledge of AWS/GCP and distributed/event-driven architectures.
• Strong understanding of data modeling, data warehousing, and big data processing.
• Experience with data quality, monitoring, and pipeline orchestration frameworks.

Preferred Skills

• Experience with Informatica for ETL processes.
• Hands-on experience with Salesforce platforms, including Flows and Apex.

Key Skills

Education

Any Graduate