Description

You will build and manage scalable data pipelines and warehousing solutions in a hybrid environment in New York City.

This role is hybrid.

Responsibilities

• Build ETL pipelines from scratch using Python and OOP principles.
• Develop, manage, and orchestrate DAGs using Airflow.
• Design data models utilizing schemas and entity relationships.
• Programmatically ingest, cleanse, govern, and report data from warehouses.

Required Skills

• 5+ years of experience in data engineering.
• Expert-level SQL capability across multiple dialects including SQL Server, DB2, and Oracle.
• Advanced Python programming with deep knowledge of Object-Oriented Programming (OOP).
• Experience managing data pipelines and orchestration via Airflow.
• Expertise in data modeling, schemas, and entity relationships.
• Hands-on experience with BigQuery and Databricks Delta Lakehouse.
• Strong understanding of RDBMS and Big Data architectures.

Preferred Skills

• Experience with Spark.
• Prior knowledge of IBM Apptio.

Key Skills

Education

Any Graduate