Description

You will build and manage scalable data pipelines and warehousing solutions in a hybrid environment in New York City.

Responsibilities

• Build ETL pipelines from scratch using Python and OOP principles.
• Develop, manage, and orchestrate DAGs using Airflow.
• Design data models utilizing schemas and entity relationships.
• Programmatically ingest, cleanse, govern, and report data from warehouses.
• Write efficient, reusable, and independent code to manage all deliverables.

Required Skills

• 5+ years of experience in data engineering.
• Expert-level SQL capability across multiple dialects including SQL Server, DB2, and Oracle.
• Advanced Python programming with deep knowledge of Object-Oriented Programming (OOP).
• Experience managing data pipelines and orchestration via Airflow.
• Expertise in data modeling, schemas, and entity relationships.
• Hands-on experience with BigQuery and Databricks Delta Lakehouse.
• Strong understanding of RDBMS and Big Data architectures.
• Ability to work on-site in New York City 3 days a week.

Preferred Skills

• Experience with Spark.
• Prior knowledge of IBM Apptio.

Key Skills

Education

Any Graduate