Description

You will design, build, and optimize data pipelines for large-scale data movement.

Responsibilities

• Design, develop, and optimize ETL/ELT pipelines using Azure Data Factory and Azure Data Bricks.
• Implement data transformation logic using SQL and Postgres.
• Integrate data sources from Coupa, SAP, and other enterprise platforms.
• Manage CI/CD processes for data solutions using Git and Azure DevOps.

Required Skills

• 5+ years of experience in ETL/ELT pipeline design and development.
• Proficiency in SQL and Postgres for data manipulation.
• Experience with data warehousing and dimensional modeling concepts.
• Familiarity with big data processing paradigms.
• Strong understanding of CI/CD practices using Git and Azure DevOps.
• Experience integrating with enterprise systems like Coupa and SAP.
• Knowledge of Unix/Linux scripting.

Preferred Skills

• Experience with Snowflake or Apache Spark.
• Familiarity with Azure certifications (DP-203 preferred).

Key Skills

Education

Any Gradute