Description

You will own the data integration layer, managing synchronization between on-premises Oracle databases and Snowflake. You will design, build, and orchestrate ETL pipelines using Airflow and Python, ensuring reliable data flow for analytics.

Responsibilities

• Implement data synchronization between on-premises Oracle databases and Snowflake using Kafka and CDC tools.
• Design, build, and manage ETL data pipelines using Airflow for orchestration and Python for scripting.
• Develop and optimize data models in Snowflake to support analytics and reporting requirements.
• Utilize CI/CD tools to automate the deployment of data pipelines and infrastructure changes.
• Create and maintain technical documentation for data pipelines, ETL processes, and data models.

Required Skills

• 5+ years of experience in data engineering and maintaining data integration projects.
• Advanced proficiency in SQL and Python for data processing tasks.
• Strong experience with Oracle, Snowflake, and Databricks.
• Proficiency with Kafka and CDC tools for data ingestion and synchronization.
• Experience with data modeling principles and data warehousing solutions.
• Knowledge of Azure cloud infrastructure as it relates to Snowflake and Databricks integration.
• Experience using Git for version control.

Preferred Skills

• Bachelor's degree in Computer Science or related field.

Key Skills

Education

Bachelor's degree