← Back to jobs

Compunnel Logo
Python Data Platform Engineer

Compunnel

 

Montreal, Quebec, Canada

Posted On: Just posted
Experience: 7+ years
Availability: Onsite
Openings: 1
Category: Python Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

You will build and maintain a next-generation data platform, sourcing data from diverse systems into a centralized environment for reporting and analytics.

This role is on-site.

Responsibilities

  • Develop Python components for a unified data pipeline framework.
  • Establish best practices for Airflow, DBT, and Snowflake usage.
  • Test and deploy pipeline frameworks using standard testing and CI/CD tooling.
  • Monitor and tune performance of queries, data loads, and Spark jobs.
  • Support QA and UAT phases via root cause analysis and issue resolution.

Required Skills

  • 7+ years of experience in data development within complex, large-volume environments.
  • 7+ years of SQL and PL/SQL experience, including complex queries for data analysis.
  • 5+ years developing data pipelines and warehousing solutions using Python, Pandas, NumPy, and PySpark.
  • 3+ years of experience in hybrid data environments (on-prem and cloud).
  • 3+ years developing Airflow DAGs with branching, dynamic task generation, and error handling.
  • Hands-on experience with Snowflake and Apache Spark.
  • Experience developing pipelines for structured, semi-structured, and unstructured data across RDBMS, NoSQL, and Document DBs.
  • Proficiency in performance tuning for SQL queries, Spark jobs, and stored procedures.
  • Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related field.

Preferred Skills

  • Hands-on experience with DBT.
  • Understanding of advanced data warehouse concepts such as Factless Fact Tables and Temporal/Bi-Temporal models.

Education

Bachelor's degree

Related Jobs

No related jobs found

← Back to jobs