Description

You own the design, development, and operation of data pipelines and platforms.

This role is remote.

Responsibilities

• Ingest and model data from APIs, files/SFTP, and relational sources using layered architectures.
• Design and operate data pipelines with Prefect or Airflow, managing scheduling, parameterization, and SLAs.
• Build on cloud data platforms, leveraging S3/ADLS/GCS and Spark compute for jobs and secrets.
• Enforce data quality and governance via contracts, validations, lineage, and proactive alerting.
• Optimize platform performance and cost through partitioning, clustering, and query tuning.

Required Skills

• 5+ years of professional data engineering experience.
• Strong proficiency in Python, SQL, and PySpark.
• Hands-on experience building ETL/ELT workflows with Prefect (or Airflow) and dbt.
• Experience with cloud storage and compute services on AWS, Azure, or GCP.
• Familiarity with data warehousing solutions like Snowflake or Databricks.
• Experience managing data lifecycle, security, encryption, and PII handling.
• Working knowledge of Git-based workflows and CI/CD principles.

Preferred Skills

• Skills in data visualization tools like Tableau.
• Experience with Collibra for data governance.

Key Skills

Education

Any Graduate