Description

You will design, build, and manage end-to-end data pipelines and warehousing solutions.

Responsibilities

  • Build and maintain ETL pipelines to process large datasets.
  • Design and implement data models for efficient warehousing.
  • Deliver end-to-end data projects independently from conception to production.
  • Develop automated data solutions using orchestration tools.
  • Manipulate and extract value from complex, large-scale data structures.

Required Skills

  • 4+ years of experience in data engineering or a related specialty such as software engineering or business intelligence.
  • Proficiency in SQL and at least one programming language including Python, Java, Scala, or NodeJS.
  • Experience with data modeling and warehousing architectures.
  • Hands-on experience building and delivering end-to-end data projects.
  • Bachelor's degree in Computer Science or an equivalent technical field.
  • Working knowledge of Python, SQL, Docker, and Shell scripting.

Preferred Skills

  • Experience with AWS services including Redshift, S3, Glue, EMR, Kinesis, Firehose, Lambda, and IAM.
  • Practical use of Apache Spark, Apache Airflow, or AWS Step Functions.
  • Familiarity with non-relational databases, object storage, or graph databases.
  • Experience with infrastructure as code, continuous delivery, and microservices.

Education

Bachelor's degree in Computer Science