Description

You will design and build data pipelines to handle complex, large-scale datasets.

Responsibilities

  • Perform data exploration and analysis to identify trends and anomalies.
  • Implement cost-effective data solutions utilizing cloud-native tools.
  • Ensure high-quality documentation for data models and system architecture.
  • Collaborate with product managers, building engineers, and software developers.
  • Follow engineering practices, including unit testing and code reviews.

Required Skills

  • 5+ years of experience in data engineering.
  • Proficiency in Python for data engineering and scripting.
  • Strong experience with data exploration using Pandas and SQL.
  • Proven ability to design solutions for large-scale, heterogeneous data.
  • Experience with cost optimization in data environments.
  • Familiarity with software engineering best practices (SOLID, KISS).
  • Experience with CI/CD pipelines.

Preferred Skills

  • Exposure to IoT protocols such as MQTT.
  • Experience in smart buildings or energy management domains.

Education

Bachelor's or Master's degrees