You will design and build data pipelines to handle complex, large-scale datasets.
Responsibilities
- Perform data exploration and analysis to identify trends and anomalies.
- Implement cost-effective data solutions utilizing cloud-native tools.
- Ensure high-quality documentation for data models and system architecture.
- Collaborate with product managers, building engineers, and software developers.
- Follow engineering practices, including unit testing and code reviews.
Required Skills
- 5+ years of experience in data engineering.
- Proficiency in Python for data engineering and scripting.
- Strong experience with data exploration using Pandas and SQL.
- Proven ability to design solutions for large-scale, heterogeneous data.
- Experience with cost optimization in data environments.
- Familiarity with software engineering best practices (SOLID, KISS).
- Experience with CI/CD pipelines.
Preferred Skills
- Exposure to IoT protocols such as MQTT.
- Experience in smart buildings or energy management domains.