You will support the delivery and maintenance of big data streaming platforms and data management capabilities.
Responsibilities
- Investigate customer issues regarding data retrieval via data products.
- Debug APIs, cloud services, and data lake technologies.
- Troubleshoot, debug, and upgrade existing systems.
- Develop tools and libraries to enable scalable development.
- Write maintainable, tested code for software solutions and tooling.
- Contribute to all aspects of the software development life cycle.
Required Skills
- 5+ years of data engineering experience.
- Proficiency in Java for writing clean, tested, and maintainable code.
- Experience building and deploying applications in AWS.
- Hands-on experience with Spark and SQL.
- Experience with Databricks or EMR.
- Experience with CI/CD and updating build pipelines and tasks.
- Experience with API development.
- Production experience with Big Data platforms and streaming data pipelines.
- Experience with test automation frameworks.
Preferred Skills
- Experience with microservices design.