Description

You will support the delivery and maintenance of big data streaming platforms and data management capabilities.

This role is hybrid.

Responsibilities

• Investigate customer issues regarding data retrieval via data products.
• Debug APIs, cloud services, and data lake technologies.
• Troubleshoot, debug, and upgrade existing systems.
• Develop tools and libraries to enable scalable development.
• Write maintainable, tested code for software solutions and contribute to the full software development life cycle.

Required Skills

• 5+ years of data engineering experience.
• Proficiency in Java for writing clean, tested, and maintainable code.
• Experience building and deploying applications in AWS.
• Hands-on experience with Spark and SQL.
• Experience with Databricks or EMR.
• Experience with CI/CD and updating build pipelines and tasks.
• Experience with API development.
• Production experience with Big Data platforms and streaming data pipelines.
• Experience with test automation frameworks.

Preferred Skills

• Experience with microservices design.

Key Skills

Education

Any Graduate