Description

You will support the delivery and maintenance of big data streaming platforms and data management capabilities.

Responsibilities

  • Investigate customer issues regarding data retrieval via data products.
  • Debug APIs, cloud services, and data lake technologies.
  • Troubleshoot, debug, and upgrade existing systems.
  • Develop tools and libraries to enable scalable development.
  • Write maintainable, tested code for software solutions and tooling.
  • Contribute to all aspects of the software development life cycle.

Required Skills

  • 5+ years of data engineering experience.
  • Proficiency in Java for writing clean, tested, and maintainable code.
  • Experience building and deploying applications in AWS.
  • Hands-on experience with Spark and SQL.
  • Experience with Databricks or EMR.
  • Experience with CI/CD and updating build pipelines and tasks.
  • Experience with API development.
  • Production experience with Big Data platforms and streaming data pipelines.
  • Experience with test automation frameworks.

Preferred Skills

  • Experience with microservices design.

Education

Any Graduate