Description

You will build and enhance software for data ingestion and entity resolution platforms within cross-functional Agile teams.

This role is hybrid.

Responsibilities

• Contribute to application, data, and infrastructure architecture for large-scale systems.
• Build efficient storage and search functions over structured and unstructured data.
• Work with large, complex datasets from diverse sources to drive engineering decisions.
• Rapidly develop user-driven prototypes to evaluate technical options.

Required Skills

• 4+ years of experience focusing on large-scale data processing and instrumentation.
• Strong programming skills in Java, Python, or Scala.
• Hands-on experience building batch and real-time data pipelines for production systems.
• Proficiency with Relational and Non-Relational databases (DB2, MongoDB).
• Expertise in tools such as Kafka, Spark, Hadoop, Iceberg, Airflow, and Data Modeling.
• Solid knowledge of software engineering best practices and the big data ecosystem.
• Experience with at least one big data product: Databricks, Elasticsearch, or Snowflake.
• Knowledge of object-oriented and functional programming paradigms and design patterns.
• Familiarity with multiple data formats: Parquet, CSV, JSON, XML.

Key Skills

Education

Any Gradute