Description

You will design and implement advanced algorithms to enable fuzzy matching and data segmentation.

Responsibilities

• Apply new algorithms to enable fuzzy matching and introduce new data linkages.
• Scale algorithm application using Pandas and GPUs.
• Design and build new approaches to measure data quality and improve matching processes.
• Work with the data platform to build scalable solutions.
• Present analytic results and reports in non-technical language to address business issues.

Required Skills

• 5+ years of experience as a Data Engineer or Developer.
• Proficiency in Python with a focus on writing clean, supportable code.
• Hands-on experience with schema design and data modeling.
• Experience building production data pipelines using distributed data processing technologies.
• Experience with RDBMS/SQL and data normalization.
• Experience with Unix/Linux environments.
• Experience with cloud platforms such as Azure or AWS.
• Proficiency with Scala and Pandas.
• Experience debugging complex data pipelines.

Preferred Skills

• Experience with Big Data fundamentals, Hadoop, Spark, or Parquet.
• Knowledge of machine learning libraries in Python, including unsupervised learning models.
• Experience with streaming technologies like Kafka, Flink, or Spark Streaming.
• Experience with Java, APIs, NoSQL databases, or K8s/Docker.

Key Skills

Education

Any Graduate