Description

You will design and implement data models, algorithms, and statistical optimization programs for large-scale systems.

This role is on-site.

Responsibilities

• Develop statistical and optimization programs to build models and algorithms.
• Build and manage large-scale data processing pipelines using PySpark and Apache Spark.
• Design and develop RESTful APIs to support data services.
• Manage data within Snowflake cloud-based warehousing and various Graph DBs.
• Execute full SDLC practices including development, testing, and release management.

Required Skills

• 7+ years of experience in data engineering or data science.
• Proficiency in Python and SQL.
• Experience with Apache Spark, DataFrames, and PySpark.
• Hands-on experience with AWS services including EMR, EKS, and Lambda.
• Strong knowledge of Spark SQL, Gremlin, and GraphQL.
• Experience with database management and Snowflake.
• Proficiency with version control systems like Git and BitBucket.

Preferred Skills

• Advanced degree or postgraduate studies.
• Experience with Scala or Java.
• Proficiency with R.

Key Skills

Education

Bachelor's Degree