Description

You will build and maintain scalable data pipelines and real-time API integrations to handle increasing data volumes and complexity.

Responsibilities

• Build ETL pipelines using internal Java and Python frameworks.
• Design and implement real-time REST APIs and streaming data solutions.
• Develop, test, debug, and maintain application components and interfaces.
• Optimize databases, data collection systems, and analytics strategies for statistical efficiency.
• Collaborate with QA, Operations, and analytics teams to improve data models and accessibility.

Required Skills

• 5+ years of experience implementing complex ETL pipelines.
• 5+ years of Python experience, specifically within the data space and object-oriented programming.
• Expert-level SQL skills for writing highly optimized queries across large datasets.
• Experience building real-time data streams using Spark.
• Hands-on experience with AWS technologies including EC2, Redshift, CloudFormation, EMR, S3, and AWS Analytics.
• Experience designing data pipelines in both on-prem and cloud environments.
• Experience building pipelines using Databricks or similar cloud databases.
• Proficiency in Unix scripting using Python, Perl, or Shell (bash/zsh).
• Technical expertise in data models, database design, and data mining.

Preferred Skills

• Background in Computer Science.
• Experience with Scala.

Key Skills

Education

ANY GRADUATE