Description

You will build and manage data pipelines for large-scale processing and analytics.

Responsibilities

• Analyze data sources and APIs to design methods for data collection and ingestion.
• Develop processes to filter, cleanse, and aggregate data for data scientists.
• Write SQL and Hive queries and build APIs to extract data from storage.
• Collaborate with cloud architects and DevOps to define architecture and build automated data pipelines.
• Partner with product managers to align technical implementations with business objectives.

Required Skills

• 4 to 10 years of experience in big data environments.
• Proficiency with Hadoop, NoSQL, Hive, and Apache Spark.
• Strong programming skills in Python and Java.
• Experience with REST APIs and version control using GIT.
• Background in finance, banking systems, fraud, or payments domains.
• Experience in client-facing roles with strong cross-group collaboration skills.
• Ability to work within SCRUM methodology and distributed teams.
• Bachelor's degree in Computer Science.

Preferred Skills

• Familiarity with HTTP, web-API invocation, and job scheduling or workflow management.
• Exposure to machine learning engineering, NLP, and text processing.

Key Skills

Education

Bachelor's degree in Computer Science