Description

You will build, optimize, and expand data pipeline architectures to support cross-functional data initiatives.

This role is on-site.

Responsibilities

• Build and maintain data systems, pipelines, and algorithms to process raw information from diverse sources.
• Analyze and organize raw data to enhance quality, reliability, and acquisition opportunities.
• Develop analytical tools and programs to interpret trends and patterns.
• Prepare data for predictive and prescriptive modeling.
• Collaborate with data scientists and architects to ensure consistent data delivery architecture.

Required Skills

• 2+ years of experience in data engineering.
• Proficiency in Python, Java, or Scala for large-scale data processing.
• Expert-level ability to write complex, optimized SQL queries.
• Experience with Apache Spark, Hadoop, and Kafka.
• Strong understanding of batch and streaming data processing techniques.
• Hands-on experience with Airflow for orchestration.
• Competency in scripting languages including Bash and Shell.
• Experience working with SQL and NoSQL databases.
• Knowledge of architectural best practices for building data lakes.

Key Skills

Education

Any Graduate