Description

You will lead data engineering efforts and manage a team of 5-8 junior developers.

Responsibilities

• Build and maintain batch and real-time data pipelines for production systems.
• Manage a team of 5-8 junior developers within an Agile environment.
• Work with various data formats including Parquet, CSV, JSON, XML, and relational data.
• Operate within Linux/Unix environments using scripting languages.

Required Skills

• 10+ years of experience building data pipelines.
• Strong coding proficiency in Java, Python, or Scala.
• Hands-on experience with at least one big data product: Databricks, Elasticsearch, or Snowflake.
• Experience with relational and non-relational databases such as DB2 and MongoDB.
• Proficiency with data formats including CSV and JSON.
• Experience working in Agile methodologies.
• Experience with Linux/Unix and scripting.

Preferred Skills

• Experience with Databricks, Delta Lake, or Kafka.
• Experience with REST-based applications.
• Experience sourcing client reference data from vendors.

Key Skills

Education

Any Graduate