Description

You will lead the architecture, development, and optimization of scalable batch and real-time data pipelines using Spark, Kafka, and Snowflake.

This role is on-site.

Responsibilities

• Architect and deploy data integration, streaming, and analytics solutions.
• Research emerging technologies to recommend solutions and establish technical best practices.
• Lead the implementation of data integration, quality, and architecture standards.
• Collaborate with partners across all stages of the Software Development Life Cycle.

Required Skills

• 4+ years of IT experience with extensive Hadoop ecosystem and Apache Spark knowledge.
• Hands-on experience with Kafka streaming (topics, partitions, producers, consumers).
• Proficiency in SQL and Unix shell scripting.
• Experience with Snowflake and distributed computing concepts (partitioning, parallel processing).
• Knowledge of Relational, Dimensional, and unstructured data modeling.
• Experience working within Agile frameworks.
• Bachelor's degree or equivalent progressive experience.

Preferred Skills

• Proficiency in Scala, Java, or Python.
• Deep experience with Spark Core, Spark SQL, Spark Streaming, and Spark MLlib.

Key Skills

Education

Bachelor's degree