Description

You will design, build, and maintain large-scale distributed data platforms and real-time streaming architectures.

This role is remote.

Responsibilities

• Build scalable data pipelines and real-time processing solutions using Hadoop, Spark, Kafka, and Redis.
• Design and optimize high-performance ETL/ELT workflows for distributed data platforms.
• Integrate emerging AI/data technologies including vector databases, graph databases, and ML data platforms.
• Engage directly with clients, delivering presentations and maintaining executive presence.

Required Skills

• 10+ years of hands-on experience in data engineering.
• Proficiency in Python, Java, or Scala.
• Deep expertise with Apache Spark and Apache Kafka (Kafka Streams/KStream required).
• Strong SQL skills and experience with PostgreSQL, MySQL, or Oracle.
• Experience with ETL tools such as Talend.
• Familiarity with cloud platforms (AWS, Azure, or GCP).
• Bachelor's degree in Computer Science, Information Systems, or related field.

Preferred Skills

• Experience with vector and graph databases.
• Background in AI/ML data platform integrations.

Key Skills

Education

Any Graduate