Description

You will design, build, and optimize large-scale data pipelines for real-time and batch processing.

This role is hybrid.

Responsibilities

• Design and maintain scalable data pipelines using Python, TypeScript, and SQL.
• Develop real-time streaming solutions with Kafka.
• Implement and optimize NoSQL stores for high-velocity workloads.
• Leverage AWS services (EMR, Redshift, Lambda, S3, ECS/EKS) and distributed tools (Spark, Hadoop, Hive, MapReduce).
• Collaborate in Agile teams through planning, reviews, and standups.

Required Skills

• 10+ years of experience as a Senior Data Engineer.
• Hands-on experience with Python, TypeScript, and SQL.
• Practical experience with AWS services including EMR, Redshift, Lambda, S3, ECS/EKS.
• Experience with distributed computing tools: Spark, Hadoop, Hive, MapReduce.
• Experience with Kafka for real-time data streaming.
• Experience with data warehousing solutions, specifically Snowflake.
• Expertise with NoSQL technologies.
• Strong foundation in UNIX/Linux environments with shell scripting.

Preferred Skills

• Experience working within Agile/Scrum engineering environments.

Key Skills

Education

Any Graduate