Description

You will build and maintain large-scale data processing pipelines and analytics workflows for the engineering team.

Responsibilities

• Develop and optimize data processing jobs using Spark and PySpark.
• Build and manage real-time data streaming pipelines with Kafka.
• Write complex SQL queries to extract and transform data from various sources.
• Deploy and manage data infrastructure components within AWS.
• Create data visualizations and reports using Tableau to support business decisions.

Required Skills

• 5+ years of professional experience in data engineering.
• Strong proficiency in Python and PySpark.
• Extensive experience with Apache Spark for distributed computing.
• Hands-on experience with Kafka for stream processing.
• Advanced SQL skills for data manipulation and analysis.
• Experience working within AWS cloud environments.
• Ability to build dashboards and visualizations in Tableau.
• Bachelor's degree or equivalent experience.

Key Skills

Education

Any Graduate