Description

You will lead the architecture and design of large-scale big data systems and streaming pipelines.

Responsibilities

• Design and develop big data pipelines using Spark for both batch and streaming workloads.
• Act as a Subject Matter Expert to provide technical solutioning and consulting for big data technologies.
• Lead presales activities and manage client relationships through technical presentations.
• Oversee data operations, ensuring high standards for data quality and data governance.
• Architect end-to-end ETL processes within cloud environments.

Required Skills

• 15+ years of experience in data engineering and technical architecture.
• Expertise in Spark (Dataframe, Spark SQL) and Scala or PySpark.
• Hands-on experience with Databricks and AWS Glue.
• Proficiency with Kafka or similar streaming technologies.
• Proven experience in solutioning, consulting, and SME-level advisory roles.
• Strong understanding of data governance and data quality frameworks.
• Experience working within AWS or Azure cloud environments.
• Ability to manage technical presentations and client-facing requirements.
• Any Graduate degree.

Key Skills

Education

Any Graduate