← Back to jobs

UST Logo
Lead Data Engineer

UST

 

Trivandrum, Kerala, India

Posted On: 2 days ago
Experience: 7+ years
Availability: Onsite
Openings: 1
Category: Lead Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will lead the design and implementation of large-scale data architectures, processing pipelines, and governance standards.

This role is on-site.

Responsibilities

  • Build, optimize, and troubleshoot complex data pipelines and validation processes.
  • Design data warehouse architectures and manage end-to-end ETL workflows.
  • Execute strategic data planning, governance, and standardization procedures.
  • Manage big data workloads within containerized environments using Kubernetes.
  • Analyze large datasets to optimize data workflows, performance, and mining outcomes.

Required Skills

  • 7+ years of experience in Data Warehouse and Big Data technologies.
  • 4+ years of hands-on experience with Scala, Spark, PySpark, Python, and SQL.
  • 3+ years of experience in strategic data planning and governance.
  • 3+ years of experience working in Agile environments.
  • Proficiency with Hadoop, Hive, Pig, and MapReduce.
  • Experience with Airflow, Kubernetes, and containerization.
  • Experience with GCP or Azure cloud platforms.
  • Strong background in Data Mining, Data Cleansing, and Data Analytics.

Preferred Skills

  • Understanding of Java, ReactJS, and Node.js.
  • Experience in Machine Learning and data optimization.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs