← Back to jobs

Terrabit  Consulting  Logo
Data Engineer

Terrabit Consulting

 

Bengaluru, Karnataka, India

Posted On: 15+ days ago
Experience: 6+ years
Availability: Remote
Openings: 2
Category: Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design and develop data ingestion frameworks, real-time processing solutions, and transformation pipelines.

This role is remote.

Responsibilities

  • Design and develop data ingestion frameworks and real-time processing solutions.
  • Operationalize open source data-analytic tools for enterprise use.
  • Implement and validate data lineage, quality checks, and data classification to ensure governance.
  • Follow the SDLC to develop, deploy, and deliver solutions.
  • Participate in a support rotation to provide system support.

Required Skills

  • 6+ years of experience in software engineering or a related field.
  • Proficiency in Python, Scala, and Java.
  • Hands-on experience with Apache Spark, PySpark, and Big Data technologies.
  • Experience with GCP tools including Cloud Composer, BigQuery, and DataProc.
  • Strong SQL skills and experience with Hive and Hadoop platforms.
  • Experience with orchestration tools like Airflow, Oozie, or Kafka.
  • Understanding of the Software Development Life Cycle (SDLC).

Preferred Skills

  • Bachelor's degree in Computer Science, CIS, or a related field.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs