← Back to jobs

Harjai Computers Logo
Big Data Engineer
Posted On: 15+ days ago
Experience: 5+ years
Availability: Onsite
Openings: 2
Category: Big Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

You will design and develop cloud-based data models, ETL pipelines, and infrastructure for reporting, analytics, and data science.

This role is on-site.

Responsibilities

  • Design and develop scalable data models from scratch for structured and unstructured data.
  • Build and manage ETL pipelines and data infrastructure on AWS.
  • Optimize large, complex SQL statements and manage relational database configurations.
  • Orchestrate clusters and troubleshoot common database issues.
  • Plan resource requirements based on high-level technical specifications.

Required Skills

  • 5 to 7 years of experience in data engineering and solution design.
  • Proficiency in Python, Java, or Scala.
  • Strong expertise in SQL and its variations across popular databases.
  • Hands-on experience with Spark, Hive, HDFS, and MapReduce (MR).
  • Experience with Apache Kafka or AWS Kinesis.
  • Experience working within AWS cloud environments.
  • Working knowledge of version control tools like Git or Subversion.
  • Experience using automated CI/CD build systems.
  • Understanding of data structures, algorithms, and ML model deployment.

Preferred Skills

  • Experience with TDD/BDD methodologies.

Key Skills
Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs