← Back to jobs

CareerNet Technologies Pvt Ltd Logo
Senior Data Tester

CareerNet Technologies Pvt Ltd

 

Bangalore, Karnataka, India

Posted On: 8 days ago
Experience: 6+ years
Availability: Remote
Openings: 2
Category: Data Tester
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will administer Cloudera CDP platforms and optimize data processing pipelines using PySpark and Python.

This role is remote.

Responsibilities

  • Administer and support Cloudera CDP/CDH platforms, including HDFS, Hive, Spark, YARN, Hue, and CDE.
  • Develop, deploy, and optimize PySpark and Python-based data processing solutions for enterprise workloads.
  • Build and maintain CI/CD pipelines using Jenkins and GitHub/Bitbucket for automated deployment.
  • Integrate security tools like Checkmarx into pipelines and implement governance best practices.
  • Write and optimize SQL queries for Hive and Impala to improve performance and ensure system availability.

Required Skills

  • 6+ years of experience in data engineering and DevOps automation.
  • Hands-on experience with Cloudera CDP/CDH, HDFS, and Spark.
  • Proficiency in PySpark, Python, and SQL.
  • Experience building CI/CD pipelines with Jenkins.
  • Strong understanding of Hive and Impala.
  • Linux Administration skills.

Preferred Skills

  • Experience with YARN, Hue, and CDE.
  • Familiarity with GitHub, Bitbucket, and Checkmarx.
  • Knowledge of SAST tools, scripting, and security controls.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs