Description

You will design and develop large-scale data processing applications using Java and Apache Spark.

This role is hybrid.

Responsibilities

• Develop, test, and deploy Java-based Apache Spark applications for large-scale data processing.
• Optimize and fine-tune Spark jobs for performance, scalability, and reliability.
• Implement Java-based microservices and APIs for data integration.
• Build and optimize ETL pipelines for large-scale data workloads using Cloudera Hadoop components.
• Maintain version control and CI/CD pipelines for Spark applications.

Required Skills

• 9+ years of experience in application development with a focus on Java and Big Data processing.
• Strong hands-on experience with Java, Apache Spark, and Spark SQL.
• Proficiency with Cloudera Hadoop components including HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
• Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
• Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
• Experience using Git, Bitbucket, Jenkins, or GitLab for version control and CI/CD.
• Familiarity with real-time data streaming and ingestion tools like Kafka, Flume, Oozie, and NiFi.

Key Skills

Education

Not specified