Description

Build and maintain a generic data loading framework using big data technologies and core programming languages.

This role is on-site.

Responsibilities

• Develop the generic loading framework using Java, Angular, Apache Spark, Hive, Impala, and Parquet.
• Translate functional requirements into technical solutions and execution plans.
• Implement data profiling, deduplication, and matching logic for analysis.
• Manage data processes and generate Data Quality reports.
• Resolve high-impact problems by evaluating complex business and system processes.

Required Skills

• 10+ years of experience in big data and cloud technologies.
• Expertise with Hadoop, Spark, and Hive implementations.
• Strong programming proficiency in Java, Scala, Python, SQL, and Hive.
• Hands-on experience with HDFS, HBase, and Kafka.
• Experience with RDBMS and NoSQL databases.
• Proficiency in Linux shell scripting.
• Experience migrating SQL Server and VBA code to other environments.
• Experience using Git for SCM and Jira for project tracking.
• Working knowledge of Agile/Scrum methodologies.

Education and Experience

• Bachelor’s Degree in Computer Science, Computer Engineering, or a closely related field.

Key Skills

Education

Any Graduate