Description

You will build and maintain a generic loading framework using big data technologies and core programming languages.

Responsibilities

• Build a generic loading framework using Java, Angular, Apache Spark, Hive, Impala, and Parquet.
• Translate functional requirements and specifications into technical solutions and execution plans.
• Develop data profiling, deduplication, and matching logic for analysis.
• Manage and implement data processes, including Data Quality reports.
• Resolve high-impact problems through evaluation of complex business and system processes.

Required Skills

• 10+ years of experience in big data and cloud technologies.
• Expertise with Hadoop, Spark, and Hive implementations.
• Strong programming proficiency in Java, Scala, Python, SQL, and Hive.
• Hands-on experience with HDFS, HBase, and Kafka.
• Experience with RDBMS and NoSQL databases.
• Proficiency in Linux shell scripting.
• Experience migrating SQL Server and VBA code to other environments.
• Experience using Git for SCM and Jira for project tracking.
• Working knowledge of Agile/Scrum methodologies.
• Bachelor’s Degree in Computer Science, Computer Engineering, or a closely related field.

Preferred Skills

• Data warehouse exposure.

Key Skills

Education

Any Graduate