Description

Architect and implement scalable big data solutions for large-scale organizations.

Responsibilities

• Architect and optimize big data solutions to solve complex real-world problems through modular code development.
• Ingest and transform diverse data sources, including social media, financial, and operational data.
• Research and utilize big data methodologies across cloud, on-premise, and hybrid hosting environments.
• Translate business analytics problems into technical approaches and create insightful visualizations and reports.
• Conduct regular peer code reviews to ensure quality and compliance with industry best practices.

Required Skills

• Minimum 4 years of big data experience or a PhD in Computer Science, Computer Engineering, or a related field.
• Proficiency in Python, Scala, or Java.
• Hands-on experience with Hadoop, Spark, Kafka, Netezza, and SAP HANA.
• Expertise in data ingestion, transformation, engineering, and visualization for both ad hoc and automated solutions.
• Strong understanding of distributed systems principles including load balancing, scaling, and in-memory vs. disk processing.
• Experience with large-scale methods such as MapReduce, Hive, Impala, or Storm.
• Working knowledge of Unix/Linux environments.
• Proficiency with source code management systems including GIT and SVN.
• Experience with version control, testing, QA, and both Waterfall and Agile methodologies.

Preferred Skills

• Two or more years of experience in professional services.
• Full-stack development capability.

Key Skills

Education

Any Gradute