Description

You will build and deploy analytical solutions and data pipelines within Big Data ecosystems to support data science workflows.

Responsibilities

• Design, build, and deploy production-level data pipelines using the Hadoop stack.
• Improve existing data pipelines by simplifying architecture and increasing performance.
• Manipulate large datasets and integrate diverse data sources to enable data science capabilities.
• Perform exploratory and targeted data analyses using descriptive statistics and complex algorithms.
• Document new and existing pipelines, datasets, and data structures.

Required Skills

• 5+ years of experience in big data engineering.
• Hands-on experience with HDFS.
• Proficiency with Hive and Spark.
• Experience using HBase and Kafka.
• Knowledge of NiFi and Oozie.
• Ability to use Splunk for data monitoring and analysis.
• Experience developing reproducible analytical approaches for business requirements.
• Degree in any field (Any Graduate).

Key Skills

Education

Any Graduate