Description

You will design, develop, and maintain a Big Data platform to process high-volume data from multiple sources.

Responsibilities

• Design and implement big data solutions for high-volume data processing.
• Develop and maintain data pipelines to transform and load data into Hadoop and other platforms.
• Optimize the performance, scalability, and reliability of big data solutions.
• Monitor and troubleshoot big data jobs to ensure data accuracy and integrity.

Required Skills

• 5+ years of hands-on experience in big data development or a similar role.
• Proficiency in Java, Spring Framework, Python, or Scala.
• Experience with Hadoop, Spark, and NoSQL databases.
• Experience with Kafka and gRPC protocols.
• Familiarity with asynchronous patterns and messaging frameworks.
• Experience with data modeling and ETL tools.
• Proficiency with task scheduling tools such as Airflow or XXLJob.
• Experience with monitoring tools including Zabbix, Grafana, ELK, or Prometheus.
• Ability to write independent scripts, with familiarity in Shell.
• English language proficiency in reading, writing, and speaking.

Preferred Skills

• Strong familiarity with Shell scripting.

Key Skills

Education

Any Graduate