Description

You will develop and maintain data processing pipelines using Big Data technologies.

Responsibilities

• Maintain and develop integrations using Apache NiFi and Kafka.
• Develop, analyze, and maintain all ETL jobs per Mayo standards using Sqoop.
• Schedule and monitor ETL jobs running on the Big Data platform.
• Administer Hadoop for managing large-volume ETL jobs.
• Interact with stakeholders regarding old data archival and troubleshoot code issues.

Required Skills

• 5+ years of experience in Big Data development.
• Expert knowledge of Kafka and Apache NiFi message brokering systems.
• Experience with Hortonworks platform ETL jobs.
• Proficiency in SQL and working knowledge of Oracle and Sybase databases.
• Familiarity with ElasticSearch implementation on Hadoop.
• Experience with Azure Data Lake and Data warehousing concepts.
• Ability to use Tableau for Big Data analytics.
• Knowledge of Hadoop platform administration.
• Strong communication skills.

Key Skills

Education

Any Graduate