Description

You will develop and maintain data processing pipelines using Big Data technologies.

This role is on-site.

Responsibilities

• Develop and maintain integrations using Apache NiFi and Kafka.
• Develop, analyze, and maintain ETL jobs per Mayo standards using Sqoop.
• Schedule and monitor ETL jobs running on the Big Data platform.
• Administer Hadoop for managing large-volume ETL jobs.
• Troubleshoot code issues and interact with stakeholders regarding data archival.

Required Skills

• 5+ years of experience in Big Data development.
• Expert knowledge of Kafka and Apache NiFi message brokering systems.
• Experience with Hortonworks platform ETL jobs.
• Proficiency in SQL and working knowledge of Oracle and Sybase databases.
• Familiarity with ElasticSearch implementation on Hadoop.
• Experience with Azure Data Lake and Data warehousing concepts.
• Ability to use Tableau for Big Data analytics.
• Knowledge of Hadoop platform administration.

Key Skills

Education

Any Graduate