Description

Design and implement data pipelines to move data from non-Hadoop databases into Hadoop environments.

This role is hybrid.

Responsibilities

• Design and build data pipelines connecting non-Hadoop databases to Hadoop ecosystems.
• Drive technical initiatives by collaborating with client business teams and internal stakeholders.
• Develop and maintain data processes using Spark, SQL, and Python.
• Manage and optimize data workloads within Databricks and Hadoop.

Required Skills

• 8-10 years of overall data engineering experience.
• 3-4 years of hands-on experience with Hadoop.
• Proficiency in Python.
• Experience with Spark and Spark SQL.
• Experience with Databricks.
• Strong SQL skills.
• Bachelor's degree or equivalent experience.
• Ability to work onsite in Charlotte, NC.

Preferred Skills

• Experience with non-Hadoop database integration.

Key Skills

Education

Any Graduate