Description

You will build and maintain data pipelines to extract insights from structured and unstructured datasets. You will own the full lifecycle of data assimilation, from design and implementation to quality assurance and troubleshooting.

Responsibilities

• Assemble large, complex datasets to meet business requirements and identify improvement opportunities.
• Build and maintain analytics tools that utilize data pipelines to provide insights into operational efficiency.
• Design, develop, test, and implement cost-effective strategies for data assimilation and reporting.
• Perform quality checks, technical troubleshooting, and data management using Spark and SQL/Python.
• Identify technical risks and develop contingency plans for data processes.

Required Skills

• 5+ years of experience as a Data Engineer.
• Proficiency with SQL and Python.
• Experience with Spark and the Hadoop ecosystem.
• Working knowledge of NoSQL and various databases including MongoDB.
• Experience with data analysis and statistics to extract knowledge from noisy data.
• Ability to work with unstructured datasets.
• Familiarity with cloud technologies such as AWS and Azure.
• Bachelor's degree with 5 years of experience, or a Master's degree with 3 years of experience in Computer Science, Engineering, or Math.

Preferred Skills

• Experience working with Health and Human Services (HHS).
• Experience working in CMMI Level 3 or higher environments.

Key Skills

Education

Any Graduate