Description

Lead a team of data engineers and serve as a key senior contributor to data engineering projects in Atlanta, GA.

Responsibilities

• Design and build scalable data pipelines to clean, transform, and aggregate data from disparate sources.
• Define data requirements, wrangle large-scale structured and unstructured data, and validate data using various tools.
• Implement statistical data quality procedures and develop mechanisms to ingest, normalize, and clean data.
• Mentor junior data engineers and collaborate across teams to provide data engineering expertise.
• Analyze insights and share strategic recommendations with leadership to support business goals.

Required Skills

• 8+ years of overall IT experience with 5+ years in data engineering or ETL roles.
• Strong proficiency in Spark, Databricks, Delta Lake, and Delta Live Tables.
• Experience with Big Data tools including Hadoop, Kafka, Sqoop, and Hive.
• Proficiency in AWS or GCP cloud platforms.
• Strong SQL skills with the ability to write intermediate complexity queries.
• Experience building and optimizing data ingestion pipelines and architectures.
• Bachelor’s degree in a relevant field.
• Experience with Agile Scrum, Kanban, or SAFe methodologies.

Preferred Skills

• Experience with PowerBI for data visualization and reporting.
• Experience with Teradata.

Key Skills

Education

Bachelor’s degree