Description

You will design, build, and maintain high-volume data pipelines and ETL processes.

This role is on-site.

Responsibilities

• Build and manage real-time streaming pipelines using Kafka.
• Develop and optimize complex SQL queries for analytics and reporting.
• Implement data architectures using star schemas, fact tables, and dimension tables.
• Process massive datasets using Apache Spark and the Hadoop ecosystem.
• Automate workflows using bash scripting and Python.

Required Skills

• 7+ years of professional data engineering experience.
• Strong Java programming experience in production environments.
• Advanced SQL skills with a track record of performance tuning on large datasets.
• Extensive AWS experience including S3, EMR, Redshift, and DynamoDB.
• Hands-on experience with Apache Spark and the Hadoop ecosystem.
• Proven experience with Kafka for real-time streaming.
• Proficiency in Python and bash scripting.
• B.S. or M.S. in Computer Science, Engineering, or a related field.
• U.S. Citizenship and current or previous Public Trust clearance.

Preferred Skills

• Experience with Databricks and delta tables.

Key Skills

Education

Any Gradute