Description

You will lead data engineering efforts and mentor junior team members to build scalable data solutions.

Responsibilities

• Build and maintain data pipelines to gather, integrate, cleanse, and structure data from multiple sources for analytical use.
• Develop data quality models, tracking processes, and automated quality checks to troubleshoot anomalies.
• Design and implement moderately complex data models and optimize them for performance.
• Provide technical guidance and mentorship to junior data engineers while reviewing their dataset implementations.
• Implement security best practices across all data pipelines and infrastructure.

Required Skills

• 10+ years of experience in data engineering or a related role.
• Advanced proficiency in Python and SQL.
• Intermediate experience with scripting languages.
• Intermediate understanding of Google Cloud Platform (GCP) and general cloud computing concepts.
• Experience building, maintaining, and troubleshooting moderately complex data pipelines.
• Advanced Git usage and CI/CD integration skills.
• BS degree in a STEM major or equivalent discipline.

Preferred Skills

• Active Cloud Certification.
• Experience with Apache Beam, GCP Dataflow, and GCP BigQuery.
• Experience with Java and ingesting data from AWS Kinesis or GCP Pub/Sub topics.
• Experience managing file transfers between GCP Cloud and AWS S3.

Key Skills

Education

Any Graduate