← Back to jobs

Profile DM Inc Logo
Lead Data Engineer with GCP

Profile DM Inc

 

Austin, TX, USA

Posted On: 30+ days ago
Experience: 12+ years
Availability: Remote
Openings: 1
Category: Lead Data Engineer
Tenure: Contract - Corp-to-Corp
Related Jobs

No related jobs found

Description

Lead the design, development, and management of high-performance data integration pipelines and frameworks.

This role is remote.

Responsibilities

  • Design and build data pipeline frameworks from scratch, covering ingestion, transformation, and efficient storage.
  • Lead and manage a team of data engineers through code reviews, technical guidance, and standard enforcement.
  • Perform POCs on open-source and licensed tools to provide architectural recommendations.
  • Own data quality, curation, reconciliation, monitoring, and controls across multiple platforms.
  • Balance production platform stability with feature delivery and technical debt reduction.

Required Skills

  • 12+ years of total experience, including at least 5 years in a leadership role.
  • Expertise in GCP cloud platform, including GCS, BigQuery, Pub/Sub, Dataproc, and Dataflow.
  • Advanced proficiency in Python, PySpark, SQL, and Shell scripting.
  • Hands-on experience with Kafka and CI/CD pipeline models.
  • Strong background in data modeling, schema design, and database definition.
  • Experience with HANA and distributed data platforms/data lakes.
  • Proven ability in technical design documentation and performance tuning.
  • Experience supporting reporting models, Looker views, and downstream application needs.

Preferred Skills

  • Ability to navigate ambiguity and coordinate with cross-functional stakeholders.

Education

Any Gradute

Related Jobs

No related jobs found

← Back to jobs