← Back to jobs

Experis Logo
Lead Data Engineer

Experis

 

Houston, TX, USA

Posted On: Just posted
Experience: 10+ years
Availability: Hybrid
Openings: 1
Category: Lead Data Engineer
Tenure: No Preference/Any
Related Jobs

No related jobs found

Description

You will design, build, and maintain scalable data pipelines and lakehouse architectures to ingest, process, and store diverse data at scale.

This role is hybrid.

Responsibilities

  • Architect and operationalize data pipelines using Medallion Architecture (Bronze, Silver, Gold) within a Lakehouse framework to ensure data quality, lineage, and usability.
  • Develop and optimize ETL/ELT workflows and data models in Databricks and Data Lakehouses to support operational and analytical applications.
  • Implement scalable data ingestion and processing systems using Apache Spark, Hadoop, and Kafka in AWS or Azure cloud environments.
  • Lead the Data Management Community of Practice, facilitating knowledge sharing, establishing engineering best practices, and representing the discipline across the organization.
  • Ensure robust data handling and storage solutions leveraging cloud services such as EC2, RDS, S3, Lambda, and Azure Data Lake.

Required Skills

  • 10+ years of experience in data engineering with a proven track record in large-scale data pipeline design and operations.
  • Expert-level experience with Apache Spark, Hadoop, and Kafka for big data processing.
  • Deep expertise in Medallion Architecture implementation within Databricks Lakehouse environments.
  • Strong proficiency in developing ETL/ELT workflows and data modeling.
  • Solid experience with cloud platforms AWS (EC2, RDS, S3, Lambda) or Azure (Data Lake).
  • Demonstrated experience with data platforms such as Databricks and Dataiku.
  • Bachelor's degree in Computer Science, MIS, or a related business discipline.

Education

Any Graduate

Related Jobs

No related jobs found

← Back to jobs