Description

You will build and maintain the data infrastructure supporting analytics for oil and gas operations.

This role is on-site.

Responsibilities

• Design and implement reliable data pipelines to integrate disparate sources into a single Data Lakehouse.
• Build data quality pipelines to ensure correctness and create trusted datasets.
• Implement the Data Lakehouse solution reflecting core business operations.
• Tune data platform performance and support physical data models, including partitioning and compaction.
• Guide data visualization and reporting to align solutions with business objectives.

Required Skills

• 5+ years of experience as a Data Engineer designing and maintaining data pipeline architectures.
• 5+ years of programming experience in Python and ANSI SQL.
• 2+ years of development experience with DBT (Data Build Tool).
• Experience implementing a Data Lakehouse using a Medallion Architecture with Apache Iceberg on S3 Object Storage.
• Experience with data integration patterns including ELT, Pub/Sub, and Change Data Capture.
• Proficiency with Python Data Engineering packages: Pandas, Numpy, Pyarrow, Pytest, Scikit-Learn, and Boto3.
• Strong software development practices: Design Principles, Testing, Refactoring, CI/CD, and version control.

Preferred Skills

• Familiarity with Data Analysis and Data Warehouse concepts.
• Proficiency with Performance Tuning techniques.

Key Skills

Education

Any Graduate