Description

You will own data engineering tasks focused on productionizing existing analytical workflows.

Responsibilities

• Refactor and productionize Python code for maintainability across various teams.
• Develop and deploy automated solutions within Databricks and integrate them with Spotfire dashboards.
• Implement best practices for version control, testing, and documentation for data pipelines.
• Understand and integrate existing analytical workflows and models from engineering teams.
• Ensure data security and compliance with internal standards.

Required Skills

• 5+ years of professional experience in Python development.
• 3+ years working with data platforms including Databricks and visualization tools like Spotfire.
• Advanced Python proficiency covering data manipulation, automation, and OOP.
• Experience building ETL processes and data pipelines.
• Proficiency with PySpark and SQL for data manipulation within Databricks.
• Experience using Git/GitHub for version control.
• Familiarity with CI/CD pipelines and unit testing practices.
• Ability to interpret and refactor code from reservoir engineering contexts.

Preferred Skills

• Familiarity with Azure cloud environments.

Key Skills

Education

Any Graduate