Description

You will own the migration and optimization of data infrastructure, including pipeline modernization and AI-driven component development.

This role is remote.

Responsibilities

• Migrate existing data pipelines and workflows to Databricks.
• Analyze current solutions and implement necessary improvements.
• Build and optimize Python and SQL-based data pipelines.
• Develop and enhance AI-driven parsing and extraction components.
• Ensure data quality, performance, and operational reliability.

Required Skills

• 5+ years of professional experience.
• Hands-on experience with Databricks (clusters, notebooks, Delta Lake).
• Strong proficiency in Python and SQL.
• Experience with AI parsing/extraction and text-processing workflows.
• Background in data migration and troubleshooting.

Preferred Skills

• Experience with Azure Databricks, MLflow, or Lakehouse architecture.
• Knowledge of document intelligence tools and DevOps workflows.

Key Skills

Education

Any Gradute