Description

You will design and build data infrastructure to handle application data ingestion and transformation.

This role is on-site.

Responsibilities

• Design and build reliable ETL pipelines to ingest and transform application data into Databricks tables.
• Redesign and extend existing schemas and data models for SaaS, custom, and IoT applications.
• Implement metadata tagging and cataloging for data discovery and governance.
• Improve data quality by validating, cleaning, and fuzzy matching application attributes.
• Support and evolve a Streamlit-based dashboard for stakeholder visibility.

Required Skills

• 3–5 years of industry experience in data engineering or related fields.
• Proficiency in Python and experience maintaining data-driven applications.
• Hands-on experience with ETL pipeline development, schema design, and data integration.
• Familiarity with Databricks, SQL, and large-scale data platforms.
• Exposure to BI/reporting tools like Streamlit or similar frameworks.
• Experience with Data Engineering concepts.

Preferred Skills

• Understanding of workflow orchestration tools like Airflow or dbt.

Key Skills

Education

Any Gradute