Description

You design, build, and maintain scalable data pipelines for structured, unstructured, and real-time sources, preparing data for AI/ML and LLM use cases.

This role is remote.

Responsibilities

• Develop and manage data pipelines using Python, Airflow, Snowflake, and SQL.
• Implement enterprise data ingestion and stage data for vector and knowledge graph databases.
• Ensure data quality, validation, and reliability across all pipeline stages.
• Monitor, optimize, and troubleshoot pipelines for performance and scalability.
• Collaborate with DevOps teams to enforce security, compliance, and deployment standards.

Required Skills

• 8+ years of experience in data engineering or pipeline development.
• Strong hands-on experience with Python, Apache Airflow, Snowflake, and SQL.
• Proven expertise in enterprise data ingestion and data validation.
• Experience preparing data for AI/LLM and analytics use cases.
• Knowledge of vector and knowledge graph databases.
• Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
• Ability to collaborate with DevOps for security and compliance.

Preferred Skills

• Experience with real-time data streaming technologies.
• Background in building scalable data architecture for large enterprises.

Key Skills

Education

Any Graduate