Description

You will build and manage data ingestion pipelines and ETL frameworks to process complex datasets.

Responsibilities

• Build and maintain data ingestion pipelines and ETL frameworks.
• Develop processes for data quality and validation.
• Integrate data with Aveva Connect, PI Historian, and Kafka.
• Collaborate directly with the OSI PI product owner.
• Implement DevOps and automation for CI/CD pipelines.

Required Skills

• 12+ years of experience in data engineering.
• Expertise in ETL, Spark, and Kafka.
• Hands-on experience with Azure, AWS, or Google Cloud platforms.
• Proficiency with Power BI.
• Experience managing CI/CD pipelines and automation.
• Strong communication skills for direct stakeholder collaboration.
• Experience with data ingestion and processing of complex datasets.
• Knowledge of Aveva Connect and PI Historian integration.

Preferred Skills

• Based in Houston, TX for on-campus work.

Key Skills

Education

Any Gradute