Description

You will develop and maintain data infrastructure and pipelines using Dremio's query engine and Lakehouse platform to provide accessible, reliable data for enterprise use cases.

Responsibilities

• Design, build, and deploy scalable data pipelines to transform data from various sources.
• Leverage Dremio's query engine and data virtualization to unify enterprise data access for self-service analytics.
• Identify and understand data requirements from stakeholders to inform data strategy.
• Apply data modeling techniques to structure data aligned with business objectives.
• Implement ETL processes to convert raw data into formats usable by data scientists and analysts.

Required Skills

• 10+ years of experience in data engineering.
• Proficiency with Dremio's query engine, Sonar, and Lakehouse technologies.
• Strong command of SQL for data querying and manipulation.
• Proficiency in Python for ETL and data pipeline development.
• Experience with AWS services, specifically S3, Glue, and Redshift.
• Knowledge of various data modeling techniques.
• Experience utilizing ETL tools.
• Understanding of data governance principles and metadata management.
• Experience working in an Agile environment using Scrum.

Key Skills

Education

Any Graduate