Description

You will build and maintain scalable ETL pipelines and data workflows using Snowflake and BigQuery.

Responsibilities

• Design and maintain scalable ETL pipelines to ensure efficient data flow from diverse sources.
• Automate complex data workflows using Apache Airflow for scheduling and management.
• Partner with data scientists to implement machine learning models in production via MLOps.
• Write high-quality Python code for data extraction, transformation, and loading tasks.
• Optimize data storage solutions and SQL queries for efficiency and scalability.

Required Skills

• 5+ years of experience in data engineering or a related field.
• Proficiency in Python for data processing and scripting.
• Practical experience with Snowflake and BigQuery.
• Strong SQL skills and experience with data modeling.
• Experience with Apache Airflow or similar workflow management tools.
• Understanding of cloud platforms including AWS, Azure, or GCP.
• Bachelor's degree in Computer Science.

Preferred Skills

• Knowledge of Databricks for data processing and analytics.
• Experience with data visualization tools like Tableau or Power BI.
• Familiarity with containerization technologies such as Docker.

Key Skills

Education

Bachelor's degree in Computer Science