Description

Design, develop, and maintain data pipelines for large-scale dataset processing and optimization.

This role is hybrid.

Responsibilities

• Build and maintain data pipelines using Python and PySpark.
• Optimize SQL queries for ETL processes and manage Snowflake data warehousing solutions.
• Deploy and monitor data applications on OpenShift.
• Automate data workflows to enhance efficiency and scalability.

Required Skills

• 5+ years of experience as a Data Engineer or similar role.
• Strong proficiency in Python and hands-on experience with PySpark.
• Extensive experience with SQL and relational databases.
• Hands-on experience with the Snowflake data warehouse platform.
• Familiarity with container orchestration using OpenShift.
• Knowledge of data modeling, ETL/ELT processes, and data architecture.
• Experience with version control systems like Git.

Preferred Skills

• Experience with AWS, Azure, or GCP.
• Knowledge of CI/CD Pipelines and DevOps practices.
• Familiarity with Kafka or Hadoop.

Key Skills

Education

Bachelor's or Master's degrees