Description

You will design, develop, and maintain data pipelines for large dataset processing.

Responsibilities

• Design, develop, and maintain data pipelines using Python and PySpark.
• Develop and optimize SQL queries for ETL processes.
• Implement and manage data warehousing solutions in Snowflake.
• Deploy and monitor data applications on OpenShift.
• Automate data workflows to improve efficiency and scalability.

Required Skills

• 5+ years of experience as a Data Engineer or similar role.
• Strong proficiency in Python and hands-on experience with PySpark.
• Extensive experience working with SQL and relational databases.
• Hands-on experience with Snowflake data warehouse platform.
• Familiarity with container orchestration using OpenShift.
• Knowledge of data modeling, ETL/ELT processes, and data architecture.
• Experience with version control systems like Git.
• Strong problem-solving skills and attention to detail.

Preferred Skills

• Experience with AWS, Azure, or GCP.
• Knowledge of CI/CD Pipelines and DevOps practices.
• Familiarity with Kafka or Hadoop.

Key Skills

Education

Bachelor's or Master's degrees