Description

You will own the development and maintenance of large-scale data pipelines, ensuring data is processed, transformed, and governed effectively across cloud platforms.

Responsibilities

• Build and maintain data pipelines using PySpark for large-volume data processing.
• Design and implement data solutions within Databricks to support analytics and machine learning workloads.
• Administer cloud-based platforms including Snowflake and Redshift, ensuring scalability and performance.
• Implement data governance policies to maintain data quality, consistency, and security.
• Monitor and troubleshoot data issues to minimize impact on business operations.

Required Skills

• 5+ years of experience in data management or data engineering.
• Strong programming skills in Python.
• Hands-on experience with PySpark for data processing and analytics.
• Experience building and optimizing pipelines using Databricks.
• Proficiency in managing and administering Snowflake and/or Amazon Redshift.
• Solid understanding of data modeling, ETL processes, and data warehousing concepts.
• Bachelor's degree in Computer Science, Information Systems, or a related field.

Preferred Skills

• Master's degree in a related field.
• Certifications in PySpark, Databricks, Snowflake, or Redshift.
• Knowledge of machine learning algorithms and techniques.

Key Skills

Education

ANY GRADUATE