Description

Manage and optimize cloud-based data infrastructure, ensuring quality and scalability.

Responsibilities

• Develop and maintain data pipelines using PySpark to process large data volumes.
• Design and optimize analytics and machine learning solutions using Databricks.
• Administer cloud data platforms including Snowflake and Redshift for performance.
• Implement data governance policies to maintain consistency and security.
• Monitor and troubleshoot data issues to minimize business impact.

Required Skills

• 5+ years of experience in data management or data engineering.
• Strong programming skills in Python.
• Hands-on experience with PySpark for data processing and analytics.
• Experience building and optimizing pipelines with Databricks.
• Proficiency in managing Snowflake and/or Redshift.
• Solid understanding of data modeling, ETL processes, and data warehousing.
• Bachelor's degree in Computer Science, Information Systems, or a related field.

Preferred Skills

• Certifications in PySpark, Databricks, Snowflake, or Redshift.
• Knowledge of machine learning algorithms and techniques.
• Experience in the banking and payments domain.

Key Skills

Education

ANY GRADUATE