Description

You will own the design, development, and maintenance of data pipelines for ETL processes.

Responsibilities

• Design and optimize data storage solutions, including data warehouses and data lakes.
• Ensure data quality and integrity through validation, cleansing, and error handling.
• Automate and improve data processes and workflows for scalability and efficiency.
• Monitor data infrastructure performance and reliability, addressing issues promptly.
• Document data pipelines, processes, and best practices for knowledge sharing.

Required Skills

• Proficient expertise on GCP Cloud and GCP DevOps.
• Experience with Terraform for Infrastructure as Code (IaC).
• Hands-on experience with Jenkins, CI/CD, GitHub, and Harness.
• Strong programming skills in Python, Java, or SQL.
• Knowledge of big data technologies such as Hadoop and Spark.
• Proven experience with ETL processes and data modeling.
• Understanding of well-architected frameworks and cloud computing trends.
• Bachelor's degree in Computer Engineering or equivalent with extensive practical experience.

Key Skills

Education

Bachelor's degree