Description

Responsibilities:

• Design, develop, and maintain scalable data pipelines and ETL processes using GCP tools.
• Implement data testing frameworks to ensure data quality and integrity across various data sources.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
• Monitor and optimize data workflows for performance and efficiency.
• Document data engineering processes, architectures, and testing methodologies.
• Stay updated with the latest trends and technologies in data engineering and GCP.
• Provide technical guidance and mentorship to junior team members.

Mandatory Skills:

• Strong expertise in GCP Data Testing, including experience with tools such as Dataflow, BigQuery, and Cloud Storage.
• Proficient in SQL and data modeling techniques.
• Experience with ETL tools and frameworks, preferably within the GCP ecosystem.
• Solid understanding of data warehousing concepts and best practices.
• Ability to write clean, maintainable code in Python or Java.

Preferred Skills:

• Familiarity with data visualization tools such as Tableau or Looker.
• Experience with machine learning workflows and data preparation.
• Knowledge of data governance and compliance standards.
• Experience with containerization technologies like Docker and orchestration tools like Kubernetes.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 7 10 years of experience in data engineering or a related role.
• Proven experience in GCP Data Testing and data pipeline development.
• Strong analytical and problem solving skills.
• Excellent communication and collaboration abilities

Key Skills

Education

Bachelor's degree