Description

You will develop and manage big data pipelines and ETL processes within a cloud-based environment.

Responsibilities

• Write Python scripts to automate ETL processes and data movement.
• Develop and optimize complex SQL queries, stored procedures, triggers, and sequences.
• Build and manage data workflows using Google Cloud services including Dataflow and Composer.
• Lead large, complex data projects with limited direction to meet established deadlines.
• Perform performance tuning on SQL and PL/SQL to ensure efficient data processing.

Required Skills

• 5+ years of experience in Big Data development.
• Proficiency in Hadoop and Hive.
• Strong experience with Google Cloud Platform, specifically Dataflow, BigQuery, GCS, and Composer.
• Advanced Python skills for data engineering and scripting.
• Expertise in SQL and PL/SQL, including Oracle and PostgreSQL.
• Hands-on experience with Data Warehousing and Business Intelligence (BI) concepts.
• Proven ability in performance tuning and analytical problem-solving.
• Bachelor's degree or equivalent graduate education.

Key Skills

Education

Any Gradute