Description

Build and optimize data pipelines to integrate the Lawson ERP system with Google Cloud Platform.

This role is on-site.

Responsibilities

• Design and implement ETL processes to move data from Lawson ERP into BigQuery and other GCP services.
• Develop and maintain seamless data synchronization and transformation between Lawson and the cloud.
• Optimize data pipelines for high availability, fault tolerance, and scalability.
• Automate routine data processes using Apache Airflow and Cloud Functions.
• Monitor pipeline performance and implement reporting systems to identify bottlenecks.

Required Skills

• 5+ years of experience in data engineering or cloud data engineering.
• Extensive experience with Google Cloud Platform (GCP) services.
• Proficiency in SQL and data warehousing.
• Hands-on experience with BigQuery, Dataflow, and Dataproc.
• Experience with Python for data processing.
• Proven track record of integrating ERP systems, specifically Lawson, with cloud platforms.
• Knowledge of Apache Beam, Cloud Storage, Cloud Functions, and Cloud Pub/Sub.
• Experience with orchestration tools such as Apache Airflow or Cloud Composer.
• Understanding of Lawson ERP architecture and data models.

Preferred Skills

• Experience with Cloud Composer for managing Airflow workflows at scale.

Key Skills

Education

Any Graduate