Description

You will design and implement data processes on Google Cloud Platform, ensuring adherence to best practices and standards.

This role is on-site.

Responsibilities

• Develop and maintain APIs using Apigee and Python FastAPI.
• Build and manage data pipelines with Spark Streaming and Kafka.
• Deploy and monitor serverless applications on Cloud Run, GKE, and Cloud Functions.
• Optimize data storage and queries in BigQuery, Cloud SQL, Cloud Spanner, and Bigtable.
• Implement CI/CD pipelines and manage infrastructure using GitHub and Postman.

Required Skills

• 5+ years of hands-on experience in data engineering.
• Strong proficiency in Python, Java, or Scala.
• Deep understanding of GCP components including BigQuery, Cloud Run, GKE, and Cloud Functions.
• Experience with API development using Apigee and FastAPI.
• Proficiency in streaming technologies like Spark Streaming and Kafka.
• Solid grasp of data formats: SQL, JSON, Avro, and Parquet.
• Familiarity with Dynatrace for monitoring and Postman for API testing.

Preferred Skills

• Experience with Vertex AI and NLP.
• Knowledge of Cloud Logging and CI/CD best practices.

Key Skills

Education

Any Gradute