Description

You will design, build, and maintain scalable data pipelines and APIs.

Responsibilities

• Develop ETL/ELT workflows for data ingestion, transformation, and processing using Cloud Composer, Dataflow, or custom scripts.
• Optimize BigQuery performance through partitioning, clustering, and query tuning.
• Monitor and troubleshoot data pipeline performance, failures, and cost efficiency.
• Design and implement Microservice Architecture and patterns using Core Java and Spring Boot.
• Develop APIs utilizing APIGEE and applying necessary security patterns.

Required Skills

• 5+ years of professional experience in data engineering or API development.
• Strong proficiency in SQL, Python, and Java for data processing and automation.
• Expertise with GCP services, including BigQuery, Dataflow, Cloud Storage, Pub/Sub, and Bigtable.
• Experience designing and building APIs using Spring Boot and Core Java.
• Familiarity with Microservice Architecture and security patterns.
• Experience with real-time and batch processing architectures.
• Understanding of data modeling, warehousing, and distributed computing concepts.
• Knowledge of security and compliance standards (IAM, encryption, GDPR, HIPAA).

Preferred Skills

• GCP certifications (e.g., Professional Data Engineer, Associate Cloud Engineer).
• Exposure to Kafka or Ni-Fi for streaming technologies.
• Experience with containerization using Docker.

Key Skills

Education

Any Gradute