Description

You will build and manage data processing frameworks and pipelines on Google Cloud Platform.

Responsibilities

• Build high-performing data processing frameworks leveraging Google Cloud Platform.
• Develop data pipelines supporting both batch and real-time streams for collection, storage, and transformation.
• Execute ETL development and data engineering work using Dataflow, Dataproc, and BigQuery.
• Manage data ingestion, capture, processing, and curation using industry-standard technology stacks.
• Automate deployments and testing through CI/CD pipelines.

Required Skills

• 10+ years of application development experience.
• GCP Certification.
• Proficiency in Python and Java.
• Strong SQL background for analyzing large datasets and creating structured outputs.
• Hands-on experience with GCP services: Dataflow, BigQuery, Cloud Storage, Dataproc, Composer, Airflow, Pub/Sub, and Cloud Monitoring.
• Experience with Memorystore/Redis and BigTable.
• Database experience with Teradata and BigQuery.
• Proficiency in Unix utilities, commands, and bash shell scripting.
• Experience with CI/CD automation pipelines and JIRA.

Preferred Skills

• Experience with Kubernetes, Docker containers, Spark, PySpark, or Kafka.
• Knowledge of Scrum/Agile methodologies, data mapping, and JSON/XML manipulation.

Key Skills

Education

Any Graduate