Description

You will design and deliver data solutions within the Google Cloud Platform ecosystem.

Responsibilities

• Design and implement data solutions leveraging GCP services including DataProc, DataFlow, and BigQuery.
• Build and maintain event-driven architectures using Java, REST APIs, Apache Flink, and Kafka.
• Develop Big Data pipelines using Spark, PySpark, Hive, and HDFS.
• Manage data integration across relational and NoSQL databases such as MongoDB, SQL Server, Atlas, and Azure SQL.
• Implement security protocols including Kerberos and JWT into data platforms.
• Participate in Agile ceremonies, including sprint planning and user story development.

Required Skills

• 10+ years of experience in data engineering.
• Extensive experience with Google Cloud Platform (GCP).
• Proficiency in DataProc, DataFlow, and BigQuery.
• Hands-on experience with Spark, PySpark, and HDFS.
• Strong background in Big Data platforms like MapR or Cloudera.
• Expertise in Java and REST APIs.
• Experience with Apache Flink and Kafka for event-driven solutions.
• Working knowledge of MongoDB, SQL Server, Atlas, and Azure SQL.
• Familiarity with wire formats including XML, JSON, Avro, and CSV.

Key Skills

Education

Any Gradute