Description

You will design, build, and maintain scalable data systems on Google Cloud Platform while leading technical discussions to ensure engineering best practices across distributed platforms.

Responsibilities

• Design, develop, and debug software for databases, applications, and tools using Python and Scala.
• Build and manage distributed data platforms, data warehouses, and data lakes on GCP.
• Implement streaming solutions using Kafka and Pub/Sub, and process data with Dataflow.
• Establish CI/CD pipelines and project management frameworks for rapid, iterative software delivery.
• Participate in code reviews, balancing production stability, feature delivery, and technical debt reduction.

Required Skills

• 5+ years of experience in data engineering or related roles.
• Proficiency in Python and Scala for data processing and application development.
• Hands-on experience with GCP services, including Cloud and DataProc.
• Strong knowledge of Hadoop, Spark, and Google Cloud Dataflow.
• Experience with streaming technologies, specifically Kafka and Pub/Sub.
• Expertise in SQL, database definition, and schema design.
• Practical knowledge of CI/CD pipelines for continuous integration and deployment.

Preferred Skills

• Familiarity with Looker Views and Models for data visualization and modeling.
• Understanding of statistical and machine learning models, data science concepts, and algorithms.
• Structured thinking skills with the ability to break down multi-dimensional problems and navigate ambiguity.

Key Skills

Education

Any Graduate