Description

You will design and build cloud-native data architectures focused on low latency and high availability. You own the development of platform-level systems and optimize data processing workflows.

Responsibilities

• Design and build cloud-native applications and platform-level system architectures.
• Develop and optimize complex SQL queries and PySpark dataframes for large-scale data processing.
• Optimize joins and data processing workflows to handle massive datasets efficiently.
• Implement data warehousing solutions using Big Data technologies.

Required Skills

• 3+ years of experience in Data Engineering or Data Warehousing.
• Hands-on experience with GCP, Google Composer, BigQuery, and BigTable.
• Proficiency in Python or Scala.
• Strong expertise in SQL, Hive, and PySpark-dataframes.
• Deep understanding of Hadoop and Spark architecture.
• Experience with Big Data technologies and NoSQL.
• Proficiency in UNIX shell scripting.
• Knowledge of cloud-native principles and architectures.

Preferred Skills

• Experience with Docker, Kubernetes, or OpenShift.
• Experience with NoSQL databases such as HBase, Couchbase, or MongoDB.

Key Skills

Education

Any Graduate