Description

Build and maintain large-scale data processing pipelines and architectures.

You will own the release pipeline.

Responsibilities

• Design and implement data modeling solutions using data warehousing best practices.
• Develop data processing logic using Scala and Spark.
• Analyze complex datasets to define problems, collect data, and establish facts.
• Write advanced scripts to automate data workflows and management tasks.
• Contribute to architectural decisions and drive technical improvements.

Required Skills

• 7+ years of experience in the IT industry.
• Expertise in Spark, Spark-SQL, and Scala.
• Strong proficiency in SQL and Hive.
• Experience with Hadoop ecosystems.
• Advanced scripting capabilities.
• Solid understanding of data warehousing architecture and data modeling.

Preferred Skills

• Exposure to Google technologies including BigQuery, BigTable, and Dataproc.
• Experience with data scheduling tools.

Key Skills

Education

Any Graduate