Description

You will build and maintain data processing pipelines and architectures within a large-scale data environment.

Responsibilities

• Design and implement data modeling solutions using data warehousing architecture best practices.
• Develop data processing logic using Scala and Spark.
• Analyze complex datasets to define problems, collect data, and establish facts.
• Write advanced scripts to automate data workflows and management tasks.
• Contribute to architectural decisions and take initiative on technical improvements.

Required Skills

• 7+ years of experience in the IT industry.
• Expertise in Spark, Spark-SQL, and Scala.
• Strong proficiency in SQL and Hive.
• Experience with Hadoop ecosystems.
• Advanced scripting capabilities.
• Solid understanding of data warehousing architecture and data modeling.
• Strong analytical skills for problem definition and data collection.
• Any Graduate degree.

Preferred Skills

• Exposure to Google technologies including BigQuery, BigTable, and Dataproc.
• Experience with data scheduling tools.

Key Skills

Education

Any Graduate