Description

You will build and maintain data pipelines and analytics components using Spark and AWS services.

This role is on-site.

Responsibilities

• Build and maintain data pipelines using Spark and Big Data frameworks.
• Write complex SQL queries for data analytics and modeling.
• Develop and test data components using Python or Scala.
• Manage data workflows using AWS Glue, S3, Athena, and EMR.
• Automate tasks using Windows PowerShell scripting.

Required Skills

• 5+ years of experience with SQL, including complex queries and data modeling.
• 4+ years of experience with Spark.
• 3+ years of experience with Python or Scala.
• Experience with the Hadoop ecosystem: Hive, Sqoop, and HDFS.
• Hands-on experience with Teradata and Unix environments.
• Proficiency with AWS services: Glue, S3, Athena, and EMR.
• Experience with Windows PowerShell scripting.

Preferred Skills

• Bachelor’s degree in Computer Science Engineering, a related discipline, or equivalent experience.

Key Skills

Education

Bachelor’s degree in Computer Science Engineering or related discipline or equivalent.