Description

Build and maintain data ingestion and transformation pipelines within big data environments.

Responsibilities

• Develop API services and big data applications using Scala and Spark.
• Build data transformation logic using DataFrame APIs and Spark SQL.
• Manage data workflows within AWS cloud environments and Hadoop ecosystems.
• Collaborate within Agile teams to deliver scalable data solutions.

Required Skills

• 5+ years of total professional experience.
• 3+ years focused on Scala and Spark projects.
• Strong programming background with expertise in Scala and Python.
• Hands-on experience with PySpark and Apache Spark.
• Proficiency in Big Data tools including Hadoop, Hive, and Sqoop.
• Experience with AWS services such as Glue and EMR.
• Knowledge of Databricks, CDH, and Linux OS.
• Familiarity with Git and build tools like Maven or SBT.

Preferred Skills

• Experience with Jira, Veracode, and SonarQube.
• Working knowledge of Agile/Scrum development cycles.

Key Skills

Education

Any Graduate