Description

You will build and support scalable Big Data applications and modern data pipelines within a software product development environment.

Responsibilities

• Build and maintain scalable Big Data applications and data pipelines.
• Develop ETL processes and perform feature engineering.
• Troubleshoot data processing issues and perform analytical tasks.
• Deliver data promptly through collaborative technical workflows.
• Work across multiple business and technical teams to meet requirements.

Required Skills

• 5 to 7 years of overall professional experience.
• 4+ years of experience building scalable Big Data applications.
• Proficiency in Spark, Scala, and the Spark Engine.
• Hands-on experience with Hadoop technologies including YARN, HDFS, and Hive.
• Experience with workflow orchestration using Airflow and Oozie.
• Strong proficiency in Shell scripting.
• Expertise in PL/SQL, NoSQL, and Data Analytics.
• Any Graduate degree.

Preferred Skills

• Experience with cloud services.
• Expertise in columnar storage formats like Parquet or Iceberg.
• Knowledge of deep learning models.

Key Skills

Education

Any Graduate