Description

You will build and maintain data processing pipelines using Spark and distributed computing technologies.

Responsibilities

• Develop scalable data processing applications using Java, Scala, or Python.
• Manage structured and unstructured data using SQL and NoSQL databases.
• Build and orchestrate data workflows using tools like Airflow, Oozie, or NiFi.
• Analyze data to identify processing opportunities and address technical gaps.
• Operate within cloud or on-premise Big Data platforms.

Required Skills

• 5+ years of professional software development experience.
• Advanced proficiency in Java, Scala, and Python.
• Extensive experience with the Spark processing engine.
• Intermediate experience with SQL and NoSQL.
• Hands-on experience with Hive and Impala.
• Experience with workflow orchestration via Airflow, Oozie, or NiFi.
• Experience with streaming technologies like Kafka.
• Exposure to Big Data platforms such as AWS Redshift, Google BigQuery, or Azure Data Warehouse.
• Any Graduate degree.

Key Skills

Education

Any Graduate