Description

You will build and maintain scalable data transformation applications within a big data ecosystem.

Responsibilities

• Design and deliver high-quality solutions that adhere to business requirements and design patterns.
• Develop and maintain scalable data transformation applications using the Apache Spark framework.
• Solve big data problems involving large data volumes using Spark, Hive, and MPP processes like Impala.
• Manage data workflows using Unix file systems and HDFS commands.

Required Skills

• 4-6 years of experience in big data development.
• Proficiency with PySpark, Python, and Spark.
• Experience with Hive and MPP processes such as Impala.
• Competency with Unix file systems and HDFS commands.
• Experience using Oracle SQL Developer.
• Strong communication and customer management skills.
• Bachelor's degree in any field.

Preferred Skills

• Knowledge of data ingestion tools including Sqoop and Kafka.
• Experience building projects using Eclipse IDE and Tetia Client.
• Broad understanding of the Big Data ecosystem components.

Key Skills

Education

Any Graduate