Description

• Design, develop, and support large-scale distributed data processing applications using Apache Spark and Scala.
• Build and optimize data pipelines using Spark Core, Spark SQL, and Spark Streaming.
• Develop scalable solutions for processing large volumes of data.
• Write clean, efficient, and maintainable Scala code following best practices.
• Work with Python, Hadoop, Hive, HDFS, and other Big Data technologies.
• Design and develop ETL and data warehousing solutions.
• Perform SQL and NoSQL database development and optimization.
• Analyze, troubleshoot, and resolve data processing and performance issues.
• Collaborate with business users, architects, and cross-functional teams.
• Participate in Agile ceremonies including daily standups, sprint planning, reviews, and retrospectives.
• Support production environments and ongoing application maintenance.
• Stay current with emerging Big Data technologies and industry trends.

Required Qualifications

• Strong hands-on experience with Spark Core, Spark SQL, and Spark Streaming.
• Strong programming experience in Scala.
• Experience with Python and SQL.
• Good understanding of Data Structures and Algorithms.
• Experience with Hadoop ecosystem technologies.
• Knowledge of ETL and Data Warehousing concepts.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and teamwork skills

Key Skills

Education

Bachelor's degree