Description

You will design, build, and maintain large-scale data processing pipelines and software systems for internal and customer-facing applications.

This role is on-site.

Responsibilities

• Build and maintain large data processing pipelines using PySpark and SQL.
• Contribute to software builds within an agile team, adhering to consistent development practices and documentation standards.
• Write code, conduct code reviews, and perform testing during ongoing sprints or proof-of-concept phases.
• Debug software components, identify defects, and implement remediations.
• Support the deployment, monitoring, and maintenance of software across test, integration, and production environments.

Required Skills

• 6–9 years of software development experience with expertise in application design and automated testing.
• Proficiency in SQL and PySpark for data processing.
• Hands-on experience with Big Data technologies: Spark, Hive, MapReduce, and HBase.
• Experience with Hadoop, HDFS, and Kafka.
• Strong knowledge of UNIX, Shell, Perl, or Python scripting.
• Competency in database query optimization and indexing.
• Bachelor’s degree in Computer Science, Computer Engineering, a technical discipline, or equivalent work experience.

Preferred Skills

• Experience with web services design and implementation using REST, SOAP, and Java.

Key Skills

Education

Any Graduate