Description

You will design, develop, and maintain large-scale data processing pipelines and software systems for customer-facing and internal applications.

Responsibilities

• Build and maintain large data processing pipelines using PySpark and SQL.
• Contribute to software builds within an agile team using consistent development practices and documentation.
• Write code, conduct code reviews, and perform testing during ongoing sprints or proof-of-concept phases.
• Debug software components, identify code defects, and implement remediations.
• Support the deployment, monitoring, and maintenance of software across test, integration, and production environments.

Required Skills

• 6–9 years of software development experience with hands-on expertise in application design and automated testing.
• Proficiency in SQL and PySpark for data processing.
• Hands-on experience with Big Data technologies including Spark, Hive, MapReduce, and HBase.
• Experience with Hadoop, HDFS, and Kafka.
• Strong knowledge of UNIX, Shell, Perl, or Python scripting.
• Competency in database query optimization and indexing.
• Ability to collaborate with business stakeholders to drive requirements and Agile story analysis.
• Bachelor’s degree in Computer Science, Computer Engineering, a technical discipline, or equivalent work experience.

Preferred Skills

• Experience with web services design and implementation using REST, SOAP, and Java.

Key Skills

Education

Any Graduate