Description

Build data-driven solutions using PySpark and Spark to optimize business processes. Own Unix shell scripting automation and pipeline monitoring.

This role is on-site.

Responsibilities

• Develop and implement data solutions using PySpark and Spark.
• Create and maintain Unix shell scripts to automate manual processes.
• Monitor and troubleshoot data pipelines to ensure continuous operation.
• Ensure data integrity and accuracy through rigorous testing and validation.
• Collaborate with cross-functional teams to gather and document business requirements.

Required Skills

• 5+ years of experience in data-driven roles.
• Proficiency in PySpark and Spark.
• Strong experience with Unix environments.
• Expertise in Unix Shell Scripting for process automation.
• Solid understanding of data analysis and visualization techniques.
• Ability to manage multiple projects simultaneously with high attention to detail.
• Bachelor's degree in Computer Science, Information Technology, or a related field.

Preferred Skills

• Experience working within the financial or technology industry.

Key Skills

Education

Any Graduate