Description

You will design, build, and deploy data-driven applications using Python and PySpark.

Responsibilities

• Design, develop, test, and maintain data integration pipelines.
• Optimize and troubleshoot existing PySpark applications to improve performance.
• Build and manage continuous integration workflows using Git, Bitbucket, or GitLab/Jenkins.
• Deploy and maintain scalable data processing applications.

Required Skills

• 6+ years of experience in designing and deploying Python and PySpark applications.
• Proficiency in Python and its common libraries.
• Strong experience with PySpark and Spark SQL.
• Hands-on experience with SQL.
• Experience using PyCharm and Jupyter Notebooks.
• Working knowledge of source control systems including Git, Bitbucket, and GitLab.
• Experience with Jenkins and continuous integration tools.

Preferred Skills

• Any Graduate degree.

Key Skills

Education

Any Graduate