Description

You will design and build scalable data processing solutions using PySpark, focusing on efficient JSON data structures and end-to-end deep learning models.

This role is remote.

Responsibilities

• Design and develop custom query builders for efficient JSON data processing using PySpark.
• Implement data models and database schemas optimized for JSON storage and retrieval.
• Build and maintain data pipelines and workflows to ensure data accuracy.
• Develop end-to-end deep learning models from conception to deployment.
• Collaborate with data scientists to translate business requirements into scalable technical solutions.

Required Skills

• 5+ years of professional software engineering experience.
• Proficiency in Python programming.
• Extensive hands-on experience with PySpark and Apache Spark.
• Strong understanding of JSON data structures and parsing.
• Solid knowledge of SQL and relational database systems.
• Proven experience building end-to-end deep learning models.
• Any Graduate degree.

Preferred Skills

• Experience with distributed computing frameworks.
• Knowledge of data processing best practices.

Key Skills

Education

Any Graduate