Description

You will design and build scalable data processing solutions using PySpark, with a specific focus on efficient JSON data structures. You will own the development of custom query builders, data models, and end-to-end deep learning models while ensuring data accuracy through robust pipeline maintenance.

Responsibilities

• Design and develop custom query builders for efficient JSON data processing using PySpark.
• Implement data models and database schemas optimized for JSON storage and retrieval.
• Develop and maintain data pipelines and workflows to ensure data accuracy and reliability.
• Build end-to-end deep learning models from conception to deployment.
• Collaborate with data scientists and analysts to translate business requirements into scalable technical solutions.

Required Skills

• 5+ years of professional software engineering experience.
• Proficiency in Python programming.
• Extensive hands-on experience with PySpark and Apache Spark.
• Strong understanding of JSON data structures and parsing.
• Solid knowledge of SQL and relational database systems.
• Proven experience building end-to-end deep learning models.
• Any Graduate degree.

Preferred Skills

• Experience with distributed computing frameworks.
• Knowledge of data processing best practices.

Key Skills

Education

Any Graduate