Description

You will own the design, development, and optimization of data-intensive applications using Python and PySpark. Your focus is on building robust data pipelines and ensuring high-performance database interactions.

Responsibilities

• Architect and implement complex data models and schemas in MongoDB, including indexing strategies and aggregation pipelines.
• Develop and optimize PySpark jobs for large-scale data processing and transformation.
• Write and tune complex SQL queries, stored procedures, and datasets to ensure performance and consistency.
• Troubleshoot and resolve performance bottlenecks across Python, Spark, and database layers.
• Participate in solution architecture discussions and Agile ceremonies to drive technical decisions.

Required Skills

• 8+ years of hands-on Python programming experience.
• Extensive experience with MongoDB, including NoSQL operations, data modeling, and schema design.
• Strong proficiency in SQL, including complex query writing and performance tuning.
• Practical experience with PySpark for distributed data processing.
• Proven track record of ensuring data quality, consistency, and governance.
• Ability to troubleshoot and debug issues across the full stack (Python, Spark, DB).
• Bachelor’s degree in a technical field or equivalent experience.

Key Skills

Education

Any Graduate