Description

Role Overview :

We are seeking a highly motivated and experienced QA Testing professional with a strong background in Python to join our dynamic team in Pune. In this role, you will be responsible for designing, developing, and executing comprehensive test strategies for our Big Data platform and related applications. You will collaborate closely with developers, data scientists, and product managers to ensure the quality, reliability, and performance of our solutions, ultimately contributing to the success of our clients and the growth of our business.

Key Responsibilities :

To be successful in this role, you should possess :

- Strong hands-on experience in Big Data testing using Python and PySpark.

- Experience in Cloud testing, with preference for AWS (S3, EMR, Glue, Lambda, etc.)

- Proficiency in Spark SQL for validating data across distributed systems (not traditional RDBMS SQL).

- Strong Python scripting skills for automation, data validation, and framework development.

Some of Highly Valued Skills may include :

- Experience working with Databricks Notebooks for exploratory testing and validation.

- Familiarity with Databricks platform and workflows.

- Knowledge of data pipeline validation and ETL testing.

- Experience with CI/CD pipelines and test automation integration.

- Understanding of data quality frameworks and validation techniques.

- Develop and maintain automated test scripts using Python and related frameworks to ensure comprehensive test coverage.

- Design and execute test plans and test cases based on functional specifications and technical designs to identify and resolve defects.

- Perform functional, integration, regression, and performance testing to validate the quality and stability of our Big Data platform.

- Collaborate with developers to analyze and debug software defects to ensure timely resolution.

- Contribute to the continuous improvement of our QA processes and methodologies to enhance efficiency and effectiveness.

- Utilize PySpark for testing and validating data transformations and data quality within our Big Data pipelines.

- Analyze large datasets to identify data quality issues and ensure data integrity.

Required Skillset :

- Demonstrated proficiency in Python programming and related testing frameworks (e.g., pytest, unittest).

- Proven ability to design and implement automated test solutions for complex software systems.

- Experience with Big Data technologies and frameworks, including PySpark.

- Strong understanding of software testing principles, methodologies, and best practices.

- Excellent analytical and problem-solving skills, with a keen attention to detail.

- Effective communication and collaboration skills, with the ability to work effectively in a team environment.

- Bachelor's degree in Computer Science or a related field

Key Skills

Education

Any Graduate