- Employment type: Full Time / Part Time
- Experience: 3+ years
- Salary Range: ₹45k to 55k Monthly
- Location: Remote & WFH
- Work timing: 6:15 PM to 3:15 AM IST
Job Description
The Opportunity
As a Software Test Engineer, you’ll use your technical and teamwork skills, knowledge of testing and test automation, DevSecOps tools and methods to help deploy and improve our GenAI solutions. You will align and integrate well with testers, developers, engineers, analysts, scrum masters, delivery managers and other stakeholders.
Responsibilities
• Review user stories and evaluate their acceptance criteria.
• Design and execute comprehensive test plans for GenAI applications (text, image, audio, video, code generation, text to SQL etc.)
• Collaborate with data scientists, ML engineers, and product teams to define quality benchmarks and improve model behavior.
• Use prompt engineering techniques to test model responses across edge cases and user scenarios.
• Document and report defects, issues, and unexpected model behaviors with clarity and reproducibility.
• Contribute to the development of evaluation metrics for both quantitative (BLEU, ROUGE, Perplexity, etc.) and qualitative assessments.
• Stay current with advancements in GenAI tools, model capabilities, safety standards, and evaluation practices.
• Support automated and manual testing pipelines where applicable.
Skills and Qualifications
• Bachelor’s degree in Computer Science, AI/ML, Linguistics, or a related field.
• 4+ years of relevant professional experience in software testing on agile projects with a focus on test automation or AI/ML evaluation roles.
• Experience with test design and set-up of test approaches.
• Experience with Salesforce Agentforce.
• Strong analytical and critical thinking skills; attention to detail.
• Experience with prompt engineering, adversarial testing, or red teaming.
• Familiarity with Python or scripting for test automation.
• Good experience with testing in the cloud.
• Knowledge of ethical AI principles and safety evaluation.
• Interest in the newest testing and test automation trends, best practices and GenAI.
• Good in analyzing problems and developing solutions.
• Proficient in both oral and written communication in English.
• Team player with innovative thinking.
