Senior/Tech Lead QA (with AI experience)

<p>We're looking for a hands-on Senior/Lead Manual QA Engineer who can cover the full testing spectrum: UI, API, and AI/ML output validation. You'll be joining a project building an AI-powered document analysis platform from the ground up. The system combines a CMS backend, modern UI, and a RAG-based AI layer used for intelligent document processing and analysis.</p> <p><strong>Key Responsibilities</strong></p> <ul> <li>Follow a phased QA approach - begin with CMS and backend testing to establish a reliable baseline of expected system behavior, then apply those insights to validate AI agent outputs effectively</li> <li>Design and execute test cases for REST APIs, covering functional correctness, edge cases, error handling, authentication, and data integrity</li> <li>Perform UI testing across core user journeys, validating layout, behavior, and integration with backend services</li> <li>Transition into AI output validation once the deterministic layers are stable - using your knowledge of business rules to identify inconsistencies, hallucinations, or degraded outputs in agent responses</li> <li>Document and maintain test cases, test plans, and bug reports in a structured and traceable way</li> <li>Participate in requirement reviews and technical discussions to identify testability gaps early</li> <li>Collaborate with the Lead Big Data/AI Engineer and AI team to understand RAG pipeline behavior, document ingestion flows, and output quality expectations</li> <li>Contribute to building reusable test assets and QA processes as the project scales</li> </ul> <p><strong>Requirements</strong></p> <ul> <li>4+ years of experience in manual QA, with exposure to frontend, backend and AI testing</li> <li>Solid experience with API testing using tools such as Postman, REST Client, or similar</li> <li>Experience testing web UIs and understanding of cross-browser/cross-environment considerations</li> <li>Ability to read and interpret API documentation, data schemas, and system architecture descriptions</li> <li>Hands-on experience working on projects that included AI, ML, or NLP components — particularly validating outputs that are probabilistic or context-dependent</li> <li>Familiarity with the concept of RAG (Retrieval-Augmented Generation) or LLM-based systems</li> <li>Strong analytical thinking — especially the ability to assess whether an AI response is contextually correct, not just technically non-null</li> <li>Good understanding of test documentation practices: test plans, test cases, bug reports, traceability</li> <li>Experience working in Agile/Scrum teams</li> <li>Upper-Intermediate English or higher - you'll be communicating directly with the client and cross-functional team members</li> <li>Familiarity with Palantir Foundry is a strong plus</li> </ul><div class="content-conclusion"><p><strong>We offer*:</strong></p> <ul> <li>Flexible working format - remote, office-based or flexible</li> <li>A competitive salary and good compensation package</li> <li>Personalized career growth</li> <li>Professional development tools (mentorship program, tech talks and trainings, centers of excellence, and more)</li> <li>Active tech communities with regular knowledge sharing</li> <li>Education reimbursement</li> <li>Memorable anniversary presents</li> <li>Corporate events and team buildings</li> <li>Other location-specific benefits</li> </ul> <p>*not applicable for freelancers</p></div>