Why Join Us?If you're looking to work on cutting-edge AI products, solve challenging problems, and be part of a fast-moving, high-talent team, you'll love it here.Join NineTwoThree AI Studio, a remote-first product design, engineering, and marketing studio, founded in 2012 and based in Boston. We build AI-powered web and mobile apps for big brands and fast-moving startups — from Fortune 500 companies to MIT research labs.You'll work with really smart people — the kind of teammates who challenge you, push you forward, and make you better. We move fast and focus on getting things done.We've been growing 20% every year for the last 5 years, which means there's plenty of room for career growth and promotions. We run on clear processes and strong leadership — we move quickly, but we don't do chaos. We do high-quality work, and we do it right.We focus on products with a positive impact: sports, health, logistics, nuclear, and AI. If you're into gambling, adult entertainment, or crypto — we're not your place.About This RoleThis is not a traditional QA role. Most of our products are powered by AI — meaning the system's output is intentionally non-deterministic. There's no single "right answer" to compare against. Your job is to figure out what "correct" looks like for a given business goal, build your own definition of it, and systematically verify whether the system gets there.You'll be testing things like: does the AI response correctly synthesize data from multiple sources? Does it apply the right organisational rules? Does it stay within its intended boundaries or leak information it shouldn't?We'll teach you the tools and techniques. What we can't teach is how you think — and that's what we're hiring for.What This Role Is NotIt's not pixel-perfect UI checking (though functional correctness is still your baseline)It's not pass/fail against a rigid specIt's not for someone who is "comfortable with ambiguity" in the sense of being okay with vague conclusions — you'll be expected to resolve ambiguity, not tolerate itMindset we're hiring for (this matters more than your CV):When requirements are vague, you don't get stuck — you form a hypothesis, define your own acceptance criteria, and test against itYou understand that AI systems fail in specific, diagnosable ways: hallucination, retrieval gaps, prompt sensitivity, role/permission leakageYou think in terms of outcomes and business goals, not just functional stepsYou're honest when something is untestable without more information — and you push to get that informationRequirementsReview requirements and independently define what "correct output" looks like when none is explicitly statedDesign test plans, scenarios, and checklists for AI-powered features where expected results are probabilisticPerform manual functional, regression, and exploratory testing across web and mobileTest AI outputs for hallucinations, incomplete retrieval, confidently wrong answers, and failure to apply business rulesInspect API requests and responses via DevTools or Postman to verify what data the system actually used — not just what it showedDocument and report bugs with enough context that developers can reproduce and diagnose themCollaborate closely with developers, product managers, and AI engineersPresent findings clearly to both technical and non-technical stakeholdersMust-have:1.5+ years in QA or software engineeringStrong understanding of QA process, methodology, and terminology (test plan, test cases, SDLC, regression)Experience with manual testing of web and mobile applicationsComfort working with REST API and browser DevTools to inspect what's actually happening under the hoodUpper-Intermediate English (you'll communicate with international clients daily)You ask "why is this the right answer?" before accepting what the screen shows youNice to have:Basic SQL or ability to query data directly to verify what the system pulledFamiliarity with how LLMs, RAG pipelines, or AI chatbots work under the hoodExperience testing products with role-based access control (RBAC)BenefitsWhat We Offer:Annual paid vacation: 20 days-off per year during the first 3 years, further increasing to 25 days in later yearsPaid sick leave, 10 national holidays and 2 company days-offWell-being budgetHealth Insurance allowanceMaternity/paternity leaveAccounting assistanceReimbursement of expenses for professional development courses/certifications (up to 100% in agreement with the Manager)Hardware upon business needsStrong positive engineering culture, a tightly-knit team of professionals with a good sense of humorWhat's The Process:We value your time and ours and make the process fast and easy.Our interview process takes the following steps: interview with the HR, technical interview with the QA Team Lead and QA Manual Engineer, Offer.What Growth Looks Like HereWe're building out an AI QA function from the ground up. If you grow into this role, you'll be one of the people who defines how AI systems get tested at this company — building ground-truth datasets, designing evaluation rubrics, and eventually leading QA on full AI product lines. Show more Show less