Senior Testing Engineer

<p><span data-contrast="none">Robots & Pencils is an applied AI engineering firm building the next frontier of business architecture. We design and ship AI co-workers that integrate into enterprise operations and deliver measurable results for our clients. We're all in on AWS, combining deep UX capability with senior engineering talent to get AI into production fast and keep it there.</span> <br><span data-contrast="none">We’ve earned the trust of leaders across Consumer Products and Retail, Education, Energy, Financial Services, Healthcare, and Manufacturing and more, and earned a reputation as the nimble alternative to traditional global systems integrators. Founded in 2009, with delivery centers in Canada, the United States, Eastern Europe, and Latin America, we are smaller, faster, and more senior by design. Our teams average 15+ years of experience. We move fast, sweat the details, and build things that actually ship.</span><span data-ccp-props="{}"> </span></p>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 2">Position Overview</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></p>

<p><span data-contrast="none">We’re looking for a Senior Testing Engineer to lead quality across complex software features, AI/ML systems, and integrated platforms. This role is ideal for an experienced engineer who is knowledgeable across both automation and AI testing, enjoys hands-on work, and is growing into owning testing strategy and architecture.</span><span data-ccp-props="{"335559739":240}"> </span></p>

<p><span data-contrast="none">In this role, you will work as part of a cross-functional team, designing automation frameworks, validating ML models and AI workflows, and driving quality throughout the delivery process. You’ll collaborate closely with developers, ML engineers, and product teams to deliver high-quality features and develop the technical instincts that come from shipping things that matter.</span><span data-ccp-props="{"335559739":240}"> </span></p>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 2">Why This Role Matters</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></p>

<p><span data-contrast="none">At Robots & Pencils, we design AI systems for a human world. Our name says it all. Robots and pencils means engineering paired with creativity, because every agent we ship has to work for real people in real workflows. That balance is baked into how we operate.</span> <br> <br><span data-contrast="none">Every role here contributes directly to that mission. Here, you shape how AI systems integrate into enterprise operations, how teams move at real velocity, and how products create measurable impact for clients and the people they serve. We ship production-ready AI in 30 to 45 days. That pace demands people who take ownership, lead with craft, and care deeply about what they put their name on.</span><span data-ccp-props="{}"> </span></p>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 2">What </span><span data-ccp-parastyle="heading 2">You’ll</span><span data-ccp-parastyle="heading 2"> Do</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":299,"335559739":299}"> </span></p>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 3">Craft & Delivery</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="1" data-aria-level="1"><span data-contrast="none">Design and develop scalable automation frameworks for UI, API, and integration testing (e.g., Cypress, Playwright, Selenium, PyTest, TestNG, Cucumber)</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="2" data-aria-level="1"><span data-contrast="none">Integrate automated tests into CI/CD pipelines and drive CI/CD quality gates (e.g., GitHub Actions, GitLab CI, Jenkins)</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="3" data-aria-level="1"><span data-contrast="none">Design AI-specific test strategies and validate ML models across key metrics including accuracy, precision, recall, bias, and drift</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="4" data-aria-level="1"><span data-contrast="none">Test data pipelines, feature engineering processes, and validate LLM responses for hallucination risk and output consistency</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="5" data-aria-level="1"><span data-contrast="none">Perform test planning, review automation code, and ensure best practices are applied across the test codebase</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="6" data-aria-level="1"><span data-contrast="none">Monitor model quality in production environments and support release validation and quality assurance processes</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="7" data-aria-level="1"><span data-contrast="none">Bring an AI-forward mindset to your daily work, using tools like Claude, Cursor, and other modern AI assistants to ship higher-quality work at pace</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 3">Collaboration & Communication</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="8" data-aria-level="1"><span data-contrast="none">Collaborate closely with developers, ML engineers, DevOps, and product teams across the full SDLC</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="9" data-aria-level="1"><span data-contrast="none">Communicate quality status, testing findings, and risks clearly to stakeholders</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="10" data-aria-level="1"><span data-contrast="none">Participate actively in sprint ceremonies, design reviews, and release planning</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<p><strong><span data-contrast="none"><span data-ccp-parastyle="heading 3">Leadership & Influence</span></span></strong><span data-ccp-props="{"134245418":true,"134245529":true,"335559738":281,"335559739":281}"> </span></p>

<ul>

<li data-leveltext="" data-font="Symbol" data-listid="8" data-list-defn-props="{"335552541":1,"335559685":720,"335559991":360,"469769226":"Symbol","469769242":[8226],"469777803":"left","469777804":"","469777815":"hybridMultilevel"}" data-aria-posinset="11" data-aria-level="1"><span data-contrast="none">Lead quality efforts end-to-end with growing ownership of testing strategy and automation architecture</span><span data-ccp-props="{"335559739":0}"> </span></li>

</ul>

<ul>