Listing note. Listings come from public job feeds and can change or expire—check the original source and eligibility requirements before applying.

All listings

Technology

[8CI] QA AUTOMATION ENGINEER / SDET — AI PROTOTYPING

Software Mind

HimalayasRemote
WhatsApp
Location
Costa Rica, Costa Rica
Type
Remote
Salary
Salary not specified
Posted
19 Nov 2026
• Define and run a pragmatic, risk-based test strategy across several prototypes built in parallel • Build reusable automated checks for APIs, user interfaces and generated documents, and connect them to CI • Maintain versioned reference (golden) datasets with the on-site Product Owner and the client's engineers • Design checks for AI output: schema validation, bounded acceptance criteria and regression tracking • Prefer deterministic checks for calculations and code compliance, kept independent of the code under test • Use AI-assisted test generation, reviewing and owning every test it produces • Extend regression suites after defects or feature changes, and run them before refactoring • Report coverage, known limitations and release risk, and support developers with shared fixtures and tooling • 5+ years in QA automation or as an SDET • Strong test automation in TypeScript and/or Python • API and integration testing; Playwright (or similar) for UI automation • Integrating automated tests into CI pipelines, with sound fixture and test-data management • Practical use of AI tools to generate tests, with critical review of the output • Risk-based judgement on what to test thoroughly
Define and run a pragmatic, risk-based test strategy across several prototypes built in parallel Build reusable automated checks for APIs, user interfaces and generated documents, and connect them to CI Maintain versioned reference (golden) datasets with the on-site Product Owner and the client's engineers Design checks for AI output: schema validation, bounded acceptance criteria and regression tracking Prefer deterministic checks for calculations and code compliance, kept independent of the code under test Use AI-assisted test generation, reviewing and owning every test it produces Extend regression suites after defects or feature changes, and run them before refactoring Report coverage, known limitations and release risk, and support developers with shared fixtures and tooling 5+ years in QA automation or as an SDET Strong test automation in TypeScript and/or Python API and integration testing; Playwright (or similar) for UI automation Integrating automated tests into CI pipelines, with sound fixture and test-data management Practical use of AI tools to generate tests, with critical review of the output Risk-based judgement on what to test thoroughly and what not to over-test in prototypes Good English; able to work core hours on US Central Time Additional skills – the edge you have: Experience evaluating LLM or other AI output (evaluation sets, scoring, regression) Testing document outputs such as PDFs, spreadsheets or generated reports Exposure to engineering, construction or CAD/BIM data Experience with AWS-hosted applications Familiarity with engineering codes or regulated, safety-relevant domains 6 MONTHS ENGAGEMENT We are Software Mind , an awesome team of engineers who are ready to ramp up any top-notch company’s projects! Our aim? To always be one step ahead. Become part of a multicultural company in constant growth with an excellent work environment certified by Great Place To Work! Join a six-person squad building AI tools for one of the largest electrical contractors in the eastern US, on behalf of a fast-growing, venture-backed US SaaS company that is the system of record for commercial electrical systems. You will make speed safe, building the shared automation, reference datasets and CI checks that let prototypes change quickly without breaking what works, including AI-generated output. Originally posted on Himalayas