QA automation hiring assessment
See whether a candidate's test actually catches bugs.
A passing test can still miss a bug.
TestAcademy runs the candidate's test against the working app. Then it checks versions with required behavior broken on purpose.
You see which required behaviors the test caught and missed.
For QA leads and engineering managers hiring Playwright or Cypress engineers using JavaScript or TypeScript.
€250 for one open role. Up to 3 candidates. Plus tax where required.
We observe the sessions. We do not rank candidates or recommend who to hire.
A passing test does not show what it would catch
A pass means the test passed against the app as it was.
It does not prove the test would fail if a required behavior broke.
The pilot checks this with existing TestAcademy problems. Use the results with your interview.
How the pilot works
Step 1
Choose the tasks together
We discuss your open role and select existing problems that fit it.
Step 2
Watch the candidate write tests
We arrange the sessions with you. The candidate writes browser tests in the TestAcademy editor.
Step 3
Run against the working app
The test must pass here before TestAcademy checks it against broken behavior.
Step 4
Check broken app behavior
The same test runs against versions with a bug added on purpose. Each version is checked separately.
Step 5
Review the results together
The result names bugs caught and missed. We prepare a summary for each candidate and discuss it with you.
Understand the evidence
These descriptions explain the result types. They are not recorded runs or candidate submissions.
Verified result
The test passes on the working app. It fails on every broken version checked for that task.
It caught the bugs checked in this task. This does not show every skill needed for the job.
Incomplete result
The test passes on the working app. It also passes on a version with broken behavior.
Example behavior: the cart subtotal ignores quantity.
If the test still passes, it missed that behavior. The report names the missed behavior.
Open the demo and press Verify to inspect an actual result. No account is needed.
Open the working demoTestAcademy QA Automation Hiring Pilot
A manual pilot for your open role
€250
Plus tax where required.
- 1 open role
- Up to 3 candidates
- 2 existing graded problems per candidate
- Sessions where we watch the candidate write tests
- A summary of each candidate's test results
- Report links when the candidate chooses to share them
- One discussion of the results with the hiring manager
No candidate ranking. No hiring recommendation.
Discuss a hiring pilotWhat you receive
- Problems attempted and framework used
- Required behaviors caught and missed
- Code review notes and the submitted test code
- Report links where the candidate chooses to publish
- Notes from the person who watched the session
- The limits of these checks and questions to discuss in the interview
The candidate needs an account to publish a report. Sharing is optional. Anyone with the link can read it. The candidate can stop sharing it.
What this assessment does not prove
We watch the candidate write tests. We do not lock down their browser.
We do not check the candidate's identity. We cannot prevent outside help or access to solutions.
Grading runs in the candidate's browser. The server checks the report data. It does not run the test again.
Use these results with an interview. They are not a certificate of skill. Do not base a hiring decision only on these results.
Discuss your open QA automation role
Tell us the role, framework and when you need to hire. We will check whether the existing tasks fit.
€250. Plus tax where required. One role, up to 3 candidates.
Discuss a hiring pilotThe button opens your email app. You can also email us directly: contact@testacademy.dev