Jenna FREN Book a call
Methodology · Assessment automation

How we set up AI pre-assessment on your platform

Jenna first-marks your learners' coursework on your own portal, writes feedback the way your assessor does, and leaves the final decision to your assessor. This page explains how we get there: what we do, what we need from you, and how you know the result can be trusted before you rely on it.

Nothing to install · No change to your portal · Your assessor signs off every Pass

Four principles

Accountability

A co-pilot, not an auto-marker

Regulators and awarding bodies are clear that AI must never be the sole marker. Jenna does the first pass; your assessor reviews and signs off. Nothing is final without a human.

Standard

Your standard, not ours

Marks, minima and criteria come from the awarding body's guidance, verbatim. We never author marking criteria. Where the guidance leaves judgement to the assessor, we derive the bar from your assessor's own marking and have them ratify it.

Evidence

Measure before trust

Before any live use, the standard is applied blind to learners your assessor has already marked and compared criterion by criterion. We look for the pattern behind disagreements, not just an agreement rate.

Safety

Protect your platform and budget

Discovery is read-only. Data capture is rate-capped and click-free. Credentials are stored as encrypted secrets. Every run is recorded step by step. Stalled runs are stopped, not left to consume minutes.

Six phases

A first qualification level typically takes two to three weeks elapsed, most of it waiting on learner submissions and assessor time rather than on us.

1. Discovery, read-only

We explore your assessor interface without changing anything: how chapters, questions, marks, feedback and Pass/Refer work, what is deep-linkable, where answers are images or files. We extract the awarding body's assessment guidance and your course manuals to text.

You provide
  • A dedicated assessor login for Jenna
  • The assessment guidance and manuals
  • Which qualification and level come first
We deliver
  • A map of your portal's assessor workflow
  • A list of what is markable online and what is not
  • A fixed quote for the set-up
Typical duration
  • One day

2. The marking standard

One knowledge entry per question carrying the guidance's own wording: the marks available, the minimum, the criteria. Feedback topics are grounded in your manuals so comments point learners to the right material without giving the answer. You review each chapter's standard in a readable document before it is used.

You provide
  • A short review of each chapter document
  • Your decision on the pass threshold where portal and guidance differ
We deliver
  • Per-chapter marking documents you can check
  • The same content loaded as mission knowledge
Typical duration
  • One to two days per level

3. Behaviour design

How Jenna acts is agreed with you and written into every mission: comment where marks are lost, record the mark she can justify, never refer on her own, re-review only what the learner revised, record a Pass only when every minimum and the total are met, hand to a human after three rounds. Feedback is always answer-free.

You provide
  • How your assessor works with learners today
  • Any house rules on feedback tone
We deliver
  • A written behaviour specification
  • The mission objectives implementing it
Typical duration
  • Half a day

4. Set-up on your Jenna account

One mission per chapter, each carrying the list of learners to assess. A new cohort is the same mission with new names. Credentials are stored as encrypted secrets and revealed only at login. Marking uses the high-effort model mode; narration is off; each chapter has a step budget sized to its length.

You provide
  • A Jenna account on the Autopilot subscription
  • The first learner to assess
We deliver
  • Provisioned, named missions per chapter
  • A first live run with its recording and report
Typical duration
  • One day

5. Validation against your assessor

The standard is applied blind to learners your assessor has already marked and compared criterion by criterion. Live runs are second-marked independently. We look for the direction of disagreement and bias the standard towards strictness, because a stricter first pass costs a learner one revision while a lenient one costs you a false Pass.

You provide
  • Two or three fully assessor-marked learners
  • An hour of your assessor's time to settle judgement calls
We deliver
  • A criterion-level comparison table
  • A written list of the failure modes found and how each is handled
Typical duration
  • One to two days

6. Calibration and go-live

Your assessor's own marks and feedback are read from the portal with plain, rate-capped page requests and no clicks. From them we derive a calibration layer for the criteria the guidance leaves vague, kept separate from the guidance text, and your assessor ratifies it. We re-run the questions that were over-marked, on empty mark boxes, and confirm they move. Then learners are first-marked as they submit.

You provide
  • Twenty to thirty assessor-marked learners for calibration
  • Your assessor's ratification of the derived rules
We deliver
  • The calibration layer with provenance to the assessor's own comments
  • A re-validation scorecard
  • A short operating guide for your team
Typical duration
  • Two to three days, plus assessor time

What stays human

  • Every Pass. Jenna submits under the assessor account; your assessor reviews and remains accountable. The errors that matter live at the pass boundary, so that is where the human looks.
  • The bar for vague criteria. "A more detailed answer" means what your assessor says it means. We derive it from their marking and they ratify it.
  • Learners who do not converge. After three comment-and-revise rounds on the same answer, the chapter is flagged for a person.
  • Practical and in-person assessments. Only what is marked online is in scope.

Safety and data handling

  • Read-only discovery. Nothing on your portal is changed until the first agreed live run.
  • Rate-capped capture. Reading your assessor's marks for calibration uses plain page requests at one request per second, with no clicks and no AI in the loop.
  • Credentials as secrets. Logins are stored encrypted on your Jenna account and never appear in mission text or logs.
  • Audit trail. Every run keeps a video, a step-by-step log with screenshots and the rationale behind each mark.
  • Anonymisation. Learners are never named in anything that leaves your account.
  • Budget control. Minutes are tracked to the decimal; runs that stall are stopped; nothing polls on a schedule.

What it costs

Set-up is billed by the hour and quoted after discovery. Running costs are Jenna automation minutes on your own account. On our reference engagement, a first-marked chapter consumed roughly 30 to 50 minutes of browser time in high-effort mode.

MarkerTime per chapterCost per chapter
A qualified assessor20 – 40 minutes≈ €7 – 13
Jenna, standard model≈ 36 minutes of browser time≈ €1.4
Jenna, high-effort model30 – 50 minutes of browser time, billed at 2.5×≈ €3.5

Figures measured on Active IQ Level 2 chapters of 14 to 16 questions. Your chapters may be shorter or longer.

Questions centres ask

Do we need to change our learning platform?

No. Jenna works through a real browser on your existing portal with a dedicated assessor account. There is no integration, no plugin and nothing to install. If your portal is deep-linkable, runs are faster; if not, Jenna navigates like a person would.

Does the AI decide who passes?

No. Jenna first-marks and leaves feedback. Where an answer is below its minimum, the chapter is held with comments for the learner, never referred. Your assessor reviews every result and remains accountable for the outcome.

What about answers that are images, posters or PDFs?

Jenna opens the preview your portal provides and marks from what she sees; a poster assignment was marked 13 out of 13 in agreement with the assessor on our reference engagement. Hand-annotated images and anything the portal cannot preview are flagged for a person.

How do you keep learners' data safe?

Jenna runs on your own account with your own credentials, stored encrypted. We read your portal only as agreed, at a capped rate. Learners are anonymised in any report that leaves your account. Run recordings live on your account and can be deleted on request.

What happens when the model is wrong?

Every mark carries its rationale and the learner's quoted words, so a wrong mark is visible and correctable in the portal exactly as today. Systematic errors are what validation and calibration exist to find; on our reference engagement the pattern was leniency on vague criteria, and the calibration moved seven of nine targeted questions to the assessor's mark.

Which qualifications and platforms?

Any written coursework marked online against a published mark scheme. We started with Active IQ Level 2 and 3 on a custom Laravel portal; Moodle and similar learning platforms follow the same six phases.

Start with a 15-minute discovery call

Tell us which qualification you mark and on which platform. We will say honestly whether it fits and what the set-up would take.