Skip to content

Guide · Choosing a systemChoosing a digitalevaluation system.

Use this guide when you write a tender or compare vendors for digital evaluation of answer scripts. It is the list we wish every institution had before its first onscreen marking rollout.

Before you start

Start with yourregulations.

A guide by NoolIQ · reviewed

The right digital evaluation system is the one that fits your examination regulations, not the other way round. Before speaking to vendors, write down how many evaluations a script receives, how differences are resolved, how revaluation works and how examiners are paid.

Then look at your scanning reality: where answer books will be scanned, how reliable power and internet are at those centres, and who will handle pages that come out blurred or missing.

With those two lists in hand, the questions below separate systems that will work in your institution from systems that only demo well.

Questions for every vendor

Ten questions to askbefore you sign.

Put these in your tender, or ask them in every vendor demo.

  1. Does the system handle bulk scanning, and what happens to the upload queue during a power cut?
  2. How are blurred, missing or duplicate pages detected and corrected?
  3. Are marks entered per question, with totals calculated by the system?
  4. Can we configure the number of evaluations and how they combine into the final mark?
  5. Is revaluation handled in the same system, with the earlier evaluations visible?
  6. Can we define our own roles and grant permissions individually?
  7. Is every annotation, mark and permission change recorded in an audit trail?
  8. Is our data partitioned from other institutions, and where is it stored?
  9. Can examiners evaluate remotely, and how is their identity verified while they mark?
  10. Is examiner remuneration calculated by the system?

Rolling out

A calm firstevaluation cycle.

  1. Pilot one programme

    Start with a single programme or semester, so examiners and the exam cell learn the workflow on a manageable volume.

  2. Prepare scanning centres

    Install the scanning software at each centre, test an upload through a deliberate power cut, and agree who rescans flagged pages.

  3. Configure your rules

    Enter subjects, evaluation rounds, rubric calculation and remuneration rates before the first script arrives.

  4. Train examiners

    A short hands-on session on the marking screen, with a sample script to practise on, is usually enough.

  5. Review and expand

    After the pilot, review turnaround, flagged pages and examiner feedback, then extend to more programmes.

Paper vs digital

Manual valuation versusdigital evaluation.

AspectManual (paper) valuationDigital evaluation
Moving scriptsBundles transported between centres and examinersScanned once; scripts reach examiners digitally
TotalsAdded by hand, recounted on requestCalculated automatically from per-question marks
Unmarked questionsNoticed late, if at allVisible on the marking screen before submission
Progress visibilityKnown when bundles returnLive, by subject, centre and evaluator
RevaluationPhysical script retrieved from storageSame system, with full evaluation history
RemunerationManual claims and verificationComputed from completed work
AuditPaper registersEvery action recorded and traceable

Questions

Frequentlyasked.

What should a digital evaluation tender include?

Your evaluation regulations (number of evaluations, reconciliation, revaluation and remuneration), scanning centres and volumes, data location and isolation requirements, audit expectations, remote evaluation and examiner verification, and support during evaluation windows.

How long does a move to digital evaluation take?

It depends on your volume and the number of scanning centres. Most institutions pilot one programme in a single cycle, then expand once examiners and the exam cell are comfortable.

Do we need special scanners?

Ask every vendor, because some systems require specific hardware. Noolbook does not: Noolbook Desktop works with the pages your existing scanning stations produce.

Can examiners evaluate from home?

Many systems allow it; the real question is how identity is verified during marking. Noolbook uses an AI Proctoring add-on with liveness checks and a server-side lock when a violation is detected.

Book a demo

Bring your nextexam cycle onto Noolbook.

Tell us about your institution and the examinations you run. We will walk your examination team through a live evaluation, end to end.

We reply within one working day.