Certified figures and nightly checks

What the Certified badge means, how a figure earns it, why it can disappear overnight and when it comes back, with the story of one figure at Brightwater Foods.

You will see a Certified badge next to figures in Ask, on dashboards, on record pages and in the Models area of Studio. This page explains what it stands for, why it can disappear, and what you can do when it does.

Who can do this

Everyone who reads figures sees the badge. Only the owner of a model (and an admin) can certify a figure, in Studio. The people who are told when a badge goes away are the model's owners.

What the badge means

A certified figure is a figure whose number has been compared with the source and confirmed by the owner of the model. It is Cortex's way of saying: this number has been checked, and someone responsible stands behind it.

The opposite label is Not certified, for example in the list of figures of a model. That does not mean the number is wrong. It means nobody has certified it yet, so treat it as indicative. On a dashboard a tile with a figure that is not certified yet carries a small grey shield beside its title (hold the pointer over it, or tab to it, to read why), and the top of the dashboard says it once, for example "Not certified yet: 2 of 9 tiles on this dashboard". The count covers every tile of the dashboard that shows a figure; a figure from a file someone added by hand keeps its own "Ad hoc · not certified" label and is not counted. In Ask a certified answer is marked Certified figure, and you also see whether the answer comes from a verified model or from a model whose answers have not been checked yet.

The life of a badge

Not certified

A new figure. Usable, but nobody has checked it yet.

Reference check

Cortex compares the model with an independent total from the source.

Certified

The owner confirms. The badge goes live with the next publish.

Nightly check

Every night the figure is compared with the source again.

A figure earns its badge once and then has to keep earning it every night.

How a figure earns the badge

An owner of the model certifies a figure in Studio:

  1. Cortex runs a reference check: it compares the model's answer with an independent total from the source, derived from the figure's own definition.
  2. The owner looks at the comparison and confirms.
  3. The figure is marked as certified, with the owner's name and the date. The badge goes live with the next publish of the model.

If the numbers do not match, the owner can still certify, but must give a reason, which is recorded in the audit log. If a figure cannot be checked yet because the table has no rows, nothing is proven and it cannot be certified yet. The steps are in Figures and certification.

If somebody changes the formula of a certified figure and saves, the certification is removed on the spot. The owner has to certify the changed figure again. A figure that is certified is only as good as its current definition.

The nightly checks

Certifying once is not enough: data changes, sources get corrected, a connection breaks. So every night Cortex checks every published model again.

For a certified figure, the nightly check compares what the model returns with the reference from the source, over closed periods. In Studio you can see that a figure is checked against the source every night, and in Ask the stamp on an answer opens the proof that the figure agrees with its source, with the date of the last check.

Cortex also checks the model more broadly:

  • whether data is still coming in,
  • whether tables are sound (for example no duplicate keys),
  • whether record counts agree with the source,
  • whether rules on your data hold, if a builder wrote them,
  • whether a figure looks plausible against its own recent history.

Each check has a consequence if it fails: Only show it (the result appears on the Checks tab and nothing else changes), Tell the owners (the owners are notified too) or Take the badges off (the figures the check proves lose their badge). In technical talk these are called info, warn and block. The checks and their lines are described in Model checks.

When the badge goes away

A certified figure loses its badge when its newest nightly check shows that it no longer matches its reference, or when a blocking check on its table fails. The badge disappears everywhere at once: in Ask, on dashboards and in other places that show certification. The owners of the model get one message that morning, and the figure then shows as Not certified.

Cortex does this on purpose. A badge that stays on a number that has stopped matching would be worse than no badge at all.

When the badge comes back

The badge comes back by itself after a night on which the figure matches again. Nobody has to certify it again, as long as the definition did not change. An owner who has fixed the cause can also use Run now on the Checks tab: a passing run on the published model gives the badge back at once.

Some nights give no verdict: the check was skipped, ran out of time, or could not read the source. Those nights do not take the badge off and do not give it back. The last night that gave a clear verdict stands. A plausibility check (a figure that looks unusual compared with previous months) is a warning to the owners and never removes a badge.

What happensWhat it does to the badge
Someone changes and saves the formula of a certified figureThe badge is removed on the spot. An owner certifies again.
The nightly check finds that the figure no longer matchesThe badge comes off, everywhere. The owners are told.
A later night matches againThe badge comes back by itself.
A night is skipped, times out or cannot read the sourceNothing changes: the last clear verdict stands.
A plausibility check flags an unusual monthA warning for the owners. The badge stays.
A blocking check on the figure's table failsThe badge comes off the figures on that table.

Example: the life of Revenue at Brightwater Foods

  1. Certify. Daan, the owner of the Sales model, runs the reference check on Revenue. The model and the independent total from the ERP agree. He certifies the figure and publishes. Sam de Vries sees Certified figure under the answer to "What was the revenue this year?".
  2. A bad night. Overnight an invoice in the ERP is corrected after month-end, and the data Cortex works with does not have the correction yet. The next nightly check compares Revenue with the source and finds a difference. The badge comes off in Ask and on the finance dashboard, and Daan gets one message that morning: Revenue stopped matching the source. Sam's answer still shows the figure, now without the badge.
  3. The fix. IT brings the data up to date. Daan has nothing to certify: the definition did not change.
  4. Back to normal. The next night matches, and the figure carries its badge again, everywhere. If Daan had used Run now on the Checks tab after the fix, it would have been back at once.

Had the cause been a change to the formula instead, Cortex would have removed the certification when Daan saved the change. That case does need a new certification: Daan runs the reference check again and certifies.

What you can do as a reader

  • If a figure shows Not certified, you can still use it, but check it before you rely on it, for example before it goes into a board report.
  • If a badge disappeared, the owners already know. You can also tell them using the feedback options in the Hub.
  • As a reader you see the badge or its absence. The detail of a failed night, such as the difference between the model and the source, is shown to the model's owners.
  • Builders: prefer certified figures. A workflow step that reads a figure to act on it works with certified figures.

What the badge does not mean

Certified means the number matches the reference from the source and an owner confirmed it. It does not guarantee that the source system itself is correct, and it is not an external certification or audit.

On this page