Accuracy

We publish how many violations our check misses, per rule group, from the latest measurement we promoted. These numbers update automatically with every release.

No measurement published yet. The new reader has not passed its first measurement, and checking stays off until the first rule group passes the release gate. The numbers will appear here the day it does.

What the numbers mean

  • Miss rate: of all known violations in the measuring drawings, the share the check did not mark 'Not met'. It includes those shown as 'Could not be judged': they hide nothing, but they do not catch the violation either.
  • False-pass rate: the share of known violations shown as 'No violation found' or 'Does not apply'. This is the most dangerous mistake, and the number we watch most.
  • Coverage: of the requirements that can be judged on these drawings, the share the check gave a verdict on (not met, no violation found, or does not apply) instead of 'Could not be judged'.

How we measure

  • Generated drawings with known answers: we draw buildings by program, so every width, distance and verdict is known in advance.
  • Planted violations: we change one element of a drawing so it breaks one rule, and check that the check catches it.
  • Consistency tests: we rotate, move, rescale or rename the layers of a drawing without changing its meaning, and check the verdict stays the same.
  • Only drawings kept aside for measuring count; the reader never learned from them. A new release is not promoted if the miss rate or the false-pass rate of any group rises.

Who reads the drawing

Our own reader reads the drawing: lengths and widths are measured from the drawing's lines and the dimensions written on it. The AI reads text and says what things are, but never counts, measures or decides. Verdicts come from fixed rules.

What these numbers cannot catch

  • A misreading every one of our models shares: if the reader and the test read a drawing the same wrong way, the measurement cannot see it.
  • Generated drawings are cleaner than real ones, so the miss rate on real submissions may be higher.
  • Codes and rule groups we do not check yet are not in these numbers.

Emtithal is a pre-check before you submit to Balady or Salamah. It never says a drawing is compliant; official approval stays with the authority.