AI in Moliri

AI jobs and nightly runs

Some AI functions do not answer straight away in the browser but run as a job on the server. All these jobs stand in one queue, together with transcriptions and text recognition, and take their turn. A job carries on when you close the tab; only the waiting in the browser ends then.

Which jobs there are

JobStarted byWhen it runs
TranscriptionTranscribe on the Transcript tab, a rule, a backfillAt once or in the night window
Text recognition (OCR)Recognise text on the server or by the AI service, a rule, a backfillAt once or in the night window
Similar values (AI)AI run … under Similar values At once, or every night
Dimensions from free text (AI)Order … under Dimensions from free text At once, or every night
Search by meaning (reading)Preparation below the search field, see Search by meaning At once, or every night
Suggest fields with AIThe button in the OCR import At once

The names in the first column appear like this in the worker dialog (see below). If another job is ahead of a question from the OCR import, such as a long transcription, the question waits, and Moliri shows how many jobs are ahead of it.

A run across a project

Similar values, Dimensions from free text and the reading for the search by meaning work through a whole project. They follow the same pattern. Above the list, a bar shows the last run and its result or the current one with its progress. The order opens from there:

In the orderMeaning
ScopeWhat is read (fields, objects, texts), how much of it is still open and roughly how long it takes
CapThe run stops there. The next run carries on from that point
Probe runA small run that shows what comes out and measures the time: 20 pairs for Similar values, eight objects for Dimensions from free text, 200 texts for the search by meaning
Start runQueues the run at once
Every nightLets the run come back every night, see Nightly runs

No run asks the same thing twice. A pair of similar values already checked is not asked again, a dimensions text already read is not read again, and only new and changed texts are read in. A second run therefore costs only what has been added since the first.

A run does not write what it finds into the fields. Values with the same meaning appear as groups with the badge AI suggestion under Similar values, dimensions read appear as suggestions under AI suggestions . Only a click turns them into a value.

Nightly runs

With the every night switch in the order, the run comes back every night for this project and takes on what is new: new values, new and changed dimension texts, new and changed texts for the search. The run reads with the rights of the person who switched it on.

The nightly runs start as soon as the server’s night window opens, by default from 19:00 to 06:00 and all weekend. A new run starts every evening, at the weekend too. When the window closes, the run stops and carries on from there the next night. If a run is not finished when the next one is due, it runs to the end first; two runs of the same kind never run side by side in a project.

The Nightly runs row in the AI overview shows in how many projects nightly runs are switched on and when the last one finished.

Where to see the progress

WhereWhat it shows
The function’s barUnder Similar values, Dimensions from free text and Preparation: the last or current run, with progress
The box in the OCR importWhether the texts are going to the server, how many jobs are waiting ahead, what the model is doing and how long it will take
The worker dialogAll jobs of the instance, for administrators (status 9), see below

The worker dialog opens in the file library (Libraries → Files) with the button Upload workers and queue. It lists every job with its type, its progress and, after the run, its result: how many pairs were checked and how many of them are the same, how many texts were read in, how many suggestions came out and how many the check refused, or that it stopped at the limit. Failed jobs can be queued again there. More on the dialog under Jobs in the worker dialog .

Stop waiting

WhereHowWhat happens to the job
OCR importStop waitingIt runs to the end on the server, but its answer no longer arrives. You carry on by hand
Transcription in the night windowStart now on the Transcript tabIt no longer waits for the night

If the transcription service is restarted, Moliri queues transcriptions and text recognition again by itself, without counting it as a failed attempt; see Jobs in the worker dialog .

Further reading