AI in Moliri
AI jobs and nightly runs
Some AI functions do not answer straight away in the browser but run as a job on the server. All these jobs stand in one queue, together with transcriptions and text recognition, and take their turn. A job carries on when you close the tab; only the waiting in the browser ends then.
Which jobs there are
| Job | Started by | When it runs |
|---|---|---|
| Transcription | Transcribe on the Transcript tab, a rule, a backfill | At once or in the night window |
| Text recognition (OCR) | Recognise text on the server or by the AI service, a rule, a backfill | At once or in the night window |
| Similar values (AI) | AI run … under Similar values | At once, or every night |
| Dimensions from free text (AI) | Order … under Dimensions from free text | At once, or every night |
| Search by meaning (reading) | Preparation below the search field, see Search by meaning | At once, or every night |
| Suggest fields with AI | The button in the OCR import | At once |
The names in the first column appear like this in the worker dialog (see below). If another job is ahead of a question from the OCR import, such as a long transcription, the question waits, and Moliri shows how many jobs are ahead of it.
A run across a project
Similar values, Dimensions from free text and the reading for the search by meaning work through a whole project. They follow the same pattern. Above the list, a bar shows the last run and its result or the current one with its progress. The order opens from there:
| In the order | Meaning |
|---|---|
| Scope | What is read (fields, objects, texts), how much of it is still open and roughly how long it takes |
| Cap | The run stops there. The next run carries on from that point |
| Probe run | A small run that shows what comes out and measures the time: 20 pairs for Similar values, eight objects for Dimensions from free text, 200 texts for the search by meaning |
| Start run | Queues the run at once |
| Every night | Lets the run come back every night, see Nightly runs |
No run asks the same thing twice. A pair of similar values already checked is not asked again, a dimensions text already read is not read again, and only new and changed texts are read in. A second run therefore costs only what has been added since the first.
A run does not write what it finds into the fields. Values with the same meaning appear as groups with the badge AI suggestion under Similar values, dimensions read appear as suggestions under AI suggestions . Only a click turns them into a value.
Nightly runs
With the every night switch in the order, the run comes back every night for this project and takes on what is new: new values, new and changed dimension texts, new and changed texts for the search. The run reads with the rights of the person who switched it on.
The nightly runs start as soon as the server’s night window opens, by default from 19:00 to 06:00 and all weekend. A new run starts every evening, at the weekend too. When the window closes, the run stops and carries on from there the next night. If a run is not finished when the next one is due, it runs to the end first; two runs of the same kind never run side by side in a project.
The Nightly runs row in the AI overview shows in how many projects nightly runs are switched on and when the last one finished.
Where to see the progress
| Where | What it shows |
|---|---|
| The function’s bar | Under Similar values, Dimensions from free text and Preparation: the last or current run, with progress |
| The box in the OCR import | Whether the texts are going to the server, how many jobs are waiting ahead, what the model is doing and how long it will take |
| The worker dialog | All jobs of the instance, for administrators (status 9), see below |
The worker dialog opens in the file library (Libraries → Files) with the button Upload workers and queue. It lists every job with its type, its progress and, after the run, its result: how many pairs were checked and how many of them are the same, how many texts were read in, how many suggestions came out and how many the check refused, or that it stopped at the limit. Failed jobs can be queued again there. More on the dialog under Jobs in the worker dialog .
Stop waiting
| Where | How | What happens to the job |
|---|---|---|
| OCR import | Stop waiting | It runs to the end on the server, but its answer no longer arrives. You carry on by hand |
| Transcription in the night window | Start now on the Transcript tab | It no longer waits for the night |
If the transcription service is restarted, Moliri queues transcriptions and text recognition again by itself, without counting it as a failed attempt; see Jobs in the worker dialog .
Further reading
- Rules and night window : transcription and text recognition by keyword, night window and backfill
- Check : similar values, dimensions from free text and AI suggestions in detail
- Where the AI runs : which jobs go to the AI account