khanh.pndc/nextcloud-docs
1
0
Fork 0
mirror of https://github.com/nextcloud/documentation.git synced 2026-01-02 17:59:36 +07:00
Code Issues Packages Projects Releases Wiki Activity

docs(admin/ai): How to improve task throughput

Browse Source 
Signed-off-by: Marcel Klehr <mklehr@gmx.net>
This commit is contained in:
Marcel Klehr
2024-07-26 11:11:48 +02:00
parent 5ee2436e4f
commit 6b5b1468d6
1 changed files with 14 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

14
admin_manual/ai/app_assistant.rst
View File

@@ -160,3 +160,17 @@ This field is appended to the block of chat messages, i.e. attached after the me
The number of latest messages to consider for generating the next message. This does not include the user instructions, which is always considered in addition to this. This value should be adjusted in case you are hitting the token limit in your conversations too often.
The AI text generation provider should ideally handle the max token limit case.
Improve AI processing throughput
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Most AI tasks will be run as part of the background job system in Nextcloud which only runs jobs every 5 minutes by default.
To pick up scheduled jobs faster you can set up background job workers that process AI tasks as soon as they are scheduled:
run the following occ commands a daemon (you can also spawn multiple, for parallel processing):
.. code-block::
occ background-job:worker 'OC\TaskProcessing\SynchronousBackgroundJob'
Make sure to restart these daemons regularly. For example once a day.