Process Que Dashboard
Last updated
Last updated
Utopia is essentially an extract, transform and load document tool, which can produces a large amount of processes depending on your setup. The system needs a way of managing a prioritizing these processes. For this, Utopia uses an open-source background job scheduler called Hangfire. you can get to the hangfire browser dashboard by navigating to:
Here you can see what processes are running, enqueued, when Jobs run and how many workers are available for us. These workers are directly related to the number of replicas you are running and how your kube config is setup.
This area is really great for understanding your system workloads and adjusting your configurations. A short definition of the ques:
default - not used
025_batches - any jobs greater than 5000 documents.
040_other - misc jobs - Logging, Maintenance and other system related jobs
024_batches - any jobs greater than 5000 documents.
010_publisherconnectors_work - data out processes
010_publisherconnectors - data out processes
006_sourceconnectors_work - data in and transform processes
001_events - webhook and API Listener processes
005_sourceconnectors - data in and transform processes
000_critical - any jobs less than 5000 documents.
045_other - misc jobs - Logging, Maintenance and other system related jobs
035_transactions2 - generation of transaction documentation for UI
020_default - not used
