Process Que Dashboard

Utopia is essentially an extract, transform and load document tool, which can produces a large amount of processes depending on your setup. The system needs a way of managing a prioritizing these processes. For this, Utopia uses an open-source background job scheduler called Hangfire. you can get to the hangfire browser dashboard by navigating to:

microservice.yourdomain.com/hangfire

Hangfire Dashboard

Here you can see what processes are running, enqueued, when Jobs run and how many workers are available for us. These workers are directly related to the number of replicas you are running and how your kube config is setup.

This area is really great for understanding your system workloads and adjusting your configurations. A short definition of the ques:

default - not used

025_batches - any jobs greater than 5000 documents.

040_other - misc jobs - Logging, Maintenance and other system related jobs

024_batches - any jobs greater than 5000 documents.

010_publisherconnectors_work - data out processes

010_publisherconnectors - data out processes

006_sourceconnectors_work - data in and transform processes

001_events - webhook and API Listener processes

005_sourceconnectors - data in and transform processes

000_critical - any jobs less than 5000 documents.

045_other - misc jobs - Logging, Maintenance and other system related jobs

035_transactions2 - generation of transaction documentation for UI

020_default - not used