Collection Parameters

A variety of different Parameters can help you setup the movement and management of data in the correct way.

Title

Giving a name to your collection (a collection is a name for an area where various documents get saved. Generally, they will contain documents with the same format, however using different format documents is allowed)

Active

Yes/No toggle – This will mark the collection on or off from the system. If off Utopia will not save any documents in the collection

Allow Replacing Documents

Yes/No toggle – If Yes, Utopia will check what field is Marked in the Identifier Field, if the incoming document has an Identifier field that matches the same field in a document already in the collection, if will overwrite this document. If No, Utopia will recognise that a document with a matching Identifier field exists and will not process the incoming document but will validate it as “Invalid”.

Ignore Duplicates

Yes/No toggle – Utopia saves a hash of each document (basically a short encryption of each document) which allows it to recognise documents that are exactly the same. If Yes, Utopia will compare the hash of the incoming document with the hashes of all documents already in the collection, if one exists it will not save it in the collection. If No, Utopia will save the document regardless of its content.

Generate Transactions

A transaction is a file which gets generated which feeds the records that can be seen on the Transactions tab. A log gets generated during each process, along with the document which gets saved in the collection and validation results. Utopia will take the main aspects of these and turn them into a transaction record which will display information on the transaction tab. If No, Utopia will bypass the creation of this record, if yes it will get generated. Note: Depending on your settings this may include a snap-shot of the exact document during processing. If you have this setting selected, it may cause larger than necessary processing requirements which is an example where you would switch this off.

Maintenance

Yes/No toggle – in certain Utopia instances there are maintenance tasks that run. These will clean out documents which are older than the specified time. If Yes, Maintenance will be performed on the collection, if no they will not. Note: If you have “static” data in the collection, used for lookups and data enriching it would be advised to switch Maintenance off to avoid loss of data.

Batch Field

field name – you can identify a field name which will be used to batch a single incoming document into multiple documents before saving in the collection. Note: If you have sample data loaded, a list of field names will be pre-populated

Identifier Field

field name – The identifier field can be set in this field. This will be used in conjunction with the “Allow Replacing Documents” validation as well as be shown on the transaction tab on the record entry. One can assign multiple Identifier fields here by simply pressing the add or delete buttons to choose the amount of unique identifiers your document needs. Note: Usually you would choose the identifier fields so that together they provide a unique ID for the document.

Sample Document