Transform Stage Types

The transform stages section allows you to add multiple aggregation steps together to create your transformation pipeline. For those users familiar with mongoDB aggregation pipelines you can simply add a JSON stage with your pipeline, and you are done. For those who are unfamiliar with the mongoDB syntax, we have created some basic for user friendly stages to help you build your pipeline.

Transform Stage Management:

Create a stage, simply press the “+” button.

Delete a stage: Press the red trash can button.

Edit a stage: Press the pencil button.

Turn a stage off in the designer: press the blue toggle button. *Note: even if this is turned off, if you save the document the aggregation will be saved as if the stage is on.

To refresh the aggregation: press the refresh button on the “Transform Stages” block.

To identify a problem with the aggregation: If there is an error with the aggregation pipeline, the “save” button on the bottom right will turn from green to red. Details on the error can be found in the Elmah logs (details on this in another section)

You can re-order stages simply by dragging and dropping them

Navigate to the different stages to understand what they all do: Filter - applies filters to the incoming document to only allow matching criteria through

Lookup - enrich your data by looking up data from other collections

Add Fields - add new fields with various conditions and functions

Projection - create your output format for your document

Unwind - break up a batched set of data from one document to many documents

JS / JSON - add customer mongoDB aggregation pipeline stages and code