By the end of this chapter you will be able to:
...
- Add a new merge stream to your model, by dragging in the icon onto your model pane.
- Call this stream Name
Channel List Reconciliation 2
- Add an input pipe from
Latest Package All Channels
, with Namesales
- Drag the following attributes from
Latest Package All Channels
toChannel List Reconciliation 2
:CustomerRef
Channel
- Add an pipe from the database collector
SOURCE_ALL_CHANNELS_LIST
toChannel List Reconciliation 2
Call this pipe
inv
- Set up the grouping attributes on the input pipes:
- Double click on the pipe
sales
- Go to the Sort/Group section
- Press and drag in
CustomerRef
andChannel
- Press to save your changes
- Double-click on the pipe
inv
- Go to the Sort/Group section
- Press
- In the new grouping attribute form that pops up:
- Select the attribute
CustomerRef
from the drop down list - Tick the Group flag
- Press
- Select the attribute
- Add the grouping attribute
Channel
in the same way - Back in the main pipe configuration form, press
- Double click on the pipe
...
This is because a merge will generate an output record for every key value it finds across all input pipes, whereas if you do a data enrichment using a lookup pipe – you will only get an output record for every record from the input pipe
Filter unmatched rows
To help you find unmatched rows in your output data, you will now add a filter
- Open the data set you have just generated in
Channel List Reconciliation 2
- Create a filter:
- Where ANY of the following are true
SalesCheck
equalsNO
InvCheck
equalsNO
- Where ANY of the following are true
- Press - Apply the filter without saving
- You will get a list of all non-matched records, that is, all records where the
SalesCheck
value isNO
or theInvCheck
value isNO