Scenario
Data reconciliation typically involves merging data from 2 (or more) sources, and determining which pieces are missing, duplicated or mismatched.
We want to compare two files (or portions of files) to see if they are identical, or if they contain data for the same keys.
Solution:
- Create a Stream for each of the inputs.
- Create an Aggregate / Merge Stream with pipes from all of the original streams.
- Key the data in each pipe to the field(s) that should match.
- Create a status field in the Aggregate Stream to report the status of the merge for this record.