Versions Compared
compared with
Key
- This line was added.
- This line was removed.
- Formatting was changed.
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
Scenario
Sometimes the data that you are trying to match is not exactly the same, but you still want to be able to align and merge data, or create a report on likely matches.
Create 2 streams two tables for data. The goal is to match up those records from stream table 1 where at least 3 of 5 fields match stream table 2.
Solution:
- Create a stream table for each input.
- Create a ( calculate ) stream table for the join.
- Make the pipe from one of the streams table a pull pipe and the pipe from the other is a lookup pipe.
- In the join streamtable, for each record on the pull pipe, cycle thru all the records from the lookup pipe and flag those records where there is a match.