Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Scenario

Sometimes the data that you are trying to match is not exactly the same, but you still want to be able to align and merge data, or create a report on likely matches.

Create 2 streams two tables for data. The goal is to match up those records from stream table 1 where at least 3 of 5 fields match stream table 2.

Solution:

  • Create a stream table for each input.
  • Create a ( calculate ) stream table for the join.
  • Make the pipe from one of the streams table a pull pipe and the pipe from the other is a lookup pipe.
  • In the join streamtable, for each record on the pull pipe, cycle thru all the records from the lookup pipe and flag those records where there is a match.