PhixFlow Help
Merging data sets with enrichment
By the end of this chapter you will be able to:
- Use a Merge Stream with data enrichment via a lookup pipe
In this exercise you will merge some address information – and in the same Stream you will further enrich the data by looking up the postcode for each record.
Merge address and customer category data
Merge addresses and customer categories stored in the database:
- Create a new model called Build full customer details
- Drag on the datasource CRM
- Create a database collector and stream to read data into PhixFlow from following tables in the CRM datasource:
- SOURCE_ADDRESS_LIST
- SOURCE_CC_LIST
- Merge these two streams:
- Select both streams
- Right-click on the model pane background and select Merge Selected Streams
- Call the new stream Full Addresses
- In the merge attributes form that pops up drag NAME into both boxes – we will merge the data from the two sources on the NAME field
- Press
- In the Automatic Stream Configuration form accept the default (All Attributes) and press
- Double-click the merge stream that is created – you will see the key field (NAME) has the expression _key[1]
- Run analysis on Full Addresses and view the results
Enrich addresses with postcodes
You will now further enrich the address data with post codes:
- Again using the Datasource CRM, create a collector and stream to load into PhixFlow data from the table SOURCE_POSTCODE_LIST
- Create a lookup pipe from the new stream SOURCE_POSTCODE_LIST to Full Addresses
- Call this lookup pipe: pc
In the matching attributes form for the pipe create matches:
Left-hand (post code reference data - SOURCE_POSTCODE_LIST)
Right-hand (output - Full Addresses)
HOUSENAMEORNUMBER
in1_HOUSENAMEORNUMBER
STREETNAME
in1_STREETNAME
TOWN
in1_TOWN
COUNTY
in1_COUNTY
- Drag the attribute POSTCODE from SOURCE_POSTCODE_LIST to Full Addresses
- Run analysis on Full Addresses and view the results
Please let us know if we could improve this page feedback@phixflow.com