PhixFlow Help

10 Merging data sets with enrichment

By the end of this chapter you will be able to:

  • Use a merge Stream with data enrichment via a lookup pipe

In this exercise you will merge some address information – and in the same stream you will further enrich the data by looking up the postcode for each record.

Merge address and customer category data

Merge addresses and customer categories stored in the database:

  • Create a new model called Build full customer details
  • Drag on the datasource CRM
  • Create a database collector and stream to read data into PhixFlow from following tables in the CRM datasource:
    • SOURCE_ADDRESS_LIST
    • SOURCE_CC_LIST
  • Merge these two streams:
    • Call the merge stream Full Addresses
    • Merge on the attribute NAME from both input streams
    • Drag other attributes from the input streams into the merge stream so that you have a full set of data for each customer
  • In the merge stream, for the attribute NAME set the expression to: _key[1]
  • Run analysis on Full Addresses and view the results

Enrich addresses with postcodes

You will now further enrich the address data with post codes:

  • Again using the datasource CRM, create a collector and stream to load into PhixFlow data from the table SOURCE_POSTCODE_LIST
  • Create a lookup pipe from the new stream SOURCE_POSTCODE_LIST to Full Addresses
  • Call this lookup pipe: pc
  • In the Order/Index attributes for the pipe create matches:

    Left-hand (post code reference data - SOURCE_POSTCODE_LIST)

    Right-hand (output - Full Addresses)

    HOUSENAMEORNUMBER

    HOUSENAMEORNUMBER

    STREETNAME

    STREETNAME

    TOWN

    TOWN

    COUNTY

    COUNTY

  • Drag the attribute POSTCODE from SOURCE_POSTCODE_LIST to Full Addresses
  • Run analysis on Full Addresses and view the results

Please let us know if we could improve this page feedback@phixflow.com