By the end of this chapter you will be able to:
- Create Merge Streamsmerge streams
- Configure Groupings groupings on Pipespipes
In this exercise, you will merge the two sets of data you just loaded into PhixFlow: the data from the file, and the data from the database.
- In the model , select the Stream CustomerAddressesThen select the Stream view, drag Add New Stream (Merge) onto your model pane
- Give this the Name:
Customer All Details
- Close the stream details form for
Customer All Details
- In the model, from the hover menu of
CustomerAddresses
select Add a new Connector, then click the end of the arrow onto the streamCustomer All Details
- Similarly, add a connector from the stream
SOURCE_CUSTOMER_PHONE_NUMBERS
– keep your ctrl key pressed down, and select the Stream with your left mouse button - Right-click anywhere on the background pane of the model (but not on either of the Streams you have just selected)
- Select Merge Selected Streams
- When the Stream Details form pops up, enter the Name: Customer All Details
- A form will appear – in this form, you can select the key fields that you will use to join the data across the two sources:
- In the box with title in press Drag the attribute CustomerRef into the box to
- Double click on the connector from
CustomerAddresses
toCustomer All Details
, this will be calledin
In the Sort/Group section, press Show Stream Attributes
- From the list that appears, drag
CustomerRef
into the list - Close the list of attributes
- In the box with title in_2 press Drag the attribute
- Double click on the connector from
CustomerAddresses
to
, this will be calledSOURCE_CUSTOMER_PHONE_NUMBERS
in_2
In the Sort/Group section, press Show Stream Attributes
- From the list that appears, drag
CUSTOMER_REF
into the boxlist - Close the list of attributes
- Now add attributes
- Press
- An Automatic Stream Configuration form will appear – accept the default in the drop-down list (All Attributes) and press
Customer All Details
A new merge Stream will appear on your model - Customer All Details.
...
- to the merge stream:
- From the hover menu of
CustomerAddresses
, press Show Stream Attributes - Drag all attributes from this list over the top of
Customer All Details
and "drop" (i.e. release your mouse button)- Note that you can select all attributes by selecting the top attribute, pressing Shift and then selecting the bottom attribute
- When the dialogue appears, select Use original attribute name
- Similarly, drag all attributes from
toSOURCE_CUSTOMER_PHONE_NUMBERS
Customer All Details
- To see the resulting configuration in
Customer All Details
, double-click on this stream- In the attributes section, you will see the added attributes
- From the hover menu of
Run Analysis on Stream
Run Analysis analysis on your new Streamstream:
- Hover over the stream
Customer All Details
, and press - Run AnalysisSee the run complete in the Console
...
View Stream data
To view the data you just loaded:
- Hover over the Stream stream and in the tool bar hover menu press - Show the list of Stream Views
- In the drop down list, select Default View
You will see the address data you loaded from the file combined with the phone numbers you loaded from the database.