Versions Compared

Old Version 1

changes.mady.by.user Anthony George

Saved on

compared with

New Version Current

changes.mady.by.user Zoe Baldwin

Saved on

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Scenario

Where we have two sources of data that share the same structure, i.e. the same attribute names, we can combine these into a single table without the need to perform a merge. The intention is that we will keep all records, so for every record

we pass in we will get one out.For example, if we are

passed in, a record is passed out.

This technique is useful when performing a data migration

where we are consolidating

that consolidates data from 3 separate systems that all follow the same data structure

we can use this technique

. 

Solution

It is assumed that all data sources are imported into their own tables in an

analysis model.From the Create section of the analysis toolbar, click 

Insert excerpt
_analysisModel
_analysisModel
nopaneltrue
. We will refer to all tables that are due to be combined as input tables and the table where the data is being combined as the output table. 

  1. From the
    Insert excerpt
    _tables
    _tables
    nopaneltrue
     drop down on the analysis toolbar, click and drag a 
    Insert excerpt
    _
datasource
  1. table_
show
  1. calculate_
tables
  1. table
    _
datasource
  1. table_
show
  1. calculate_
tables
  1. table
    nopaneltrue
drag the Image Removed Merge Table  onto
  1.  table on your model
.
    1. In the
settings
    1. Properties, set the Name
for example Businesses Merged

The attributes can be created manually using the plus button in the Attributes section. Here we will use the attributes from the Businesses 1 table to automatically setup our merge attributes.

Hover over the Businesses 1 table and from the hover over
    1. , e.g. Output Table

  2. For each of the input tables, from its hover over toolbar, select 

    Insert excerpt
    _pipe
    _pipe
    nopaneltrue
    , then click the end of the arrow onto the output table

  3. Hover over the first input table and from the popup toolbar click 

    Insert excerpt
    _attributes_

show_hide

  1. icon
    _attributes_

show_hideTick

  1. icon
    nopaneltrue

.
  1. In the Attributes window, tick all of the attributes and
then
  1. drag them
into the attributes section of the Merge Table. If PhixFlow asks for confirmation.
  1. onto the output table
    1. Select Use original attribute name
. Then click the arrow Image Removed to confirm.
Image Removed

  • Click Image Removed OK to save and close the settings for the merge table.

    • Connect the Inputs

  • In the analysis model, hover over the Businesses 1 table.

    • From the hover over toolbar, select Image Removed Connector, then click the end of the arrow onto the merge table. This connector will pipe data into the merge table.
      2. Click Confirm
        1. This automatically creates the attributes for us in the output table
      3. Close the Attributes window
    2. We now need to set up the attributes to pull information from all input tables
      1. Click on the output table and
        Insert excerpt
        _pin
        _pin
        nopaneltrue
         the tab to keep it open
      2. In the Attributes section, double click the first attribute
      3. Remove the pipe prefix, typically this will be "in."
        1. For example, in.CompanyName becomes CompanyName.
        2. By doing this we are telling PhixFlow to look for this attribute name regardless of which pipe it is coming from
      4. Repeat this for all of your attributes, the configuration is illustrated below:
      5. f
        Image AddedImage Added
    3. Click 
      Insert excerpt
      _finish
      _finish
      nopaneltrue
       to save and close the settings for the output table