Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Scenario

Where we have two sources of data that share the same structure we can combine these into a single table without the need to perform a merge. The intention is that we will keep all records so for every record we pass in we will get one out.

For example, if we are performing a data migration where we are consolidating data from 3 separate systems that all follow the same data structure we can use this technique. 

Solution

  • It is assumed that all data sources are imported into their own tables in an analysis model.
  • We will refer to all tables that are due to be combined as input tables and the table where the data is being combined as the output table. 
  1. From the Create section of the analysis toolbar, click 
    Insert excerpt
    _datasource_show_tables
    _datasource_show_tables
    nopaneltrue
    1. drag the 

Image Removed Merge Table  onto
    1. Insert excerpt
      _table_calculate
      _table_calculate
      nopaneltrue
      onto your model.

    2. In the settings, set the Name

for example Businesses MergedThe attributes can be created manually using the plus button in the Attributes section. Here we will use the attributes from the Businesses 1 table to automatically setup our merge attributes
    1. .

  1. For each of the input tables, from its hover over toolbar, select 

    Insert excerpt
    _pipe
    _pipe
    nopaneltrue
    , then click the end of the arrow onto the output table.

  2. Hover over the

Businesses 1
  1. first input table and from the hover over toolbar click 

    Insert excerpt
    _attributes_show_hide
    _attributes_show_hide
    nopaneltrue
    .

    1. Tick all of the attributes and

then
    1. drag them

into the attributes section of the Merge Table
    1. onto the output table

      1. If PhixFlow asks for confirmation. Select Use original attribute name. Then click the arrow Image Modified to confirm
.
Image Removed
  • Click Image Removed OK to save and close the settings for the merge table.

  • Connect the Inputs

  • In the analysis model, hover over the Businesses 1 table.

  • From the hover over toolbar, select Image Removed Connector, then click the end of the arrow onto the merge table. This connector will pipe data into the merge

      1. This automatically creates the attributes for us in the output table.
    1. We now need to set the attributes up to pull information from all input tables.
      1. Click on the output table, in its Attributes section double click the first attribute
      2. Remove the pipe prefix, typically this will be "in.". By doing this we are telling PhixFlow to look for this attribute name regardless of which pipe it is coming from.
        1. For Example, in.CompanyName would become CompanyName.
      3. Repeat this for all of your attributes, the configuration is illustrated below:
      4. Image Added
      5. Image Added 
    2. Click Image Added OK to save and close the settings for the output table.