Introduction

Welcome to Analysis Modelling Fundamentals. In this chapter we will learn about designing and creating analysis models including cleansing and enriching data.

Concepts

To find out more about the Analysis Modelling options and design principles before you take the course below, or simply to refresh your memory, see Analysis Models for Batch Processing Data.

Video Demonstration 

Watch the video demonstration, then complete the task list below.

Part 1 - Analysis Fundamentals

Fundamentals Tasks

Complete the tasks below, before moving to the next chapter. 

Task 1: Download Learning Centre Files

1. Access the Learning Centre using the Help link in the top right corner of PhixFlow or via Learning Centre  
   1. 
2. Scroll to the bottom of the webpage and in the Sample Datasets section, download the files:
   • Companies
   • Companies Additional

Task 2: Create the Analysis Model

1. Select 

   Insert excerpt
   _analysis _analysis nopanel true

    from the PhixFlow home page
2. Click 

   Insert excerpt
   _add _add nopanel true

3. On the Create Analysis Model window that appears, enter the name, CRM Data Import, and select Create

Task 3: Add a File Collector

1. Add a new File Collector by hovering over

   Insert excerpt
   _files _files nopanel true

    in the toolbar and clicking and dragging the

   Insert excerpt
   _file_collector _file_collector nopanel true

    icon onto the canvas
   1. In the

      Insert excerpt
      _property_settings _property_settings nopanel true

       on the right, enter the name, Additional Companies, and 

      Insert excerpt
      _save _save nopanel true

2. Hover over the Additional Companies File Collector on the canvas and in the pop-up menu, click the 

   Insert excerpt
   _upload_file_icon _upload_file_icon nopanel true

    icon
3. In the Upload File window:
   1. choose Select
   2. find the Additional Companies file on your PC/laptop
   3. click Open
   4. click Upload File
4. An Additional Companies table will be automatically created and added to the canvas
   1. this table does not yet hold the data you have uploaded, only the attributes (column headers). This allows any changes to be made to the attributes first which affects how the data is imported

Task 4: Setup the Additional Companies table

1. Click on the Additional Companies table and

   Insert excerpt
   _pin _pin nopanel true

    the tab 
2. In the table's

   Insert excerpt
   _property_settings _property_settings nopanel true

   , in the Attributes section, make the following changes:
   1. double-click on the attribute TurnOver and change:
      1. Type: Decimal
      2. Decimal Places: 2

      3. Insert excerpt
         _finish _finish nopanel true

   2. click

      Insert excerpt
      _add_icon _add_icon nopanel true

       and set up the following new attribute:
      1. Name: Source
      2. Expression: "Additional Company Data"

      3. Insert excerpt
         _finish _finish nopanel true

   3. Move the attribute Source to position 13 in the attribute list
      1. do this by dragging and dropping Source over Status
      2. A message will show asking to confirm if this table attribute should be moved - select Yes

Task 5: Import the Additional Companies data

1. To import the data from the File Collector to the table, hover over the Additional Companies table and select 

   Insert excerpt
   _run_analysis_icon _run_analysis_icon nopanel true

2. Confirm that you want to Run Analysis by pressing Yes on the message
   1. A 

      Insert excerpt
      _database _database nopanel true

       icon will show on the table to indicate it now holds data
3. View the imported data by hovering over the Additional Companies table and selecting 

   Insert excerpt
   _view_show_icononly _view_show_icononly nopanel true

4. On the Analysis Model toolbar, press 

   Insert excerpt
   _save_saveModel _save_saveModel nopanel true

Task 6: Add the Companies table

1. In 2. ERD Fundamentals you created a Companies table - this can be added to your Analysis Model by clicking the

   Insert excerpt
   _tables _tables nopanel true

    icon in the toolbar
   1. If you have not completed 2. ERD Fundamentals, repeat the relevant steps in Task 2-5 above to import the Companies table
2. The list of tables in your app opens in the

   Insert excerpt
   _repository _repository nopanel true

    on the right
3. Click and drag the Companies table onto the canvas
   1. To see the File Collector for the table, hover over the Companies table and press 

      Insert excerpt
      _table_show_inputs_icon _table_show_inputs_icon nopanel true

Task 7: Enrich the data

1. Hover over the 

   Insert excerpt
   _tables _tables nopanel true

    icon in the toolbar and drag a

   Insert excerpt
   _table_calculate _table_calculate nopanel true

    onto the canvas

1. In the Basic Settings for the new table, name it: Additional Companies Processed

2. Insert excerpt
   _save _save nopanel true

    the settings
3. Connect the tables by hovering over the Additional Companies table and clicking on 

   Insert excerpt
   _pipe_icon _pipe_icon nopanel true

   , then click on the Additional Companies Processed table
4. Hover over the Additional Companies table and select the

   Insert excerpt
   _attributes_icon _attributes_icon nopanel true

    icon to list all of the attributes for this table
5. Copy these attributes by selecting them all, then dragging and dropping them onto the Additional Companies Processed table
6. Click on the Additional Companies Processed table and in the Attributes section on the

   Insert excerpt
   _property_tabs _property_tabs nopanel true

   :
   1. click the 

      Insert excerpt
      _more_options _more_options nopanel true

       icon, then click 

      Insert excerpt
      _refresh _refresh nopanel true

       to show the attributes
   2. add a new attribute by clicking the 

      Insert excerpt
      _add_icon _add_icon nopanel true

       button and giving it the following settings:
      1. Name: ImportDate
      2. Type: Datetime
      3. Expression: now()

      4. Insert excerpt
         _finish _finish nopanel true

          the changes

Task 8: Enhance the Additional Companies Processed table

1. In the Additional Companies Processed table, on the 

   Insert excerpt
   _property_tabs _property_tabs nopanel true

    make the following changes to the attributes:
   1. Double click on the Name attribute and change the expression to: 

trim(in.Name)

b. Double click on the Web attribute and change the expression to: 

ifNull(
     // If a website is provided use it
     in.web,

     // ELSE, if it is NULL, use
     "https://www.google.com/search?q=" + replaceAll(_out.Name, "[ ,.]", "")
)

c.

d. On the Analysis Model toolbar, press

Task 9: Make the tables static

1. Hover over the Additional Companies table and select the 

   Insert excerpt
   _static_icon _static_icon nopanel true

    icon
2. Hover over the Additional Companies Processed table and select the 

   Insert excerpt
   _run_analysis_icon _run_analysis_icon nopanel true

    icon
   1. Confirm you want to Run Analysis by pressing Yes to the message
   2. Once the

      Insert excerpt
      _database _database nopanel true

       icon shows on the table indicating there is now data in the table, hover over the table and press 

      Insert excerpt
      _view_show_icononly _view_show_icononly nopanel true

       to see the results of the expressions you added in Task 8

3. Insert excerpt
   _save_saveModel _save_saveModel nopanel true

    the model