Introduction

Welcome to Analysis Modelling Fundamentals. In this chapter we will learn about designing and creating analysis models including cleansing and enriching data.

Concepts

To find out more about the Analysis Modelling options and design principles before you take the course below, or simply to refresh your memory, see Analysis Models for Batch Processing Data.

Video Demonstration 

Watch the video demonstration, then complete the task list below.

Part 1 - Analysis Fundamentals

Fundamentals Tasks

Complete the tasks below, before moving to the next chapter. 

Task 1: Download Learning Centre Files

1. Access the Learning Centre using the Help link in the top right corner of PhixFlow or via Learning Centre  
   1. 
2. Scroll to the bottom of the webpage and in the Sample Datasets section, download the files:
   • Companies
   • Companies Additional

Task 2: Create the Analysis Model

1. Select  Analysis from the PhixFlow home page
2. Click  Add New
3. On the Create Analysis Model window that appears, enter the name, CRM Data Import, and select Create

Task 3: Add a File Collector

1. Add a new File Collector by hovering over  Files in the toolbar and clicking and dragging the  File Collector icon onto the canvas
   1. In the  Properties on the right, enter the name, Additional Companies, and  Apply
2. Hover over the Additional Companies File Collector on the canvas and in the pop-up menu, click the  icon
3. In the Upload File window:
   1. choose Select
   2. find the Additional Companies file on your PC/laptop
   3. click Open
   4. click Upload File
4. An Additional Companies table will be automatically created and added to the canvas
   1. this table does not yet hold the data you have uploaded, only the attributes (column headers). This allows any changes to be made to the attributes first which affects how the data is imported

Task 4: Setup the Additional Companies table

1. Click on the Additional Companies table and  Pin the tab 
2. In the table's  Properties, in the Attributes section, make the following changes:
   1. double-click on the attribute TurnOver and change:
      1. Type: Decimal
      2. Decimal Places: 2
      3.  Apply and Close
   2. click  and set up the following new attribute:
      1. Name: Source
      2. Expression: "Additional Company Data"
      3.  Apply and Close
   3. Move the attribute Source to position 13 in the attribute list
      1. do this by dragging and dropping Source over Status
      2. A message will show asking to confirm if this table attribute should be moved - select Yes

Task 5: Import the Additional Companies data

1. To import the data from the  File Collector to the  Table, hover over the Additional Companies table and select 
2. Confirm that you want to Run Analysis by pressing Yes on the message
   1. A  Database icon will show on the table to indicate it now holds data
3. View the imported data by hovering over the Additional Companies table and selecting 
4. On the Analysis Model toolbar, press  Save

Task 6: Add the Companies table

1. In 2. ERD Fundamentals you created a Companies table - this can be added to your Analysis Model by clicking the  Table icon in the toolbar
   1. If you have not completed 2. ERD Fundamentals, repeat the relevant steps in Task 2-5 above to import the Companies table
2. The list of tables in your app opens in the  Repository on the right
3. Click and drag the Companies table onto the canvas
   1. To see the File Collector for the table, hover over the Companies table and press 

Task 7: Enrich the data

1. Hover over the  Table icon in the toolbar and drag a  Calculate Table onto the canvas

1. In the Basic Settings for the new table, name it: Additional Companies Processed
2.  Apply the settings
3. Connect the tables by hovering over the Additional Companies table and clicking on , then click on the Additional Companies Processed table
4. Hover over the Additional Companies table and select the icon to list all of the attributes for this table
5. Copy these attributes by selecting them all, then dragging and dropping them onto the Additional Companies Processed table
6. Click on the Additional Companies Processed table and in the Attributes section on the Properties tab:
   1. click the  More Options icon, then click  Refresh to show the attributes
   2. add a new attribute by clicking the  button and giving it the following settings:
      1. Name: ImportDate
      2. Type: Datetime
      3. Expression: now()
      4.  Apply and Close the changes

Task 8: Enhance the Additional Companies Processed table

1. In the Additional Companies Processed table, on the  Properties tab make the following changes to the attributes:
   1. Double click on the Name attribute and change the expression to: 

trim(in.Name)

b. Double click on the Web attribute and change the expression to: 

ifNull(
     // If a website is provided use it
     in.Web,

     // ELSE, if it is NULL, use
     "https://www.google.com/search?q=" + replaceAll(_out.Name, "[ ,.]", "")
)

c.  Apply and Close the changes

d. On the Analysis Model toolbar, press  Save

Task 9: Make the tables static

1. Hover over the Additional Companies table and select the  icon
2. Hover over the Additional Companies Processed table and select the  icon
   1. Confirm you want to Run Analysis by pressing Yes to the message
   2. Once the  Database icon shows on the table indicating there is now data in the table, hover over the table and press  to see the results of the expressions you added in Task 8
3.  Save the model

Further Reading (Optional)

For more information on the topics covered in this chapter, see the below links.

• Analysis Models for Batch Processing Data
• Expression Basics
• Importing a Managed File
• Understanding Tables and Pipes
• Enriching Data