Analysis Modelling

What Is Analysis Modelling?

Models are the graphical representation of the analysis that will be carried out by the PhixFlow Analysis Engine. Analysis Models define how data is collected, transformed, exported and viewed. Analysis Models are created by opening a new modelling screen and adding processing steps. These steps define data collection from databases or files, analysis of that data and export of the data.

The Analysis Engine is the main back-end process in PhixFlow that performs all stream calculations, data collections and builds charts and dashboards. The Analysis Engine starts whenever the generation of a stream is requested. This can be triggered in three ways:

• An ad-hoc request from the stream navigator, by right-clicking on the stream generator and selecting Run Analysis.
• An ad-hoc request from a model, by clicking the  Run Analysis in the stream's pop-up toolbar.
• By a task plan.

The best way to get started with modelling is the Introduction to Modelling Course.

As PhixFlow runs the analysis process, it reports on progress using messages in the System Console. You can open the system console up at any time by clicking the icon  on the task bar. The analysis calculations depend on the properties set in the modelling objects, in particular:

• Datasources
•  Database Collectors 
• File Collectors 
• Streams 
• Database Exporters 
• File Exporters

Once you are familiar with the basic of modelling, this section contains more pages about common modelling tasks and on the fundamentals of PhixFlow Analysis.

The pages in this topic are:

• Using the Model Window
• Analysis Model
• Copying Models and Modelling Objects
• Getting Data Into and Out of Analysis Models
  • Datasource
  • Database Table
  • HTTP Datasource
  • Database Collector
  • File Collector
  • HTTP Collector
  • FTP Site
  • Database Exporter
  • File Exporter
  • File Exporter Excel Multi-input
  • HTTP Exporter
  • HTTP Header
  • XML Namespace
  • Reading Data From an Email Account
  • Upload Managed File
• Understanding Streams and Pipes
  • Which Stream to Use
    • When to Use a Calculate Stream
    • When to Use an Aggregate Stream
    • Merging Two Data Sets
    • Merging Similar Data Sets
    • Deduplicating Similar Data Sets
    • Enriching Data with Data From Another Set
    • Combining Data Using a Lookup Pipe
    • Combining Data Using a Cache Extraction Filter Lookup Pipe
    • Grouping and Referencing Data Using Calculate By Set Stream
  • Stream Set List
  • Copy or Move Stream Data
  • Stream
  • Stream Attributes
  • Stream View
  • Pipe
  • Using Directed Pipes to Read from Large Data Sets
  • Sort Order
  • Rollback
  • Rollback or Repeat Cycles
• Aggregate Functions
• Charting and Reports
• Creating Pivot Views
• PhixFlow Timing Cycle
• Common Modelling Scenarios
  • Calculate an Average
  • Load Data
    • Check Database Space Being Used
    • Load a Subset of Data from a Database
    • Load Binary Files
    • Load Data From the Web
    • Load From and Write to a Database
    • Manage Unsorted Data Using an In-Memory Stream
    • Speed Up Data Loading Using Parallel Collectors
  • Compare or Match Data
    • Check Generated Files
    • Compare Two Files
    • Inexact Match for DateTimes
    • Inexact Match for Strings
    • Inexact Match Streams
    • Remove Duplicates
  • Split or Combine Data
    • Break an SQL IN Clause Into Batches
    • Create Unique Indexes or Record Identifiers
    • Enrich Stream Data
    • Filter Values in a Lookup Pipe
    • Process Separate Files into Separate Streams
    • Reconcile Invoices
    • Turn One Record Into Multiple Records
    • Use a Master List