Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

This page is for data modellers. It provides an introduction to tables and pipes.

Overview

In an analysis model,

a dataset is represented by a table. A table is a bit like an Excel spreadsheet, in that it contains a set of data with:columns

data is held in a table which consists of:

  • Columns - these are the attributes.
rows
  • Rows - these are the data records.
In PhixFlow you connect two tables with a pipe. A pipe sends data from the input table to the output table

Tables can be connected with pipes, which are used to send data from table to another. Pipes also connect other types of modelling object, such as a datasource that connects to a database or file exporter. Usually, a pipe has default settings

. This

, this means it passes all attributes and records onto the next object. However, you can use the pipe properties to control which attributes and records from the input object you want to pass through.

When you

For example, here we have data being imported from a database using a datasource and data collector, the data is held in its original form in a table before being passed onto a second table where is it enriched. It is possible to add a filters on any of the pipes to remove records such as a business being found with no name or a transaction being older than a specified date.


Image Added

To move data between modelling objects we must run an analysis model

,

PhixFlow then uses the information in each object's properties to process the data.

This means each table and pipe can transform the data in the analysis model. With

Because with each analysis run

,

the data in a table can change,

so

PhixFlow keeps

a  snapshot

the dataset for each run.

The snapshot is called a recordset

If there is a problem in the analysis run, you can delete

the new recordset by rolling back the run. PhixFlow reverts the data

a dataset(s) using the Rollback feature which will revert to the selected

, previous recordset

datasetYou can also copy or move data from a

recordset

dataset.

To look at the data table, you use a view. The

Table is possible via views, the default view shows data in a grid. You can also create

different

your own views such as graphs and charts. View properties have lots of options to control which attributes are included in the view, which records are shown and how to sort the records.

Panel
borderColor#7da054
titleColorwhite
titleBGColor#7da054
borderStylesolid
titleSections on this page
Table of Contentsindent12pxstylenone

Running Analysis

This topic includes:

Child pages (Children Display)

Running analysis is where PhixFlow evaluates your configuration and uses this information to processes your data. Analysis is started from a table, and then all modelling objects which proceed the table will process the data in order. It should be noted that some modelling objects can be set to static, these will not run and PhixFlow will not run any items which precede a static item. This is useful where there is information which you do not need to reprocess every time your run analysis, or want to run it on a different schedule.

To Run Analysis hover over the table and click Run Analysis:

image2022-3-8_15-39-26.pngImage Added

Streams and Time Periods

In any given moment, a streams

contains

can contain a set of records

. This is the record-set. You

which we call the dataset. You can set the time period

over

which PhixFlow

collects

uses to collect records. The period can be:

Insert excerpt
Table Properties
Table Properties
nopaneltrue

For non-transactional periods, PhixFlow checks for incomplete record-sets and reports an error if it finds them. However, pipes from transactional streams allow incomplete record-sets, as data is constantly changing.

Publishing Streams
Anchor
publish
publish

When you make changes to a stream's properties or its attributes, PhixFlow publishes the changes to the PhixFlow database. This happens automatically in the background. Publishing many streams or streams with many attributes can take some time, and may slow performance.

If the stream properties are set incorrectly, PhixFlow will not be able to publish the stream to the database. If this happens, the

Insert excerpt
_console
_console
nopaneltrue
 will report the publishing error. PhixFlow will also display an error message if you try to interact with the stream, for example to view its data or to run analysis. You must correct the stream properties, so that PhixFlow can retry publishing the stream. 

During the publishing process, PhixFlow may create temporary streams in its database. These are kept for a period, then automatically removed when a system task runs. For information about:

Insert excerpt
_publishing_space
_publishing_space
nopaneltrue

Learn More