Versions Compared
Version | Old Version 140 | New Version Current |
---|---|---|
Changes made by | ||
Saved on |
Key
- This line was added.
- This line was removed.
- Formatting was changed.
Overview
tables are a key model component. They represent a structured store of data within PhixFlow receiving data from one or more components, processing it then storing it.
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
Overview
Tables are a key model component. They represent a structured store of data within PhixFlow receiving data from one or more components, processing it then storing it. When you make changes to tables and attributes, PhixFlow automatically publishes them to the database; see Publishing StreamsTables.
Excerpt |
---|
| ||||
For
|
|
|
Table Properties
Basic Settings
s, see File Table. |
Insert excerpt | ||
---|---|---|
|
|
|
The toolbar has the following additional buttons:
Insert excerpt | ||
---|---|---|
|
|
|
|
|
,
Insert excerpt | ||
---|---|---|
|
|
|
Updating a static table
In general, static tables are not updated during an analysis run that is initiated on another table in the model. The exception is when an incoming push pipe is triggered, as this will force the table to update itself.
Instead, to update the data in a static table you must run analysis directly on the table via:
- the model
- a task plan.
Select the time period for the table:
Excerpt |
---|
|
As transactional tables need a UID
attribute, PhixFlow automatically creates this attribute if it does not already exist.
This option affects the following items for which this is the backing table:
- views
- screens
- card components.
If no option is is selected, PhixFlow assumes the default data range is All.
You can override this setting using the options Use Custom Data Range and Data Range available:
You cannot override this setting for a view.
Select the table type; see Types of Table. The type indicates the function that operates on the data.
- Aggregate Table
- Calculate Table
- CalculateBySet Table
- Cartesian Table
- Merge Table
Select a loop pipe from the list of those available.
A loop pipe links the table back to itself. It compares new data records to the existing data records. If there is a repeated record PhixFlow uses the new one in the table and marks the old one as superseded
.
|
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
Basic Settings
Field | Description |
---|---|
Name | The name of the table. |
Description | We recommend that you always enter a description to explain the purpose of this item. |
Attributes
The grid lists the attributes (data columns) in the table data.
Excerpt | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
|
Excerpt | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||
ViewsThe grid contains a list of the data views for this table.
|
Anchor multipliers multipliers
Analysis Options
multipliers | |
multipliers |
Field | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
Enabled |
When Audit Manual Changes is first set, the attributes
|
Attributes
The grid contains a list of the attributes in the table. This section has a toolbar with standard buttons andThe grid lists the attributes (data columns) in the table data. To edit the properties of an attribute, double-click the attribute name to open the Attribute properties.
To remove an attribute from the table, select the attribute and clickTo add an existing attribute to the list:
ClickTo edit only the expression:
- Right-click an attribute name to display the context menu.
- Select Edit the expression field.
- PhixFlow opens a simple text editor box
- Make changes to the attributes expression.
- Click Image Removed to save your changes.
Field | Description | ||||||||
---|---|---|---|---|---|---|---|---|---|
to include the table during analysis runs. | |||||||||
Static Data |
Updating a static tableIn general, static tables are not updated during an analysis run that is initiated on another table in the model. The exception is when an incoming push pipe is triggered, as this will force the table to update itself. Instead, to update the data in a static table you must run analysis directly on the table via:
| ||||||||
Period | Select the time period for the table:
| ||||||||
Default Data Range | This option affects the following items for which this is the backing table:
If no option is is selected, PhixFlow assumes the default data range is All. You can override this setting using the options Use Custom Data Range and Data Range available: You cannot override this setting for a view. | ||||||||
Table Type | Select the table type; see Types of Table and When to Use Them. The type indicates the function that operates on the data.
| ||||||||
Supersede Items on Pipe | Select a loop pipe from the list of those available. A loop pipe links the table back to itself. It compares new data records to the existing data records. If there is a repeated record PhixFlow uses the new one in the table and marks the old one as | ||||||||
Input Multiplier | The input multiplier expression should evaluate to a list of one or more values. For each value in the list, the internal variable _inputMultiplier will be set to that value and the whole table processing will be repeated i.e. the pull pipes will be read and the data from those pipes processed to generate output records to be added to the current recordset. For example : do ( $aRange = [], addElement($aRange, rng.RangeFrom), addElement($aRange, rng.RangeTo), $bRange = [], addElement($bRange, $aRange), $bRange ) Where rng.RangeFrom = 500 and rng.RangeTo = 1000, the above example evaluates to [[500,1000]], which is a list containing 1 element, which is itself a list containing 2 elements. An input multiplier that evaluates to [3,4,7,8] would run the Table 4 times. other Collectors. | ||||||||
Log Input Multiplier Messages |
| ||||||||
Output Multiplier | This field is an expression which should evaluate to an array of values. A separate output record will be produced for each value in the array and this value is available as _outputMultiplier in each of the table output attribute expressions (each value in the array is also available through _type, although this is not recommended usage). In effect this will multiply each of the output records by the number of elements from the returned list. For example : ifNull(in.ASSET, [1,10,12] , // else do [5,7] ) will create 3 records for every record in the table if in.ASSET contains a value (setting _type = 1, 10 and 12 in each case). Otherwise it will create 2 records for every record in the table (and set _type = 5 and 7). An output multiplier may also evaluate to a record, or a group of records. For example an Output Multiplier with the expression:do( lookup(lkin, $num = in.BNumber), lkin ) will return a list of records which match the lookup on the lkin pipe. In this case the required data can be extracted from the Output Multiplier using the following expression : do ( $values = _type, $values.account_num ) If the output multiplier expression evaluates to _NULL, an empty list of values or an empty list of records then a single output record will be produced with _type set to _NULL, _NULL or an empty record respectively. | ||||||||
Select Records to Output (Formerly Output Filter) | You can select a subset of records to output to the next modelling object. You select records using the data in any attribute that is in the table output. Enter an expression that should evaluate to true or false (equivalently 1 or 0). When the expression evaluates to true or 1, the records found by the expression are selected and output to the next modelling object. For example:
To select active accounts, enter the expression |
Actions
This section has a toolbar with standard buttons. The grid contains a list of actions that operate on the table.
true or 1, the records found by the expression are selected and output to the next modelling object. For example:
To select active accounts, enter the expression |
Actions
The grid contains a list of actions that operate on the table.
- To edit the properties of an action, double-click its name
- To add an action to the list, click
and PhixFlow opens the Table-Action properties tabInsert excerpt _new _new nopanel true - To remove an action from the table, select the action and click
in the toolbarInsert excerpt _delete _delete nopanel true
Record-Actions
The grid contains a list of record-actions that can update records in the table.
- To edit the properties of a record-action, double-click its name
- To add
- a record-action to the list,
- click
Insert excerpt _new _new nopanel true
- and PhixFlow opens the Record-Action
- properties tab
- To remove
- a record-action from the table, select the record-action and click
Insert excerpt _delete _delete nopanel true
- in the toolbar
Record-Actions
This section has a toolbar with standard buttons. TheExcerpt | ||
---|---|---|
| ||
Sort OrdersThe grid contains a list of |
the sort orders for this table.
|
|
|
|
|
|
|
|
|
Excerpt | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
Errors
|
|
|
Views
This section has a toolbar with standard buttons. The grid contains a list of the data views for this table.
To edit the properties of an view, double-click its name. To add a view to the list, clickSort Orders
This section has a toolbar with standard buttons. The grid contains a list of the sort orders for thisExcerpt | ||
---|---|---|
| ||
ERDsThe grid displays a read-only list of the Entity Relationship Diagrams (ERDs) that this table is part of. Double-click an ERD to open it. See Entity Relationship Diagrams. |
Excerpt | ||
---|---|---|
| ||
RelationsThe grid displays a read-only list of the relationships that this table has to attributes in other tables. Double-click a relationship to display it's properties; see Relationship and Entity Relationship Diagrams. |
Excerpt | ||
---|---|---|
| ||
FiltersThe grid contains a list of the filters that can be applied to this table. You can add filters to view based on this table. All filters in this list are available in the default view for this table. For views that you create, in the View properties tab → Filters section, you can add filters. The list of available filters is populated by the filters defined for the table. To edit the properties of a |
filter, double-click its name. |
To add a filter to the list, click
|
|
|
|
This section has a toolbar with standard buttons. The grid displays a read-only list of the relationships that this table has. Double-click a relationship to display it's properties; see Relationship.
Filters
This section has a toolbar with standard buttons. The grid contains a list of the filters that can be applied to this table. You can add filters to view based on this table.
All filters in this list are available in the default view for this table. For views that you create, in the View properties tab → Filters section, you can add filters. The list of available filters is populated by the filters defined for the table.
To edit the properties of a filter, double-click its name. To add a filter to the list, clickTip |
---|
In a view grid, the header row has a drop-down list of filters. The drop-down list is populated by the filters that are selected on the view. The filters must first be defined for the table here. |
Inputs
This section has a toolbar withNote |
---|
This list can include pipes that have no input. This occurs if the source table has been deleted or if a model has been moved to a different PhixFlow instance (export/import), leaving behind a referenced table. Any pipes with no input are highlighted in yellow. To resolve pipes with no input you can:
|
The following properties affect the number of data records a user can download from a view, such as a grid, chart or card; see Download CSV or Excel Data.
Available when Allow Unlimited Downloads is ticked.
Use this section to select the user groups whose members can download an unlimited number of records.
This section has a toolbar with standard buttons andThe grid contains a list of user groups that are exempt from the Table Download Limit. To add a user group to the list:
ClickLive Search | ||||||||
---|---|---|---|---|---|---|---|---|
|
Panel | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
|
Learn More
Use the following options to specify how PhixFlow manages old data when a table-data-delete task runs.
Warning |
---|
We recommend that you always specify the data retention values for every table you create.
If no data retention option is set, PhixFlow displays an error in the Errors section, above. |
- Using Tasks and Task Plans for information about tasks.
- Deleting Old Data to see how you can use these values in data management strategies.
Retain All Data
Warning |
---|
Tables with Retain All Data ticked never have their data deleted and the data will accumulate. This can lead to performance issues. |
Keep for N Days
The age of data in a recordset is its 'to' date, relative to the 'to' date of the newest valid recordset in the table .
When a table-data-delete task runs for a table and:
- Keep for X Days only is set, PhixFlow deletes table data that is older than N days.
- Keep for Y Recordsets only is set, PhixFlow keeps the most recent X recordsets and deletes recordsets that exceed X.
- both Keep for X Days and Keep for Y Recordsets are set, PhixFlow deletes the table data that meets both conditions.
- neither Keep for N Days nor Keep for X Recordsets are set, PhixFlow keeps table data indefinitely. This can lead to performance issues.
The number of recordsets to keep in the table.
Keep Superseded for N Days
Enter the number of days to keep superseded records in the table data.
Tip |
---|
Remember to keep superseded records for as long as you want the option to roll back the data. For example, when Keep Superseded for N Days is set to 4, you can run roll back on data that was superseded up to 4 days ago. A table-data-delete task removes superseded records older than 4 days, so PhixFlow no longer has the data to be able to roll it back. |
In a table where the superseded date is tracked, the table data contains a mixture of active records and records that have been superseded.
When a table-data-delete task runs for a table and:
- Keep Superseded for N Days only is set, PhixFlow deletes data records that were superseded more than N days ago.
- Keep Superseded for X Recordsets only is set, PhixFlow deletes superseded records from the recordsets that exceed X.
- both Keep Superseded for N Days and Keep Superseded for X Recordsets are set, PhixFlow deletes the superseded records that meet both conditions.
- neither Keep Superseded for N Days nor Keep Superseded for X Recordsets are set, PhixFlow keeps superseded records indefinitely. This can lead to performance issues.
Available when Track Superseded Data is selected.
Enter the number of recent recordsets that will retain their superseded data records.
Advanced
Only change the advanced properties with advice by PhixFlow support.
Use this property if your database administrator wants to query table data in the PhixFlow database.
Enter a string in the format v_xxxx
. When the table is published to the database, PhixFlow creates a view. If the table is deleted, the next system task that runs will clear the associated view from the database.
By default, this field is blank and no view is created in the database.
See also Configuring Access to Database Views.. PhixFlow opens the Filter properties tab. To remove a filter from the table, select the filter and click
|
Inputs
This section lists all pipes that connect into the table. Double-click a pipe to view more details and make changes. See Pipe.
This section has a toolbar with
and Insert excerpt _detailed_list _detailed_list nopanel true
buttons; see standard buttons, see Menu Options and Toolbar Buttons. Insert excerpt _refresh _refresh nopanel true
Note |
---|
This list can include pipes that have no input. This occurs if the source table has been deleted or if a model has been moved to a different PhixFlow instance (export/import), leaving behind a referenced table. Any pipes with no input are highlighted in yellow. To resolve pipes with no input you can:
|
Download Limits
Anchor | ||||
---|---|---|---|---|
|
The following properties affect the number of data records a user can download from a view, such as a grid, chart or card; see Download CSV or Excel Data.
Field | Description | ||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Table Download Limit | Enter the maximum number of records that a user can download from a view on this table. If no value is set, PhixFlow uses the default limit set in System Configuration→ System Tuning → Default Download File Limit. | ||||||||||||||||||||||||
Allow Unlimited Downloads |
| ||||||||||||||||||||||||
User Groups | Available when Allow Unlimited Downloads is ticked. Use this section to select the user groups whose members can download an unlimited number of records. This section has a toolbar with standard buttons, see Menu Options and Toolbar Buttons, and The grid contains a list of user groups that are exempt from the Table Download Limit. To add a user group to the list:
To remove user groups, use the
|
Excerpt | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
Data Retention Settings
Use the following options to specify how PhixFlow manages old data when a table-data-delete task runs.
|
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
Excerpt | ||||||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||||||||||||||||||||||||||||||||||||||
AdvancedOnly change the advanced properties with advice by PhixFlow support.
|
|
|
Insert excerpt | ||||||
---|---|---|---|---|---|---|
|
By default, the permissions to access table data is set in System Configuration → Allow access to data by default. You can add specific user groups to restrict access to the table.
Insert excerpt | ||
---|---|---|
|
By default, the permissions to access table data is set in System Configuration → Allow access to data by default. You can add specific user groups to restrict access to the table.
|
Live Search | ||||||||
---|---|---|---|---|---|---|---|---|
|
Panel | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||
|
Learn More
- Entity Relationship Diagrams
- Displaying Data (Views)
- Analysis Models for Batch Processing Data
- Attribute
- View