...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
...
...
For advanced configuration, see Advanced Pipe Configuration.
...
bgColor | #e6f0ff |
---|---|
titleBGColor | #99c2ff |
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
...
Using the Sort/Group Grid
To add a stream attribute to the list:
...
For input stream attributes, PhixFlow displays the attribute name. (Read-only)
For a new attribute, enter a name.
...
Select the sort order
- (A-Z) to sort data records in ascending order, e.g. A to Z, 1 to 9, earliest to latest date.
- (Z-A) to sort data records in descending alpha-numeric order, e.g. Z to A, 9 to 1, latest to earliest date.
...
If this attribute is part of the candidate key set, you must tick the Group check box. Otherwise, the attributes will be used only to sort the data in the candidate set.
...
This field is available for lookup pipes with an Index Type option selected.
Look-up pipes can be configured for fast "indexed" access to cached data. This data is collected from external tables, files or from other streams. Indexed access is controlled through configuring a pipe with an index and setting index expressions on "Group By" attributes here.
...
Tip |
---|
In some cases, you may have a pipe connected to a database collector, which pulls data from an external database table. In these cases, the fields in the database must have matching attribute names in the output stream. You can refer to it using the format |
Aggregate Attributes
Use this section to define the properties of data that you want to combine as it comes through the pipe.
Note |
---|
You cannot aggregate data from attributes if the pipe's input is from: If you need to aggregate data from a database collector, you can use an SQL query. |
This section has:
- a toolbar with standard buttons
- a grid that lists the attributes that you want to aggregate.
Using the Aggregate Attributes Grid
To add a stream attribute to the list:
...
To set the properties for an aggregate attribute, double-click its name in the grid. PhixFlow opens the attribute's sort properties:
...
Select an function to combine stream data records.
- Average
- Count
- Distinct
- Maximum
- Minimum
- Sum
See Aggregate Function for details. Make sure the function matches the data in the attribute. For example, you cannot Sum text.
...
Select the stream attribute aggregated from the list of attributes in the input stream.
PhixFlow does not use the value in this field if the Aggregate Function is Count.
...
Advanced
The following options are available when the pipe Type is Push or Pull. Allow Incomplete Stream Sets is also available when the pipe Type is Lookup.
...
...
...
...
...
PhixFlow cannot complete a stream set if:
...
Tip |
---|
You must tick this check box on all the pipes that will read from a static (or effectively static) input stream in the analysis run. PhixFlow will report an error if there is any pipe trying to complete the stream set during the analysis run. |
Pipes that are not used in the analysis run do not try to complete a stream set, so will not report an error. (Unused pipes can occur if they lead to streams on branches of the model that are not being run.)
...
Max Records To Read
...
Enter a number for the maximum number of records that should be read down this pipe. The pipe may read more than this number of records if it is configured to carry out multiple reads simultaneously. For example:
- a pipe can be connected to a File Collector that reads multiple files simultaneously
- the pipe strategy is Directed with multiple workers.
...
Select an option to specify how this pipe should be implemented. See the section on Directed Merge Strategy
- Default: this is the way pipes usually works
- Directed: when reading from a large data set; see Using Directed Pipes to Read from Large Data Sets
...
Max Workers
...
This field is available when Strategy is Directed
Enter the maximum number of concurrent worker tasks. When no value is specified, this defaults to 1.
...
This field is available when Strategy is Directed
Enter the number of key values to read for a single worker task, which runs a single select statement.
When no value is specified, this defaults to 1000. This is the maximum value that can be used when reading from an Oracle database.
...
- Pipe Logging : when ticked, PhixFlow always logs the number of records returned by this pipe, whatever is set here.
...
The following properties are available in Basic Settings when you set Data To Read to Custom.
...
Every time the analysis engine runs, all of the stream sets that are created by all of the streams affected by that analysis run are given the same Run ID.
...
Enter the number of stream sets to be retrieved from the input stream.
For a push pipe with positive offsets. enter the maximum number of stream sets that can be created i.e. the maximum number of cycles this pipe can initiate.
...
For example, if:
- the from and to offsets are both 0.0
- and the output stream requires stream generation for the period 17/10/07 - 18/10/07
...