Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Streams are a key modelling components in PhixFlow.

...

There are several types of stream:

Anchor
calculate
calculate
  
Insert excerpt
_stream_calculate
_stream_calculate
nopaneltrue

...

 Calculate Stream

Calculate streams are the most basic stream type in PhixFlow. An output record will be produced for each input record.

Anchor
merge
merge
 
Insert excerpt
_stream_merge
_stream_merge
nopaneltrue
Merge Stream

Merge streams combine sets of input data. In each input pipe a grouping is defined, and an output record is produced for each key value combination that is produced by this grouping applied across all inputs.

Anchor
aggregate
aggregate
 
Insert excerpt
_stream_aggregate
_stream_aggregate
nopaneltrue
Aggregate Stream

Aggregate streams aggregate input data. In the input pipe a grouping is defined, and an output record is produced for each key value combination that is produced by the grouping.

...

Publishing Streams 
Anchor
publish
publish

When you make changes to a stream's properties or its attributes, PhixFlow publishes the changes to the stream data tables in the PhixFlow database. This happens automatically in the background. Publishing many streams or streams with many attributes can take some time, and may slow performance.

If the stream properties are set incorrectly, PhixFlow will not be able to publish the stream data to the database. If this happens, the

Insert excerpt
_console
_console
nopaneltrue
 will report the publishing error. PhixFlow will also display an error message if you try to interact with the stream, for example to view its data or to run analysis. You must correct the stream properties, so that PhixFlow can retry publishing the stream. 

During the publishing process, PhixFlow may create temporary tables in its database. These are kept for a period, then automatically removed when a system task runs. For information about: