PhixFlow generates processing statistics which are saved to the database. These statics are for use by administrators and designers who are tuning for performance.
See System Configuration for how to enable and manage stats generation.
Processing Statistics
The following statistics are currently recorded and available as data records in the STATISTICS table. (See STATISTICS record definition)
Activity Statistics
Activity Statistics are recorded from TaskPlans executed, Actions triggered.
STATS_TYPE | INITIATOR_TYPE | INITIATOR_ID | INITIATOR_NAME | CONTEXT_TYPE | CONTEXT_ID | CONTEXT_NAME | FULL_CONTEXT | DATA_TYPE | DATA_VALUE |
|---|---|---|---|---|---|---|---|---|---|
| Activity | TaskPlan, Action | TaskPlan/Action ID | TaskPlan/Action name | TaskPlan/Action Name | numStarted | {Numer of tasks started in this timeslot} | |||
| numActive | {Volume of records inserted} | ||||||||
| numEnded | {Volume of bytes inserted} | ||||||||
| sumDuration | {Time taken to insert records} |
Pipe Read Statistics
Not yet available.
Stream Write Statistics
This is a record of data volumes written to Streams and Exporters
STATS_TYPE | INITIATOR_TYPE | INITIATOR_ID | INITIATOR_NAME | CONTEXT_TYPE | CONTEXT_ID | CONTEXT_NAME | FULL_CONTEXT | DATA_TYPE | DATA_VALUE |
|---|---|---|---|---|---|---|---|---|---|
| Stream | TaskPlan, Action | TaskPlan/Action ID | TaskPlan/Action name | Stream | Stream ID | Stream Name | TaskPlan/Action Name.Stream Name | insertCount | {Count of records inserted} |
| insertVolume | {Volume of records inserted} | ||||||||
| insertVolumeBytes | {Volume of bytes inserted} | ||||||||
| insertTimeTotal | {Time taken to insert records} | ||||||||
| updateCount | {Count of records updated} | ||||||||
| updateVolume | {Volume of records updated} | ||||||||
| updateVolumeBytes | {Volume of bytes updated} | ||||||||
| updateTimeTotal | {Time taken to update records} |
Database Statistics Record Structure
The table structure for STATISTICS is as follows:
Member | Class | Description |
|---|---|---|
| stats_type | enum | Statistics Type: E.g. 'Activity, Pipe, PipeLookup, PipeQueue, Stream' |
| fromDtm | Datetime | The start time of the period that this measure refers to |
| toDtm | Datetime | The end time of the period that this measure refers to |
| initiator_type | String | The object initiating the activity - eg. "TaskPlan", or "Action" |
| initiator_id | Uid | The ID of the initiating TaskPlan or Action / other object. |
| initiator_name | String | The name of the initiating TaskPlan or Action / other object. |
| context_type | String | The activity triggered by the initiator. eg "Stream" |
| context_id | Uid | e.g. The "Streams" ID that Analysis was run on. |
| context_name | String | eg. The name of the stream that Analysis was run on.` |
| full_context | String | This a dotted notation indicating the full context. eg. TaskPlan1.Stream X.in |
| data_type | String | The type of statistics data being recorded for this stats type. Eg. totalRecordsWritten, totalWriteTime. |
| data_value | Double | The value of the statistic being recorded for the given data_type. |