PhixFlow generates processing statistics which are saved to the database. These statics are for use by administrators and designers who are tuning for performance.

See System Configuration for how to enable and manage stats generation.

Processing Statistics

The following statistics are currently recorded and available as data records in the STATISTICS table. (See STATISTICS record definition)

Activity Statistics

Activity Statistics are recorded from TaskPlans executed, Actions triggered.

STATS_TYPE	INITIATOR_TYPE	INITIATOR_ID	INITIATOR_NAME	FULL_CONTEXT	DATA_TYPE	DATA_VALUE
Activity	TaskPlan, Action	TaskPlan/Action ID	TaskPlan/Action name	TaskPlan/Action Name	numStarted	{Numer of tasks started in this timeslot}
					numActive	{Number of tasks still running at the end of this timeslot}
					numEnded	{Number of tasks ended in this timeslot}
					sumDuration	{Total duration of task ending in this timeslot}

Stream Statistics

This is a record of data volumes written to Streams and Exporters

STATS_TYPE	INITIATOR_TYPE	INITIATOR_ID	INITIATOR_NAME	CONTEXT_TYPE	CONTEXT_ID	CONTEXT_NAME	FULL_CONTEXT	DATA_TYPE	DATA_VALUE
Stream	TaskPlan, Action	TaskPlan/Action ID	TaskPlan/Action name	Stream	Stream ID	Stream Name	TaskPlan/Action Name.Stream Name	insertCount	{Count of records inserted}
								insertVolume	{Volume of records inserted}
								insertVolumeBytes	{Volume of bytes inserted}
								insertTimeTotal	{Time taken to insert records}
								updateCount	{Count of records updated}
								updateVolume	{Volume of records updated}
								updateVolumeBytes	{Volume of bytes updated}
								updateTimeTotal	{Time taken to update records}

Pipe Statistics

This is a record of Pipe Read Statistics

STATS_TYPE	INITIATOR_TYPE	INITIATOR_ID	INITIATOR_NAME	CONTEXT_TYPE	CONTEXT_ID	CONTEXT_NAME	FULL_CONTEXT	DATA_TYPE	DATA_VALUE
Stream	TaskPlan, Action	TaskPlan/Action ID	TaskPlan/Action name	Stream	Stream ID	Stream Name	TaskPlan/Action Name.Stream Name	insertCount	{Count of records inserted}

This is a record of Pipe Queue Statistics

STATS_TYPE	INITIATOR_TYPE	INITIATOR_ID	INITIATOR_NAME	CONTEXT_TYPE	CONTEXT_ID	CONTEXT_NAME	FULL_CONTEXT	DATA_TYPE	DATA_VALUE
Stream	TaskPlan, Action	TaskPlan/Action ID	TaskPlan/Action name	Stream	Stream ID	Stream Name	TaskPlan/Action Name.Stream Name	insertCount	{Count of records inserted}

This is a record of Pipe Lookup Statistics

STATS_TYPE	INITIATOR_TYPE	INITIATOR_ID	INITIATOR_NAME	CONTEXT_TYPE	CONTEXT_ID	CONTEXT_NAME	FULL_CONTEXT	DATA_TYPE	DATA_VALUE
Stream	TaskPlan, Action	TaskPlan/Action ID	TaskPlan/Action name	Stream	Stream ID	Stream Name	TaskPlan/Action Name.Stream Name	insertCount	{Count of records inserted}

Database Statistics Record Structure

The table structure for STATISTICS is as follows:

Member	Class	Description
stats_type	enum	Statistics Type: E.g. 'Activity, Pipe, PipeLookup, PipeQueue, Stream'
fromDtm	Datetime	The start time of the period that this measure refers to
toDtm	Datetime	The end time of the period that this measure refers to
initiator_type	String	The object initiating the activity - eg. "TaskPlan", or "Action"
initiator_id	Uid	The ID of the initiating TaskPlan or Action / other object.
initiator_name	String	The name of the initiating TaskPlan or Action / other object.
context_type	String	The activity triggered by the initiator. eg "Stream"
context_id	Uid	e.g. The "Streams" ID that Analysis was run on.
context_name	String	eg. The name of the stream that Analysis was run on.`
full_context	String	This a dotted notation indicating the full context. eg. TaskPlan1.Stream X.in
data_type	String	The type of statistics data being recorded for this stats type. Eg. totalRecordsWritten, totalWriteTime.
data_value	Double	The value of the statistic being recorded for the given data_type.