PhixFlow Help

Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 31 Next »

PhixFlow generates processing statistics which are saved to the database. These statics are for use by administrators and designers who are tuning for performance.

See System Configuration for how to enable and manage stats generation.

Processing Statistics

The following statistics are currently recorded and available as data records in the STATISTICS table. (See STATISTICS record definition)

Activity Statistics

Activity Statistics are recorded from TaskPlans executed, Actions triggered.

STATS_TYPE
INITIATOR_TYPE
INITIATOR_ID
INITIATOR_NAMECONTEXT_TYPECONTEXT_IDCONTEXT_NAMEFULL_CONTEXTDATA_TYPEDATA_VALUE
ActivityTaskPlan, Action

TaskPlan/Action ID

TaskPlan/Action name   TaskPlan/Action NamenumStarted{Numer of tasks started in this timeslot}
        numActive{Number of tasks still running at the end of this timeslot}
        numEnded{Number of tasks ended in this timeslot}
        sumDuration{Total duration of task ending in this timeslot}

Stream Statistics

This is a record of data volumes written to Streams and Exporters

STATS_TYPE
INITIATOR_TYPE
INITIATOR_ID
INITIATOR_NAMECONTEXT_TYPECONTEXT_IDCONTEXT_NAMEFULL_CONTEXTDATA_TYPEDATA_VALUE
StreamTaskPlan, Action

TaskPlan/Action ID

TaskPlan/Action nameStreamStream IDStream NameTaskPlan/Action Name.Stream NameinsertCount{Count of records inserted}
        insertVolume{Volume of records inserted}
        insertVolumeBytes{Volume of bytes inserted}
        insertTimeTotal{Time taken to insert records}
        updateCount{Count of records updated}
        updateVolume{Volume of records updated}
        updateVolumeBytes{Volume of bytes updated}
        updateTimeTotal{Time taken to update records}

Pipe Statistics

This is a record of Pipe Read Statistics

STATS_TYPE
INITIATOR_TYPE
INITIATOR_ID
INITIATOR_NAMECONTEXT_TYPECONTEXT_IDCONTEXT_NAMEFULL_CONTEXTDATA_TYPEDATA_VALUE
StreamTaskPlan, Action

TaskPlan/Action ID

TaskPlan/Action nameStreamStream IDStream NameTaskPlan/Action Name.Stream NameinsertCount{Count of records inserted}

This is a record of Pipe Queue Statistics

STATS_TYPE
INITIATOR_TYPE
INITIATOR_ID
INITIATOR_NAMECONTEXT_TYPECONTEXT_IDCONTEXT_NAMEFULL_CONTEXTDATA_TYPEDATA_VALUE
StreamTaskPlan, Action

TaskPlan/Action ID

TaskPlan/Action nameStreamStream IDStream NameTaskPlan/Action Name.Stream NameinsertCount{Count of records inserted}

This is a record of Pipe Lookup Statistics

STATS_TYPE
INITIATOR_TYPE
INITIATOR_ID
INITIATOR_NAMECONTEXT_TYPECONTEXT_IDCONTEXT_NAMEFULL_CONTEXTDATA_TYPEDATA_VALUE
StreamTaskPlan, Action

TaskPlan/Action ID

TaskPlan/Action nameStreamStream IDStream NameTaskPlan/Action Name.Stream NameinsertCount{Count of records inserted}

Database Statistics Record Structure

The table structure for STATISTICS is as follows:

Member
Class
Description
stats_typeenum

Statistics Type:

E.g. 'Activity, Pipe, PipeLookup, PipeQueue, Stream'

fromDtmDatetimeThe start time of the period that this measure refers to
toDtmDatetimeThe end time of the period that this measure refers to
initiator_typeString

The object initiating the activity - eg. "TaskPlan", or "Action"

initiator_idUidThe ID of the initiating TaskPlan or Action / other object.
initiator_nameString

The name of the initiating TaskPlan or Action / other object.

context_typeStringThe activity triggered by the initiator. eg "Stream"
context_idUid

e.g. The "Streams" ID that Analysis was run on.

context_nameStringeg. The name of the stream that Analysis was run on.`
full_contextString

This a dotted notation indicating the full context.

eg. TaskPlan1.Stream X.in

data_typeStringThe type of statistics data being recorded for this stats type. Eg. totalRecordsWritten, totalWriteTime.
data_valueDouble

The value of the statistic being recorded for the given data_type.

  • No labels