Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Introduction

Overview

Each time you run analysis on a model, PhixFlow creates a new set of data, called a recordset, for each streamnon-transactional table. You can view this data by right-clicking on a table and selecting 

Insert excerpt
_recordsets_show
_recordsets_show
nopaneltrue
see Managing Recordsets for more options.

Recordsets remain available until you run an archive task on the streamtable; see Task or rollback back the recordsets

From the System Console → Task Logs tab → Recordsets you can select an option to rollback or to repeat analysis where the analysis run generated a number of cycles; see Understanding Cycles, below.

How To Rollback Recordsets

For non-transactional tables, which have a Period of Daily, Monthly or Variable, you can back out the changes to data caused by an analysis run. This resets the data to a previous recordset.

Warning

Do not roll back recordsets in transactional tables.
For tables with a Period of Transactional individual records are updated overtime. For example, application users make individual edits to records in the table. This means PhixFlow cannot rollback to a recordset in all tables where the data is consistent.

To rollback data you need to to an earlier recordset, open the rollback window , you can access this from several from one of the following places:

  • In a model: right-click on a stream table icon and select 
    Insert excerpt
    _rollback
    _rollback
    nopaneltrue
     StreamTable.
  • In the repository: right-click on a stream table name and select   select  
    Insert excerpt
    _rollback
    _rollback
    nopaneltrue
     StreamTable.
  • In the repository: use Ctrl+click to select multiple streams tables, right-click one of the stream table names and select   select  
    Insert excerpt
    _rollback
    _rollback
    nopaneltrue
     Selected Objects.
  • In a list of stream setsrecordsets: select one or more stream setsrecordsets, then right-click on one stream set recordset and select
    Insert excerpt
    _rollback
    _rollback
    nopaneltrue
     StreamSetRecordset. PhixFlow automatically populates the data for the rollback options, as it knows the properties of the selected stream setrecordset(s).
  • In the System Console → Task Logs tab → Recordsets , select rollback.for a recordset.

PhixFlow opens the Rollback window where you can configure the rollback. 

During the rollback process, PhixFlow displays details in the console. For large data sets, it may take some time to rollback all the data in a recordset.

Anchor
options
options
Rollback Window Options

In the Rollback window, select an option and specify the stream sets recordsets to rollback.

    

OptionDescription
Rollback a number of
StreamSets
RecordsetsEnter the number of
stream sets
recordsets to roll back. PhixFlow removes this number of
stream sets
recordsets, starting with the most recent.
Rollback to a specific run

Enter the run ID of a

stream set

recordset to which you want to rollback. You can find the run IDs in the Managing Recordsets. PhixFlow removes all the

streams

tables from the most recent, up to and including the specified run ID.

For a transactional

stream

table, PhixFlow removes the specified run ID only. All other

stream sets

recordsets, even more recent ones, are retained. 

From DateEnter a date. PhixFlow removes
stream sets
recordsets whose period start date is more recent than the specified date.
Rollback all dataPhixflow removes all
stream sets
recordsets for this
stream
table.
Keep old
Stream sets
Recordsets

This box is ticked by default.

Insert excerpt
_check_box_tick
_check_box_tick
nopaneltrue
 to rollback the data but to keep

the stream set

the recordset itself. In the

stream set

recordset list, the

stream set

recordset is empty and marked incomplete.

Insert excerpt
_check_box_untick
_check_box_untick
nopaneltrue
 to delete the

stream set

recordset. Both the data and the

stream set

recordset itself are removed from the

stream set

recordset list. You cannot repopulate deleted

stream sets

recordsets.

Insert excerpt
_dialog_cancel
_dialog_cancel
nopaneltrue
Close the window without running rollback.
Insert excerpt
_dialog_finish
_dialog_finish
nopaneltrue
Run the rollback process, then click Yes to confirm
.

Details about the rollback process are displayed in the console.

For large data sets, it may take some time to rollback all the data in a stream set
.

Example Rollback

When testing an analysis model it is likely you will read and clear all the data frequently, in this instance you would use the following configuration:

Understanding Repeat Cycles 
Anchor
#cycles
#cycles

Whenever an analysis model is run it will carry out a number of tasks e.g. read a number of files, generate a number of recordsets, export a number of files.

You can configure an analysis model so that in a single analysis session it actually runs several times. When a model is configured in this way, each run is called a cycle. All of the items processed or generated during that cycle (i.e. the files processed, recordsets created, files exported etc) are flagged with the cycle number. This cycle number is visible in the Log File for that analysis run on each of the relevant tabs showing files and stream sets processed.

The most common reason for configuring a model in this way is to allow a number of files to be processed in a single analysis session but to have the results from each file saved in a separate recordset. In this way, whenever a file fails to process, you can simply rollback the recordsets associated with that file rather than rolling back all of the recordsets associated with all of the files for the whole analysis session.

To configure a model to run multiple times in one analysis session:

  1. At the start of the model, configure the file collector to process a single file at a time.
  2. At the end of the model, from the final table create a push pipe that points back to the final table. 
  3. In the push pipe, set positive offsets.

When you run analysis on the model:

  1. The file collector reads in one file.
  2. PhixFlow then processes all tables in the model, generating a recordset for each table.
  3. Each recordset, and any associated output file, is flagged with the cycle number 1.
  4. When the last table in the model has finished producing its recordset, it sends a notification to itself down the push pipe.
  5. Due to the positive offset in the push pipe, the notification is the signal to create another recordset, so the whole model runs again. This time, recordsets and other output files are flagged with cycle number 2.

In the log files you can see which items were processed in which cycle. For rolling back analysis runs, you can choose how many cycles to roll back. In the case where the last file processed was unsuccessful, you can choose to only roll back the last cycle.

From the System Console → Task Logs tab → Recordsets you can see the cycle number associated with each recordset. You have options to rollback data to repeat analysis for specific cycles.

Anchor
rerun
rerun
Repopulating Incomplete

Stream Sets

Recordsets

If you rollback data due to errors, you can repopulate an incomplete stream set recordset with the correct data. This is because the all stream sets recordsets in a model that were created during the same analysis run have the same Run ID. PhixFlow can use the run ID to pull the correct data into an incomplete streamtable.

Tip

Make sure you have corrected any problems that caused the error before repopulating the stream set recordset with data.

To repopulate an incomplete stream setrecordset:

  1. Go to the console.
  2. Find the log messages related to rollback.
  3. Right-click the log message and in the Rollback window, select Repeat to reinstate data; see Rollback or Repeat Cycles Window.

For information about rerunning incomplete stream sets recordsets in an transactional streamtable; see the Managing Recordsets → Reprocess StreamSetRecordset option.

Insert excerpt
_terms_changing
_terms_changing
nopaneltrue