Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Overview

Each time you run analysis on a model, PhixFlow creates a new set of data

in each stream

, called a recordset, for each non-transactional table. You can view

the stream sets and the data they contain; see Stream Set List. Stream sets 

this data by right-clicking on a table and selecting 

Insert excerpt
_recordsets_show
_recordsets_show
nopaneltrue
see Managing Recordsets for more options.

Recordsets remain available until you run an archive task on the

stream

table; see Task

If there is a problem during the analysis run, you may find that a stream set has incorrect or missing data. To fix stream sets, you can undo the analysis by running rollback. There are several options available to configure rollback; see Using the Rollback Window, below.

Panel
borderColor#7da054
titleColorwhite
titleBGColor#7da054
borderStylesolid
titleSections on this page

Table of Contents
indent12px
stylenone

Either rollback deletes the specified stream set(s).
You cannot repopulate a deleted stream set.
Use this approach when you want to completely discard a stream set. When you next run analysis, PhixFlow creates a new stream set with the latest data.
  • Or rollback deletes the data but keeps the stream set itself. Tick the Keep old stream sets option to use this option.
    The stream set remains on the stream set list, marked as incomplete. You can repopulate an incomplete stream.
    Use this approach when you want to fix the data in a stream set. When you next run analysis, PhixFlow repopulates the incomplete stream set; see Repopulating Incomplete Stream Sets, below. 
  • For large data sets, it may take some time to rollback all the data in a stream set.

    Accessing the Rollback Window

    To undo one, some or all of the stream sets for a stream, use the 

     or rollback back the recordsets. 

    From the System Console → Task Logs tab → Recordsets you can select an option to rollback or to repeat analysis where the analysis run generated a number of cycles; see Understanding Cycles, below.

    How To Rollback Recordsets

    For non-transactional tables, which have a Period of Daily, Monthly or Variable, you can back out the changes to data caused by an analysis run. This resets the data to a previous recordset.

    Warning

    Do not roll back recordsets in transactional tables.
    For tables with a Period of Transactional individual records are updated overtime. For example, application users make individual edits to records in the table. This means PhixFlow cannot rollback to a recordset in all tables where the data is consistent.

    To rollback to an earlier recordset, open the rollback window from one of the following places:

    • In a model: right-click on a table icon and select 
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
     menu option, which displays the Rollback window. You can access this option from several places:
    •  Table.
    • In the repository: right-click on a
    stream
    • table name and
    select   
    • select  
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       
    Stream
    • Table.
    • In the repository: use Ctrl+click to select multiple
    streams
    • tables, right-click one of the
    stream
    • table names and
    select   
    • select  
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       Selected Objects.
    • In
    a model: right-click on
    • a
    stream icon and select  Insert excerpt_rollback_rollbacknopaneltrue Stream.In a list of stream sets
    • list of recordsets: select one or more
    stream sets
    • recordsets, then right-click on one
    stream set
    • recordset and select
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       
    StreamSet
    • Recordset. PhixFlow automatically populates the data for the rollback options, as it knows the properties of the selected
    stream set
    • recordset(s).
    • In the System Console → Task Logs tab → Recordsets , select rollback.for a recordset.

    PhixFlow opens the Rollback window where you can configure the rollback. 

    During the rollback process, PhixFlow displays details in the console. For large data sets, it may take some time to rollback all the data in a recordset.

    Anchor
    options
    options

    Using the

    Rollback Window Options

    In the Rollback window, select an option and specify the

    stream sets

    recordsets to rollback.

    OptionDescription
    Rollback a number of
    StreamSets
    RecordsetsEnter the number of
    stream sets
    recordsets to roll back. PhixFlow removes this number of
    stream sets
    recordsets, starting with the most recent.
    Rollback to a specific run

    Enter the run ID of a

    stream set

    recordset to which you want to rollback. You can find the run IDs in the 

    Stream Set List

    Managing Recordsets. PhixFlow removes all the

    streams

    tables from the most recent, up to and including the specified run ID.

    For a transactional

    stream

    table, PhixFlow removes the specified run ID only. All other

    stream sets

    recordsets, even more recent ones, are retained. 

    From DateEnter a date. PhixFlow removes
    stream sets
    recordsets whose period start date is more recent than the specified date.
    Rollback all dataPhixflow removes all
    stream sets
    recordsets for this
    stream
    table.
    Keep old
    Stream sets
    Recordsets

    This box is ticked by default.

    Insert excerpt
    _check_box_tick
    _check_box_tick
    nopaneltrue
     to rollback the data but to keep

    the stream set

    the recordset itself. In the

    stream set

    recordset list, the

    stream set

    recordset is empty and marked incomplete.

    Insert excerpt
    _check_box_untick
    _check_box_untick
    nopaneltrue
     to delete the

    stream set

    recordset. Both the data and the

    stream set

    recordset itself are removed from the

    stream set

    recordset list. You cannot repopulate deleted

    stream sets

    recordsets.

    Insert excerpt
    _dialog_cancel
    _dialog_cancel
    nopaneltrue
    Close the window without running rollback.
    Insert excerpt
    _dialog_finish
    _dialog_finish
    nopaneltrue
    Run the rollback process, then click Yes to confirm.

    Example Rollback

    When testing an analysis model it is likely you will read and clear all the data frequently, in this instance you would use the following configuration:

    Image Added

    Understanding Repeat Cycles 
    Anchor
    #cycles
    #cycles

    Whenever an analysis model is run it will carry out a number of tasks e.g. read a number of files, generate a number of recordsets, export a number of files.

    You can configure an analysis model so that in a single analysis session it actually runs several times. When a model is configured in this way, each run is called a cycle. All of the items processed or generated during that cycle (i.e. the files processed, recordsets created, files exported etc) are flagged with the cycle number.

    Details about the rollback process are displayed in the console

    This cycle number is visible in the Log File for that analysis run on each of the relevant tabs showing files and stream sets processed.

    The most common reason for configuring a model in this way is to allow a number of files to be processed in a single analysis session but to have the results from each file saved in a separate recordset. In this way, whenever a file fails to process, you can simply rollback the recordsets associated with that file rather than rolling back all of the recordsets associated with all of the files for the whole analysis session.

    To configure a model to run multiple times in one analysis session:

    1. At the start of the model, configure the file collector to process a single file at a time.
    2. At the end of the model, from the final table create a push pipe that points back to the final table. 
    3. In the push pipe, set positive offsets.

    When you run analysis on the model:

    1. The file collector reads in one file.
    2. PhixFlow then processes all tables in the model, generating a recordset for each table.
    3. Each recordset, and any associated output file, is flagged with the cycle number 1.
    4. When the last table in the model has finished producing its recordset, it sends a notification to itself down the push pipe.
    5. Due to the positive offset in the push pipe, the notification is the signal to create another recordset, so the whole model runs again. This time, recordsets and other output files are flagged with cycle number 2.

    In the log files you can see which items were processed in which cycle. For rolling back analysis runs, you can choose how many cycles to roll back. In the case where the last file processed was unsuccessful, you can choose to only roll back the last cycle.

    From the System Console → Task Logs tab → Recordsets you can see the cycle number associated with each recordset. You have options to rollback data to repeat analysis for specific cycles.

    Anchor
    rerun
    rerun
    Repopulating Incomplete

    Stream Sets

    Recordsets

    If you rollback data due to errors, you can repopulate an incomplete

    stream set

    recordset with the correct data. This is because the all

    stream sets

    recordsets in a model that were created during the same analysis run have the same Run ID. PhixFlow can use the run ID to pull the correct data into an incomplete

    stream

    table.

    Tip

    Make sure you have corrected any problems that caused the error before repopulating the

    stream set

    recordset with data.

    To repopulate an incomplete

    stream set

    recordset:

    1. Go to the console.
    2. Find the log messages related to rollback.
    3. Right-click the log message and in the Rollback window, select Repeat to reinstate data
    ; see Rollback or Repeat Cycles
    1. .

    For information about rerunning incomplete

    stream sets

    recordsets in an transactional

    stream

    table; see the 

    Stream Set List

    Managing Recordsets → Reprocess

    StreamSet

    Recordset option.

    Insert excerpt
    _terms_changing
    _terms_changing
    nopaneltrue