Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Insert excerpt
_Banners
_Banners
nameanalysis
nopaneltrue

Introduction

Overview

Each time you run analysis on a model, PhixFlow creates a new set of data, called a recordset, for each streamnon-transactional table. You can view this data by right-clicking on a table on an analysis model and selecting 

Insert excerpt
_record_setsrecordsets_show
_record_setsrecordsets_show
nopaneltrue
see Managing Recordsets for more options.

Recordsets remain available until you run an archive task on the streamtable; see Task

This has been removed as it doesnt add value the options are explained below?

Either rollback deletes the specified stream set(s).
You cannot repopulate a deleted stream set.
Use this approach when you want to completely discard a stream set. When you next run analysis, PhixFlow creates a new stream set with the latest data.
  • Or rollback deletes the data but keeps the stream set itself. Tick the Keep old stream sets option to use this option.
    The stream set remains on the stream set list, marked as incomplete. You can repopulate an incomplete stream.
    Use this approach when you want to fix the data in a stream set. When you next run analysis, PhixFlow repopulates the incomplete stream set; see Repopulating Incomplete Stream Sets, below. 
  • Rollback data

    To rollback data you need to open the rollback window, you can access this from several  or rollback back the recordsets. 

    From the System Console → Task Logs tab → Recordsets you can select an option to rollback or to repeat analysis where the analysis run generated a number of cycles; see Understanding Cycles, below.

    How To Rollback Recordsets

    For non-transactional tables, which have a Period of Daily, Monthly or Variable, you can back out the changes to data caused by an analysis run. This resets the data to a previous recordset.

    Warning

    Do not roll back recordsets in transactional tables.
    For tables with a Period of Transactional individual records are updated overtime. For example, application users make individual edits to records in the table. This means PhixFlow cannot rollback to a recordset in all tables where the data is consistent.

    To rollback to an earlier recordset, open the rollback window from one of the following places:

    • In a model: right-click on a stream table icon and select 
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       StreamTable.
    • In the repository: right-click on a stream table name and select   select  
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       StreamTable.
    • In the repository: use Ctrl+click to select multiple streams tables, right-click one of the stream table names and select   select  
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       Selected Objects.
    • In a list of stream setsrecordsets: select one or more stream setsrecordsets, then right-click on one stream set recordset and select
      Insert excerpt
      _rollback
      _rollback
      nopaneltrue
       StreamSetRecordset. PhixFlow automatically populates the data for the rollback options, as it knows the properties of the selected stream setrecordset(s).
    • In the System Console → Task Logs tab → Recordsets , select rollback.for a recordset.

    PhixFlow opens the Rollback window where you can configure the rollback. 

    During the rollback process, PhixFlow displays details in the console. For large data sets, it may take some time to rollback all the data in a recordset.

    Anchor
    options
    options
    Rollback Window Options

    In the Rollback window, select an option and specify the stream sets recordsets to rollback.

        

    OptionDescription
    Rollback a number of
    StreamSets
    RecordsetsEnter the number of
    stream sets
    recordsets to roll back. PhixFlow removes this number of
    stream sets
    recordsets, starting with the most recent.
    Rollback to a specific run

    Enter the run ID of a

    stream set

    recordset to which you want to rollback. You can find the run IDs in the Managing Recordsets. PhixFlow removes all the

    streams

    tables from the most recent, up to and including the specified run ID.

    For a transactional

    stream

    table, PhixFlow removes the specified run ID only. All other

    stream sets

    recordsets, even more recent ones, are retained. 

    From DateEnter a date. PhixFlow removes
    stream sets
    recordsets whose period start date is more recent than the specified date.
    Rollback all dataPhixflow removes all
    stream sets
    recordsets for this
    stream
    table.
    Keep old
    Stream sets
    Recordsets

    This box is ticked by default.

    Insert excerpt
    _check_box_tick
    _check_box_tick
    nopaneltrue
     to rollback the data but to keep

    the stream set

    the recordset itself. In the

    stream set

    recordset list, the

    stream set

    recordset is empty and marked incomplete.

    Insert excerpt
    _check_box_untick
    _check_box_untick
    nopaneltrue
     to delete the

    stream set

    recordset. Both the data and the

    stream set

    recordset itself are removed from the

    stream set

    recordset list. You cannot repopulate deleted

    stream sets

    recordsets.

    Insert excerpt
    _dialog_cancel
    _dialog_cancel
    nopaneltrue
    Close the window without running rollback.
    Insert excerpt
    _dialog_finish
    _dialog_finish
    nopaneltrue
    Run the rollback process, then click Yes to confirm
    .

    Details about the rollback process are displayed in the console.

    For large data sets, it may take some time to rollback all the data in a stream set.

    .

    Example Rollback

    When testing an analysis model it is likely you will read and clear all the data frequently, in this instance you would use the following configuration:

    Image Added

    Understanding Repeat Cycles 
    Anchor
    #cycles
    #cycles

    Whenever an analysis model is run it will carry out a number of tasks e.g. read a number of files, generate a number of recordsets, export a number of files.

    You can configure an analysis model so that in a single analysis session it actually runs several times. When a model is configured in this way, each run is called a cycle. All of the items processed or generated during that cycle (i.e. the files processed, recordsets created, files exported etc) are flagged with the cycle number. This cycle number is visible in the Log File for that analysis run on each of the relevant tabs showing files and stream sets processed.

    The most common reason for configuring a model in this way is to allow a number of files to be processed in a single analysis session but to have the results from each file saved in a separate recordset. In this way, whenever a file fails to process, you can simply rollback the recordsets associated with that file rather than rolling back all of the recordsets associated with all of the files for the whole analysis session.

    To configure a model to run multiple times in one analysis session:

    1. At the start of the model, configure the file collector to process a single file at a time.
    2. At the end of the model, from the final table create a push pipe that points back to the final table. 
    3. In the push pipe, set positive offsets.

    When you run analysis on the model:

    1. The file collector reads in one file.
    2. PhixFlow then processes all tables in the model, generating a recordset for each table.
    3. Each recordset, and any associated output file, is flagged with the cycle number 1.
    4. When the last table in the model has finished producing its recordset, it sends a notification to itself down the push pipe.
    5. Due to the positive offset in the push pipe, the notification is the signal to create another recordset, so the whole model runs again. This time, recordsets and other output files are flagged with cycle number 2.

    In the log files you can see which items were processed in which cycle. For rolling back analysis runs, you can choose how many cycles to roll back. In the case where the last file processed was unsuccessful, you can choose to only roll back the last cycle.

    From the System Console → Task Logs tab → Recordsets you can see the cycle number associated with each recordset. You have options to rollback data to repeat analysis for specific cycles.

    Anchor
    rerun
    rerun
    Repopulating Incomplete

    Stream Sets

    Recordsets

    If you rollback data due to errors, you can repopulate an incomplete stream set recordset with the correct data. This is because the all stream sets recordsets in a model that were created during the same analysis run have the same Run ID. PhixFlow can use the run ID to pull the correct data into an incomplete streamtable.

    Tip

    Make sure you have corrected any problems that caused the error before repopulating the stream set recordset with data.

    To repopulate an incomplete stream setrecordset:

    1. Go to the console.
    2. Find the log messages related to rollback.
    3. Right-click the log message and in the Rollback window, select Repeat to reinstate data; see Rollback or Repeat Cycles Window.

    For information about rerunning incomplete stream sets recordsets in an transactional streamtable; see the Managing Recordsets → Reprocess StreamSetRecordset option.

    Insert excerpt
    _terms_changing
    _terms_changing
    nopaneltrue