Details about the rollback process are displayed in the console.
For large data sets, it may take some time to rollback all the data in a stream setExample Rollback
When testing an analysis model it is likely you will read and clear all the data frequently, in this instance you would use the following configuration:
Understanding Repeat Cycles
Whenever an analysis model is run it will carry out a number of tasks e.g. read a number of files, generate a number of recordsets, export a number of files.
You can configure an analysis model so that in a single analysis session it actually runs several times. When a model is configured in this way, each run is called a cycle. All of the items processed or generated during that cycle (i.e. the files processed, recordsets created, files exported etc) are flagged with the cycle number. This cycle number is visible in the Log File for that analysis run on each of the relevant tabs showing files and stream sets processed.
The most common reason for configuring a model in this way is to allow a number of files to be processed in a single analysis session but to have the results from each file saved in a separate recordset. In this way, whenever a file fails to process, you can simply rollback the recordsets associated with that file rather than rolling back all of the recordsets associated with all of the files for the whole analysis session.
To configure a model to run multiple times in one analysis session:
- At the start of the model, configure the file collector to process a single file at a time.
- At the end of the model, from the final table create a push pipe that points back to the final table.
- In the push pipe, set positive offsets.
When you run analysis on the model:
- The file collector reads in one file.
- PhixFlow then processes all tables in the model, generating a recordset for each table.
- Each recordset, and any associated output file, is flagged with the cycle number 1.
- When the last table in the model has finished producing its recordset, it sends a notification to itself down the push pipe.
- Due to the positive offset in the push pipe, the notification is the signal to create another recordset, so the whole model runs again. This time, recordsets and other output files are flagged with cycle number 2.
In the log files you can see which items were processed in which cycle. For rolling back analysis runs, you can choose how many cycles to roll back. In the case where the last file processed was unsuccessful, you can choose to only roll back the last cycle.
From the System Console → Task Logs tab → Recordsets you can see the cycle number associated with each recordset. You have options to rollback data to repeat analysis for specific cycles.
Repopulating Incomplete Stream SetsRecordsets
If you rollback data due to errors, you can repopulate an incomplete stream set recordset with the correct data. This is because the all stream sets recordsets in a model that were created during the same analysis run have the same Run ID. PhixFlow can use the run ID to pull the correct data into an incomplete streamtable.
Tip |
---|
Make sure you have corrected any problems that caused the error before repopulating the stream set recordset with data. |
To repopulate an incomplete stream setrecordset:
- Go to the console.
- Find the log messages related to rollback.
- Right-click the log message and in the Rollback window, select Repeat to reinstate data; see Rollback or Repeat Cycles Window.
For information about rerunning incomplete stream sets recordsets in an transactional streamtable; see the Managing Recordsets → Reprocess StreamSetRecordset option.