...
The older data is deleted when you run a stream-data-delete task that acts on the stream; see When setting up Using Tasks and Task Plans and Task.
You can set up a stream-data-delete task , it must havewith:
- either one or more stream addedspecific streams. You may choose to do this, for example:
- to manage the data in several related streams
- to run frequently on a stream that contains a large amount of data.
- to run occasionally to manage on streams with low volumes of data that change rarely.
- or have the All Streams option ticked. The task will run on all streams:
- that are not in another stream-data-delete task
- and have Data Retention Settings configured.
...
Managing Full Stream Sets
| Anchor | ||||
|---|---|---|---|---|
|
...
The table below assumes the stream to be archived following table shows the different combinations of settings possible in stream properties → Data Retention Settings. It assumes that a stream currently contains 8 stream sets. Two :
- 2 from the current
...
- day
- 1 from each of the previous 6 days.
In the table below the value null refers to the fact that The values are:
- N: a number of days
- X: a number of stream sets
null: indicates no value has been entered
...
for this
...
option.
...
| Tip |
|---|
PhixFlow always retains the maximum number of active and superseded stream sets in the data |
...
, so that no conflicting stream sets will be |
...
deleted. |
| Archive After X Days | Keeping Latest Y StreamSets | Resulting Streams Archived/Retained |
|---|---|---|
| null | null | No stream sets will be archiveddeleted. |
| 0 | null | All stream sets will be archivedbe deleted. |
| 1 | null | The last day of valid steam sets will be retained. All earlier stream sets will be archiveddeleted. In our example the 2 latest stream sets will be retained with the earliest 6 stream sets archiveddeleted. |
| XN | null | All stream sets which are older than X than N days before the latest valid stream set will be archiveddeleted. |
| null | 0 | All stream sets will be archivedbe deleted. |
| null | 1 | The last valid stream set will be retained, all other stream sets will be archivedbe deleted. |
| null | YX | The most recent Y valid stream sets will be retained, all others stream sets will be archiveddeleted. |
| 0 | 0 | All stream sets will be archivedbe deleted. |
| 0 | 1 | The last valid stream set will be retained, all other stream sets will be archivedbe deleted. |
| 1 | 0 | The last day of valid steam sets will be retained. All earlier stream sets will be archived. |
| 1 | 1 | The last day of valid steam sets will be retained regardless of if there are more than 1. If there are no stream sets in the last day then the first previous stream set will be retained instead. |
| N | XY | Will retain the maximum active stream sets in the data such that no conflicting stream sets will be archiveddeleted. |
Superseded Stream Sets
| Anchor | ||||
|---|---|---|---|---|
|
...
In the case where only the Keep Superseded for X N Days and Keep Superseded for Y X StreamSets fields are populated, the same logic in the table above will apply to the superseded records. Note that again archiving will always retain the maximum superseded stream sets in the data such that no conflicting stream sets will be archived.
...