Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

It is often useful to read a local or network directory and populate a PhixFlow stream with the names of the files. This can be used as a reference list for subsequent processing and can also form the basis of a duplicate detection pattern, ensuring that files are not processed mor more than once. The examples below show how to read the entire folder contents, as well as just speciifc specific file types.The model for these examples is 004 Read a List of Files in a Directory

Example 1: Read all files

...

  1. Add a File Collector to the model and confiure configure it as follows:
    1. Source Type = Specified Directory
    2. File Type = File Details Only
    3. File Location Strategy = All Files in Folder
    4. Input Directory Expression = Enter the name of the folder relative to the Import File Locaion Location in  System System Configuration. Put the folder name in double quotes e.g. "Data Files"
    5. File Pattern Expression = ".*." (This will read all file types)
  2. Make sure the Enabled and Allow on-Schedued Scheduled collection checkboxes are checked and then save and close the file colletorcollector
  3. Hover over the file collector and select Add a New Stream
  4. Add an attribute to the stream to hold the fie name and enter the expression "in._fileName" without the quotes.
  5. Run analysis on the stream and view the filenames

File Collector Configuration

 

Attribute Expression to Read Filename

...

 Example Folder and Results in PhixFlow

...

  1. Copy the file collector and stream using the following steps:
    1. Hold  down down shift and selecting the two objects by left-clicking on them
    2. Select Copy Selected Object
  2. Modify the Input Directory Expression on the new stream to  to ".*.csv" (This will read all files of type csv)
  3. Make sure the Enabled is  checked  is checked and then save and close the file collector
  4. Run analysis on the stream and view the filenames for the csv files

Copying Multiple PhixFlow Objects

  

Modified Expression to read just the CSV files

 

...

Mode Ref: 004

Filter by label (Content by label)
showLabelsfalse
max5
spacesHELP70
showSpacefalse
sortmodified
reversetrue
typepage
cqllabel = "kb-how-to-article" and type = "page" and space = "HELP70"
labelskb-how-to-article

...