Regular expressions provide a powerful way of matching patterns, in essence anything other than a simple string literal.
When you enter a regular expression in a PhixFlow field, remember that it must be contained inside "quotes", except where you are using PhixFlow variables that contain strings, or functions that return strings.
Finding File Names
Regex | Purpose |
---|---|
"inputFile_[0-9]{3}\\.txt" |
...
Match file names |
...
with the format: inputFile_NNN. |
...
txt e.g. |
...
inputFile_034.txt where N are digits. |
"inputFile_ |
...
[0-9]{3}\\.txt" |
...
Match file names |
...
with the format: inputFile_ |
...
NNN.txt eg. inputFile_034.txt where N are digits. |
"inputFile_" + $fileSeq + "\\.txt" |
...
Match file names |
...
with the format: inputFile_$fileSeq. |
...
txt e. |
...
g. |
...
inputFile_034.txt where $fileSeq="034" |
Regex Arguments in Expressions
Code Block |
---|
if(!matches(value,"[\\p{Alnum}\\p{Space}]+" |
...
Regular expressions are seen throughout many languages (C, Java, Perl) and unix shells. PhixFlow regular expressions follow the common rules of POSIX regular expressions to a great extent; specification for the elements of regular expressions are given below. Useful examples of regular expressions are found in replaceAll, replaceFirst, matches.
In PhixFlow, to escape a character you must use two backslashes: \\, e.g. \\n for a new line. To match a backslash in the data you are matching, you will need four backslashes: \\\\ in your regular expression. See below for details.
Regular expression constructs, and what they match
...
),error('Please only enter alpha numeric characters') |
Checks whether any characters are not (!)
alphanumeric characters or spaces. If any are not, matches() will evaluate to 1, and the error message will be presented. The +
is a greedy quantifier, so it can match more than once. This means value
can contain as many alphanumeric characters or spaces as it likes, so long as it does not contain anything else.
Code Block |
---|
$xml = replaceAll($xml, "<sc_tower_torqueing/type><id.*?<name>", "<type>"),
$xml = replaceAll($xml, "</name></sc_tower_torqueing/type>", "</type>"), |
The first line matches text with the pattern:
-
sc_tower_torqueing/type><id.
- followed by
any character, indicated by the wildcard *
- however many times it appears, indicated by
?
- followed by the text
<name>
to finish.
Any matching pattern is changed to the text <type>
.
The second line matches the exact text </name></sc_tower_torqueing/type>
and changes any occurrence to “</type>". As the exact text is known, this does not require a regex.
Escaping Special Characters
Anchor | ||||
---|---|---|---|---|
|
In a regex, some characters, called meta-characters, have special meanings. For example quote marks “
mark the the start and end of a string; see Regular expression metacharacters for a full list and their functions. To use a meta-character as if it is a normal character, use an escape character so that the regex can ignore its special meaning.
Use | To escape | For example | |
---|---|---|---|
2 backslashes | \\ |
|
|
3 backslashes | \\\ | a backslash quote marks | \\\\ \\\" |
For example, the following regex shows some characters are escaped and some are not.
Code Block |
---|
replaceAll(JSON Code,"[^\\p{Space}0-9A-Za-z!:\\\"%&\\[*()\\],-/_\\\\{}\\.]","") |
This regex checks text to make sure it does not contain any unusual characters by defining a list of allowed characters:
- paragraph end marks:
\\p
- spaces:
{Space}
- numbers 0-9:
0-9
- uppercase or lowercase alphabetic characters:
A-Za-z
- other characters:
! :
% &
* ( ) ,
- / _ { }
- special characters, preceded by backslashes to escape them:
" [ ] \
.
Characters with special meaning are:
- quotes and square brackets:
“[
and]"
indicate the start and the end of the string - caret
^
This regex ignores any of the allowed characters. If it finds any character not in the list, it replaces them with nothing, indicated by ""
.
Tip |
---|
A double backslash \\ can also make an alphanumeric character a construct. For example, \\n means newline; see Characters below. Escaping an alphabetic character that does not form construct causes an error. |
For information about escaping characters in PhixFlow expressions, rather than in a regex, see Text Expressions and Escape Characters.
Groups and Capturing
Anchor | ||||
---|---|---|---|---|
|
Capturing groups are numbered by counting their opening parentheses from left to right. For example, ((A)(B(C)))
contains 4 groups:
1 | ((A)(B(C))) |
---|---|
2 | (A) |
3 | (B(C)) |
4 | (C) |
Group zero always stands for the entire regex.
During a match, each sub-sequence of the input sequence that matches a group is saved. The captured sub-sequence may be used later in the regex, via a back reference. In PhixFlow, a back reference has the format $n
, where n
is the number of the capturing group; replaceFirst for some examples.
The captured input associated with a group is always the sub-sequence that the group most recently matched. If a group is evaluated a second time because of a quantifier, then any previously captured value is retained if the second evaluation fails. For example, matching the string "aba"
against the regex (a(b)?)+
leaves group two set to "b
". All captured input is discarded at the beginning of each match.
Groups beginning with (?
are pure, non-capturing groups that do not capture text and do not count towards the group total.
Character Constructs
Anchor | ||||
---|---|---|---|---|
|
The following table shows the different characters and what they match.
Characters
Construct | Matches |
---|---|
x | The character x |
\\\\ | The backslash character |
\\/ | The forward slash character |
\\\" | The double quote character |
\\0n | The character with octal value 0n (0 <= n <= 7) |
\\0nn | The character with octal value 0nn (0 <= n <= 7) |
\\0mnn | The character with octal value 0mnn (0 <= m <= 3, 0 <= n <= 7) |
\\xhh | The character with hexadecimal value 0xhh |
\uhhhh | The character with hexadecimal value 0xhhhh |
\\t | The tab character ('\u0009') |
\\n | The newline (line feed) character ('\u000A') |
\\r | The carriage-return character ('\u000D') |
\\f | The form-feed character ('\u000C') |
\\a | The alert (bell) character ('\u0007') |
\\e | The escape character ('\u001B') |
\\cx | The control character corresponding to x |
Character
...
Classes
Construct | Matches |
---|---|
[abc] | a, b, or c (simple class) |
[^abc] | Any character except a, b, or c (negation) |
[a-zA-Z] | a through z or A through Z, inclusive (range) |
[a-d[m-p]] | a through d, or m through p: [a-dm-p] (union) |
[a-z&&[def]] | d, e, or f (intersection) |
[a-z&&[^bc]] | a through z, except for b and c: [ad-z] (subtraction) |
[a-z&&[^m-p]] | a through z, and not m through p: [a-lq-z](subtraction) |
Predefined |
...
. | Any character |
...
wildcard This may or may not match line terminators |
...
\\d | A digit: [0-9] |
\\D | A non-digit: [^0-9] |
\\s | A whitespace character: [ \\t\\n\\x0B\\f\\r] |
\\S | A non-whitespace character: [^\\s] |
\\w | A word character: [a-zA-Z_0-9] |
\\W | A non-word character: [^\\w] |
Line Terminators
Anchor | ||||
---|---|---|---|---|
|
A one- or two-character sequence that marks the end of a line of the input character sequence.
Construct | Indicates |
---|
...
\\n | newline (line feed) |
\\r | carriage-return |
\\r\\n | carriage-return followed immediately by a newline |
\\u0085 | next-line |
\\u2028 | line-separator |
\\u2029 | paragraph-separator |
POSIX Classes
(US-ASCII only)
Construct | Matches |
---|---|
\\p{Lower} | A lower-case alphabetic character: [a-z] |
\\p{Upper} | An upper-case alphabetic character:[A-Z] |
\\p{ASCII} | All ASCII:[\\x00-\\x7F] |
\\p{Alpha} | An alphabetic character:[\\p{Lower}\\p{Upper}] |
\\p{Digit} | A decimal digit: [0-9] |
\\p{Alnum} | An alphanumeric character:[\\p{Alpha}\\p{Digit}] |
\\p{Punct} | Punctuation: One of !"#$%&'()*+,-./:;<=>?@[\]^_`{|}~ |
\\p{Graph} | A visible character: [\\p{Alnum}\\p{Punct}] |
\\p{Print} | A printable character: [\\p{Graph}] |
\\p{Blank} | A space or a tab: [ \\t] |
\\p{Cntrl} | A control character: [\\x00-\\x1F\\x7F] |
\\p{XDigit} | A hexadecimal digit: [0-9a-fA-F] |
\\p{Space} | A whitespace character: [ \\t\\n\\x0B\\f\\r] |
...
Unicode Classes
Construct | Matches |
---|---|
\\p{InGreek} | A character in the Greek block (simple |
...
block) | |
\\p{Lu} | An uppercase letter (simple |
...
category) | |
\\p{Sc} | A currency symbol |
\\P{InGreek} | Any character except one in the Greek block (negation) |
[\\p{L}&&[^\\p{Lu}]] | Any letter except an uppercase letter (subtraction) |
...
Unicode Characters
Construct | Matches |
---|---|
\x{20ac} | The Euro symbol € |
\x{1f914} | An emoji character 🤔 |
Boundaries
Construct | Matches |
---|---|
^ | The beginning of a line |
$ | The end of a line |
\\b | A word boundary |
\\B | A non-word boundary |
\\A | The beginning of the input |
\\G | The end of the previous match |
\\Z | The end of the input but for the final |
...
, if any | |
\\z | The end of the input |
...
Back References
Construct | Matches |
---|---|
$n | Whatever the nth capturing group matched; see Groups and Capturing, above. |
Quantifiers
Construct | Matches | ||
---|---|---|---|
Greedy longest possible match | Reluctant (lazy) | ||
X? | X?? | X?+ | X, once or not at all |
X* | X*? | X*+ | X, zero or more times |
X+ | X+? | X++ | X, one or more times |
X{n} |
...
X |
...
{n |
...
}? | X{n |
...
} |
...
+ | X, |
...
exactly n times |
X{n, |
...
} |
...
X |
...
{n,}? | X{n,}+ | X, |
...
at least n times |
X{n,m} |
...
X |
...
{n,m}? | X{n,m}+ | X, at least n but not more than m times |
Logical
...
Operators
Construct | Matches |
---|---|
XY | X followed by Y |
X|Y | Either X or Y |
(X) | X, as a |
...
capturing group; see Groups and Capturing, above. |
Special Constructs
(Non-capturing)
Construct | Matches |
---|---|
(?:X) | X, as a non-capturing group |
(?idmsux-idmsux) | Nothing, but turns match flags on - off |
(?idmsux-idmsux:X) |
...
X, as a |
...
non-capturing group with the given flags on - off; see Groups and Capturing, above. | |
(?=X) | X, via zero-width positive lookahead |
(?!X) | X, via zero-width negative lookahead |
(?<=X) | X, via zero-width positive lookbehind |
(?<!X) | X, via zero-width negative lookbehind |
(?>X) | X, as an independent, non-capturing group |
...
Quotation
...
A double backslash \\ either makes an alphanumeric character a contruct (e.g. \\n means newline), or allows a special character to be quoted (e.g. use \\{ if you want to match the { character). If you escape an alphabetic character that is not a construct when escaped, you will get an error.
...
A line terminator is a one- or two-character sequence that marks the end of a line of the input character sequence. The following are recognized as line terminators:
- A newline (line feed) character ('\\n'),
- A carriage-return character followed immediately by a newline character ("\\r\\n"),
- A standalone carriage-return character ('\\r'),
- A next-line character ('\\u0085'),
- A line-separator character ('\\u2028'), or
- A paragraph-separator character ('\\u2029).
...
Capturing groups are numbered by counting their opening parentheses from left to right. In the expression ((A)(B(C))), for example, there are four such groups:
1 | ((A)(B(C))) |
---|---|
2 | (A) |
3 | (B(C)) |
4 | (C) |
Group zero always stands for the entire expression.
During a match, each sub-sequence of the input sequence that matches a group is saved. The captured sub-sequence may be used later in the expression, via a back reference. In PhixFlow, a back reference has the format $n, where n is the number of the capturing group. See examples for replaceFirst.
The captured input associated with a group is always the sub-sequence that the group most recently matched. If a group is evaluated a second time because of a quantifier then its previously captured value, if any, will be retained if the second evaluation fails. Matching the string "aba" against the expression (a(b)?)+, for example, leaves group two set to "b". All captured input is discarded at the beginning of each match.
...
Construct | Matches |
---|---|
\\ | Nothing, but quotes the following character |
\\Q | Nothing, but quotes all characters until \\E |
\\E | Nothing, but ends quoting started by \\Q |