Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Overview

Use the stream attributes properties tab to specify the characteristics of the the data in a table column.  

...

FieldDescription
Indexed

Insert excerpt
_check_box_ticked
_check_box_ticked
nopaneltrue
 to index this attribute in the underlying database.

To improve performance, index an attribute when the stream has a large data set and an output pipe from the stream uses this attribute to:

  • filter the stream data
  • sort or group the stream data.
Filter conditions are
case-independent by default

Insert excerpt
_check_box_ticked
_check_box_ticked
nopaneltrue
 to set new filter conditions on this attribute to be case-insensitive by default. The filter window → Ignore Case check box inherits this setting; see Filters on Data Views. For case-insensitive filters, there is no difference if the attribute is also indexed. 

Note
This option affects the behaviour of filters for PhixFlow instances running on Oracle or MariaDB (MySQL) databases.
For PhixFlow instances running on a SQL Server database, filters are always case-independent.


Key

Insert excerpt
_check_box_ticked
_check_box_ticked
nopaneltrue
 for in-memory streams, to specify that this field will be used as a key value. 

Cache Key

Enter an expression to be evaluated for each stream item (data record) in the stream. The expression can

  • either use the value of this attribute
  •  or calculate a different value

Once calculated, the cache key value persists throughout subsequent stream calculation, rather than being created from scratch for each stream item as normal. This allows you to keep track of the calculation as it progresses.

This means you can use a "persistent" attribute value in other expressions. 

CHECK THIS

...

Which fields can have "null"?

String

Apply a string type to sequences of characters (i.e., letters, numerals, symbols and punctuation marks). By default string attribute types have a fixed length of 50. The minimum length is 1 and the maximum length is 4000.

do we need to tell users about any information-loss if data that is naturally a different type gets loaded as a string?

Anchor
Bigstring
Bigstring
Bigstring

...

The maximum bigstring size can be configured in System Configuration → System Tuning → Maximum Bigstring Size.

Integer

Apply an integer type to whole numbers (not a fractions or decimals) that can be positive, negative, or zero. 

What happens if you attempt to load a float or decimal number into an integer attribute? If you store a number with decimal places as an integer it will be truncated.

...

Note

Ensure your decimal type has the number of decimal places you need for your data. Once the data is loaded into PhixFlow, you will not be able to recover excess decimal places.

Date

Apply a date type to representations of a calendar day.

Are there any specific formats to say are recognised/not recognised?

What about word formats e.g. Word formats, such as Tuesday the fourteenth of February? Words are  are not recognised except . However, three letter month abbreviations eg are recognised, for example: 14 Feb 2019 is accepted.

"yyyyMMdd",
"dd/MM/yy",
"dd MM yy",
"dd-MM-yy",
"MM/dd/yy",
"MM dd yy",
"MM d yy",
"MM-dd-yy"

"dd/MMM/yy",
"dd-MMM-yy",
"dd MMM yy",
"MMM/dd/yy",
"MMM-dd-yy",
"MMM dd yy",
"MMM d yy"

"dd/MM/yyyy",
"dd-MM-yyyy",
"dd MM yyyy",
"MM/dd/yyyy",
"MM-dd-yyyy",
"MM dd yyyy",
"MM d yyyy"

"dd-MMM-yyyy",
"dd/MMM/yyyy",
"dd MMM yyyy",
"MMM/dd/yyyy",
"MMM-dd-yyyy",
"MMM dd yyyy",
"MMM d yyyy"
The following date formats, have:

  • y represents year digits
  • M represents month digits or MMM represents three letters
  • d represents day digits
  • separators can be forward slash / hyphen - or a space.

Recognised Date Formats

  • the international standard format has not separators and is yyyyMMdd, for example 20190214. 
  • the following variations (examples shown with space separators).
14 02 201914 Feb 201902 14 2019Feb 14 2019
dd/MM/yyyydd-MMM-yyyyMM/dd/yyyyMMM/dd/yyyy
dd-MM-yyyydd/MMM/yyyyMM-dd-yyyyMMM-dd-yyyy
dd MM yyyydd MMM yyyyMM dd yyyyMMM dd yyyy


MM d yyyyMMM d yyyy
14 02 1914 Feb 1902 14 19Feb 14 19
dd/MM/yydd/MMM/yyMM/dd/yyMMM/dd/yy
dd MM yydd-MMM-yyMM-dd-yyMMM-dd-yy
dd-MM-yydd MMM yyMM dd yyMMM dd yy


MM d yyMMM d yy

Datetime

Apply a datetime type to representations of a day and a time. It cannot be used to represent a time alone.

Are there any specific formats to say are recognised/not recognised?

datetime must be day and time, can't be just a time.

Same formats as for date but with Datetimes can have any of the above date formats followed by a space separator and HH:mm:ss on the end.

"yyyyMMdd.HHmmss"

"dd/MM/yy HH:mm:ss",
"dd-MM-. for example MM/dd/yy HH:mm:ss",
"dd MM yy HH:mm:ss",
"MM/dd/yy HH:mm:ss",
"MM-dd-yy HH:mm:ss",
"MM dd yy HH:mm:ss",
"MM d yy HH:mm:ss"

"dd/MMM/yy HH:mm:ss",
"dd-MMM-yy HH:mm:ss",
"dd MMM yy HH:mm:ss",
"MMM/dd/yy HH:mm:ss",
"MMM-dd-yy HH:mm:ss",
"MMM dd yy HH:mm:ss",
"MMM d yy HH:mm:ss"

"dd/MM/yyyy HH:mm:ss",
"dd-MM-yyyy HH:mm:ss",
"dd MM yyyy HH:mm:ss",
"MM/dd/yyyy HH:mm:ss",
"MM-dd-yyyy HH:mm:ss",
"MM dd yyyy HH:mm:ss",
"MM d yyyy HH:mm:ss"

"dd/MMM/yyyy HH:mm:ss",
"dd-MMM-yyyy HH:mm:ss",
"dd MMM yyyy HH:mm:ss",
"MMM/dd/yyyy HH:mm:ss",
"MMM-dd-yyyy HH:mm:ss",
"MMM dd yyyy HH:mm:ss",
"MMM d yyyy HH:mm:ss"

Graphic

Is this still available?

TrueFalse

Apply a TrueFalse type to fields that can have the values true or false.

What happens if the field is empty? Or has something other than True/False?

The value saved is always true or false. It is true if it is a number other than 0, the string "true", "t", "yes", "y" (case insensitive), or for a list if all items in the list are true. Anything else is false, so empty/null is false. represents a datetime such as 02/14/19 15:35:06.

  • H represents hour digits (24 hour)
  • m represents minute digits
  • s represents second digits
  • time separators are colons :

The international datetime uses a full stop/period as a separator between the date and time, yyyyMMdd.HHmmss, for example 20190214.15:35:06.

Graphic

Is this still available?

TrueFalse

Apply a TrueFalse type to fields that can have the values true or false.

The values that are saved as true are:

  • any number other than 0
  • for a list: all items in the list are true
  • the following case-insensitive strings
  • true
  • t
  • yes
  • y

The values that are saved as false are:

  • 0 (zero)
  • any string not listed as true above
  • an empty/null field