Insert excerpt | ||||||||
---|---|---|---|---|---|---|---|---|
|
Scenario
In an Excel table, I can add a new column that contains a formula to calculate values using data on other columns. How do I do this in PhixFlow?
Concepts
In a PhixFlow analysis model, data is loaded into streams from external sources, such as files and databases. Usually we want to calculate additional values and use them in subsequent streams. Key concepts to be aware of:
There are one or more datasources that need to be extracted, transformed and loaded into a new target system.
Let's expand this simple model to include the areas where PhixFlow brings benefits
Solution
Extraction
PhixFlow can extract data from multiple sources, we recommend for the purposes of reconciliation that data be kept initially in its raw form with the exception of a PhixFlow UID being applied to records. The latter will allow you to handle duplicate entries. This raw data will form the baseline for the imported data, telling us how many records were provided and what data was provisioned.
Extraction
Processing typically consists of:
- Consolidation
- Transformation
- Enhancement and Enrichment
- Filtering
- Review
- Investigation
- Reconciliation