Introduction

When you are creating models, there are common scenarios that occur. You can create bits of models, called  "patterns" to use in these scenarios.  You can then re-use the model patterns whenever the scenario occurs. Patterns can be:

• controls
• groups of controls
• portions of models.

A pattern is any solution that is useful and reusable, from very simple methods to more sophisticated model-fragments.

This topic contains pattern suggestions for some common modelling scenarios.

• Using a Calculate Table
• Add Attributes with Calculated Data
• Calculate an Average
• Data Import Scenarios
  • Check Database Space Being Used
  • Load a Subset of Data from a Database
  • Import Binary Files
  • Import Data From the Web
  • Import and Export Data to a Database
  • Manage Unsorted Data Using an In-Memory Table
  • Speed Up Data Loading Using Parallel Collectors
  • Migrating Data From Another System
• Merging or Combining Data
  • Merging Similar Data Sets
  • Merging Two Data Sets
  • Combining Data Using a Lookup Pipe
  • Deduplicating Similar Data Sets
• Splitting Data
  • Combining Data Using a Cache Extraction Filter Lookup Pipe
  • Break an SQL IN Clause Into Batches
  • Create Unique Indexes or Record Identifiers
  • Filter Values in a Lookup Pipe
  • Process Separate Files into Separate Tables
  • Reconcile Invoices
  • Use a Master List
• Compare or Match Data
  • Check Generated Files
  • Compare Two Files
  • Inexact Match for DateTimes
  • Inexact Match for Strings
  • Inexact Match Tables
  • Remove Duplicates
• Enrich Data
• Using Filters And Order/Index Lookup
• Difference Between Filter and Order/Index Lookups