This page is for data modellers who want to connect to data sources via HTTP.

Overview

An HTTP datasource is a modelling object whose properties provide the information needed to connect to an external source of data via HTTP. This may be a web site, a web service or some other target that allows XML, HTTP or text data to transferred over HTTP.

You must have one HTTP datasource for each HTTP location to which you need to connect. Each HTTP datasource must have at least one HTTP datasource instance. You can add several instances if you want to configure different settings.

In an analysis model, you can add:

• a HTTP Collector to load data from a site or service.
• a HTTP Exporter /wiki/spaces/HELP12/pages/9615616020 to update the site or service with processed data from the model.

The HTPP datasources you create appear in the Basic Settings → HTTP Datasource list in HTTP collector and HTTP exporter properties. In the properties for collectors and exporters, you can optionally specify the HTTP datasource instance using the Advanced → Datasource Instance Expression.

To add a new HTTP datasource to an analysis model:

1. Go to the model's toolbar → Create group.
2. Click

   Insert excerpt
   _http _http nopanel true

    to expand the menu.
3. Drag a 

   Insert excerpt
   _http_datasource _http_datasource nopanel true

    onto the analysis model.

To add an existing HTTP datasource to an analysis model, in the model diagram toolbar:

1. Go to the model toolbar → List group.
2. Click

   Insert excerpt
   _http _http nopanel true

    to expand the menu.
3. Click 

   Insert excerpt
   _http_datasource _http_datasource nopanel true

    to open the list of available HTTP datasources.
4. Drag a HTTP datasource into the analysis model.

HTTP Datasource 

Insert excerpt
_property_tabs _property_tabs name basic-h nopanel true

Basic Settings

Datasource Instance Details

This section has a toolbar with standard buttons/wiki/spaces/HELP12/pages/9615612941.

The grid contains a list of HTTP datasource instances that belong to this HTTP datasource. Each datasource defines the connection details to an HTTP target. A number of instances can be defined to allow for several connections under a single HTTP datasource. You must define at least one HTTP datasource Instance for each HTTP datasource.

Double-click on a row to open the HTTP datasource instance properties. 

To add a HTTP datasource to the list, click

To remove a datasource instance from the grid, use the toolbar button 

Secret Key Details

This section has a toolbar with standard buttons/wiki/spaces/HELP12/pages/9615612941.

The grid contains a list of the secret keys available to this datasource. A secret key is a way to securely store datasource authentication values; see Secret Key and Local Secret /wiki/spaces/HELP12/pages/9615611519. To use the secure values in HTTP collector or exporter expressions, refer to the secret key using:

_datasource.name

where name is the secret key name listed in this grid.

Rate Limiting

For /wiki/spaces/HELP12/pages/9615615875s this is per request and for /wiki/spaces/HELP12/pages/9615616020s this is per batch defined by its Commit Size setting

Advanced

HTTP Datasource Instance

Insert excerpt
_property_tabs _property_tabs name basic-h nopanel true

 

Anchor
instance instance

Basic Settings

In addition to the standard icons, the properties toolbar includes