Temporary Storage Connector
The temporary storage connector is accessed from the Connectivity tab of the design component palette:
This connector is used to first configure a temporary storage connection for access to temporary storage on the agent machine, and then to configure one or more temporary storage activities associated with that connection to use as a source or target within an operation or script:
- Read: Reads data from a local storage connection and is used as a source in an operation or a script.
- Write: Writes data to a local storage connection and is used as a target in an operation or a script.
Together, a specific temporary storage connection and its activities are referred to as a temporary storage endpoint. Once a connection is configured, activities associated with the endpoint are available from the Endpoints filter:
Cloud Agents that are version 10.10 or higher have a temporary storage file size limit of 50 GB per file. Those who need to create temporary files larger than 50 GB are encouraged to use Private Agents.
When using temporary storage in an environment associated with an Agent Group that contains multiple agents, it is important to be aware that a temporary storage endpoint connects to the particular agent machine that is running the operation with the associated temporary storage read or write activity.
However, all linked operations in an operation chain are run on the same agent. So as long as temporary storage is written to and read from within the same operation chain, use of the temporary storage connector is consistent and reliable.
CAUTION: If using more than one agent in an Agent Group, and an operation that is not in the same operation chain looks for a file in temporary storage, there is no way to determine whether the same agent and temporary storage location will be used.
Temporary Storage vs. Variable
There are several considerations to take into account when choosing between using a temporary storage endpoint and a variable endpoint. While using a variable can increase reuse and reduce complexity, variables should be used only when working with tiny data sets (such as those totaling under 7 KB).
Larger data sets need to be handled using temporary storage, as using variables can result in truncation. Note that there should be no degradation in performance when using temporary storage over variables in those use cases. In fact, with data sets greater than 4 MB, operation processing is faster with temporary storage as compared with variables.
Last updated: Nov 25, 2019
- No labels