Page tree
Skip to end of metadata
Go to start of metadata

DigitalRoute is constantly working on improving your experience with Usage Engine. Here is a summary of what has changed in the latest release of Cloud Edition as well as information on previous releases. 

Current version: 2.56.0

Release Date: 1 December 2022

2022
2.56.0

The GoTransverse Function is available for select customers that have requested this package. 

Cloud Edition has been updated to remedy bug fixes. 

November 2022
2.55.0

The Variable Insertion function has been updated with the deploy scope, supporting replicaNumber and lastReplicaNumber as possible targets.

The Amazon S3 collector function can use variable insertion on deploy when configuring the Bucket, Folder, and FileName fields. 

The SFTP function can use variable insertion on deploy when configuring the Path and FileName fields. 

2.53.0

In this version of Cloud Edition, the audit log collector has been updated to perform better under larger loads.

The backend audit server has been updated to mitigate potential issues during audit message batch execution. 

2.52.0

With this version Usage Engine introduces a new processor Function, Script Aggregator, that gives you more flexibility and control to perform advanced and complex data aggregation using JavaScript. Check out the documentation here

Script Aggregator Function Configuration View

Using Aggregation Inspector, you can now view and inspect different aggregation sessions created by a Script Aggregator Function as well. Check out the documentation here.

We are continuously working on improving the user experience by providing you with the latest updates. Part of such an endeavor is to keep the documentation live and up-to-date. 

October 2022
2.50.0

A bug has been resolved in the usage audit wherein in certain streams the users were unable to sort the shown data. 

The latest update has revamped some of the backend functionality so that further improvements can be made. 

2.49.0

The latest update has revamped some of the backend functionality so that further improvements can be made. 

2.48.0

The HTTP Client Function in its three forms Collector, Processor, and Forwarder now support Secrets Wallet credentials access for the OAuth 2.0 configuration. This makes configuration easier when creating streams. 

2.47.0

Improvements to the advanced aggregation include the ability to perform operations such as  SUM, COUNT, MAX, MIN, and Average. The addition of the Hours option allows for data to be flushed at an hourly rate. 

Significant performance updates have been made to the Usage Audit functionality. 

The latest update has revamped some of the backend functionality so that further improvements can be made. 

2.46.1

The latest update has revamped some of the backend functionality so that further improvements can be made. 

2.45.0

The latest update has revamped some of the backend functionality so that further improvements can be made. 

2.43.0
  • The Custom option for Timeout settings in the Data Aggregator is updated for better user experience.
  • Updated interface for Display Options and a minor UI fix for the Apply button in the Aggregation Inspector.
  • Added an alert to ensure that, when using multiple inputs for a Data Aggregator, the structure of the payloads is the same.
2.42.0

Improvements for higher record processing and large data volume by streams.

2.41.0

Fix for an issue that throws a memory limitation error when deduplicating large number of records in the stream. 

2.40.1

Minor fix for performance improvements.

2.40.0

Minor fixes that focus on stability improvements.

2.39.2

Fix to verify recipient emails when using Notification Groups.

2.39.1

Minor fixes focused on improving internal communication between various services.

2.39.0

The Database function now supports Secrets Wallet. Use the toggle to select a predefined secret when configuring the Database function.

The Aggregation Table in the Inspect Tab now supports an additional option in Actions, View as JSON, to view individual session data in the JSON format.

September 2022
  • Improved user interface to better reflect the timeout behaviour. Visit the documentation for the Data Aggregator function for more details.

  • Improved loading time for Solutions
  • A couple of cool bug fixes
August 2022

Release date: August 26, 2022

The Aggregation Inspector is updated to better align with user requirements.

  • Added sorting options for the Planned timeout and Session created columns of the Aggregation Table in the Inspect tab
  • Added advanced filtering condition for fields in the Inspect tab

  • An improved warning message when deleting a Data Aggregator function containing aggregation session data
  • Tooltip updates for Field Organizer, Validate and Script functions
  • Multiple documentation updates
July 2022

Release date: July 28, 2022

Map function now supports a new string functionality, split, allowing strings to be split by a specific substring into an array.

Example

split(xx,yy)

See the documentation for more information.

Previously, when using the Tree view to observe Preview data for a function, the data displayed would not be consistent with the connected output (in case of multiple output function).

This is fixed now and the Tree view displays data separately for each connected function.

June 2022

Release date: June 30, 2022

The Aggregation Inspector is a new feature that gives you the ability to visually inspect and manage all your aggregation sessions. You can view aggregated session data on a solution level using the Aggregation tab and also within individual Data Aggregator functions using the Inspect tab that contains aggregated session data, apply filters, modify timeout values and command the flush & deletion of sessions. This is especially useful for long-term sessions that are aggregated using the Data Aggregator function.

Check out the Aggregation Inspector documentation for more details.

                                            Aggregation tab                                                                                                      Inspect tab

Usage Engine introduces a new function, the Audit Log. The Audit Log is a collector that helps gather and export audit data from all available streams in your account to external databases or BI systems. You can evaluate and transform complex data into meaningful and actionable information, which in turn can be used to support more effective strategic, tactical, and operational insights and decision-making. Audit logs can also be viewed using the Audit Dashboard as part of the Usage Insights add-on package.

For more information, check out the Audit Log documentation.

The Salesforce Query and Salesforce Bulk Upload functions allow adding custom tenant environments. Upon selecting the Custom tenant option, you must provide the URL to access your custom tenant environment.

This release of Usage Engine Cloud Edition features a redesign of the Configuration and Preview screen for the functions. The improved user interface provides you with an enhanced configuration experience. The changes include: 

  • Configuring your function to the right and viewing the Preview data to the left
  • Resizeable configuration and preview panes
  • Tooltip information and the link to documentation are now accessible by hovering your cursor over the function icon
  • Keyboard shortcut (Esc) to close the Configuration screen

Introducing the Usage Insights dashboard

Audit metrics can now be visualized graphically in the new Usage Insights dashboard, available when clicking Audit in the stream editor.

Collection Strategy for SFTP Collector

When configuring the SFTP collector function, users can set a collection strategy when collecting files from the SFTP server. There is also flexibility in setting conditions for excluding files based on the last modified timestamp.

May 2022

Release date:  May 18th 2022

Introducing the Abort function

The Abort function, as the name suggests, is a forwarder that helps you stop the execution of a stream.

Stream hangs without any error message when MongoDB is unavailable

Fixed an issue with no error message being displayed when MongoDB becomes unavailable during stream execution. The problem is now fixed by adding an error message when MongoDB is unavailable: Transaction error: MongoServerSelectionError: connection timed out

April 2022

Release date: April 27th 2022

Introducing the Zuora Query Processor

The new Zuora Query function is added to Usage Engine Cloud Edition as a processor. Using this function, you can post queries to the Zuora Billing service to help enrich data processing and create meaningful chargeable records. This function also provides the flexibility to choose between two APIs when querying namely, Action Post Query API that uses the Zuora Object Query Language (ZOQL) and Data Query that uses the standard Structured Query Language (SQL). 

Data Aggregator

The Data Aggregator function is updated to support more advanced usage billing by extending aggregation based on time period and conditions. It now supports real-time streams as well.

Amazon S3, SFTP and Google Cloud Storage

The Amazon S3, SFTP and Google Cloud Storage functions that contain the file collection feature, now support decompression of files in the Zlib format.

Amazon S3

  • The Amazon S3 collector can now read more than 1000 files from an S3 bucket irrespective of the file extension or file format.
  • The Amazon S3 forwarder now supports BucketOwnerFullControl setting to allow object access for bucket owner in case of AWS cross-account scenario.
March 2022

Release date: March 15th 2022

Usage Data Platform is now Usage Engine Cloud Edition!

Exciting news as Usage Data Platform is rebranded into Usage Engine Cloud Edition. With the intent of unifying the look and feel across both product lines of DigitalRoute's Usage Engine namely Usage Engine Private Edition and Usage Engine Cloud Edition, this release brings many changes to the user interface. Hope you like it!

Introducing the new Zuora Post Usage forwarder!

Joining the other Zuora functions in Usage Engine, is the new Zuora Post Usage forwarder. You have the flexibility to either use Zuora’s Active Rating API or the native Post Usage API to create and upload usage records to your Cloud Billing system. Refer to the Zuora Post Usage documentation.

Updated Login Page for Usage Engine Cloud Edition

A refreshing new look for the login page of Usage Engine.

HTTP Client now supports OAuth2

The HTTP Client functions now support the OAuth2 authorization framework. This resolves the issue of having to implement the OAuth2 by yourself using two additional HTTP Client functions and provide credentials that would be visible in the body. With the ability of OAuth2 to securely provide access to third-party applications, you can connect to almost any API servers of your choice.

February 2022

Release date: 23 February 2022

Data Aggregator

The Data Aggregator now has an updated user interface. 

General

Multiple bug fixes and documentation updates


February 2022

Release date: 2 February 2022

HTTP Client

Users can now choose to disable Preview for the HTTP Client processor function.

HTTP Server

The HTTP Server function now supports incoming HTTP requests with two additional content-types: application/cloudevents+json and application/cloudevents-batch+json.

Script

The Script function has been updated with significant reliability and performance improvements.

Zuora Import Usage

Support for Secrets Wallet is added to the Zuora Import Usage function.

Zuora Post Usage

Support for Secrets Wallet is added to the Zuora Post Usage File function.

state.stream during Variable Insertion

Usage Engine is no longer supporting variable insertion (interpolation) using state.stream. So all the existing streams using interpolation with state.stream will become invalid. It is recommended to use meta instead. 

For more details, see Configuring Dynamic Naming in Fields for a simple example showing how to interpolate using the meta object.

If you have any questions, do not hesitate to contact your Customer Contact.

2021


Release date: 20 December 2021

Deprecations

The following deprecation has now been postponed to February  2, 2022.

Function/FeatureDescription
state.stream during variable insertion 

Usage Engine will no longer support variable insertion (interpolation) using state.stream. It is recommended to use meta instead. 

  • How to use?
    For example, the image below shows variable insertion using state.stream.FILENAME in an Amazon S3 Forwarder function. In this scenario, kindly update the stream configuration and replace it with meta.FILENAME.




The Filename field should be populated as shown below:



For more details, please go through Configuring Dynamic Naming in Fields for a simple example showing how to use variable insertion using the meta object.

If you have any questions, do not hesitate to contact your Customer Contact.

Release date: 2 December 2021

Improvements
Function/FeatureDescription

HTTP Server

HTTP Server collector and forwarder functions now support configuring a custom header for the HTTP OPTIONS method requests. 
Route

Route function now verifies array length. 

Stream audit

The Stream audit table can now support an additional 50 or 100 records to be displayed per page. 

Beta Releases
Function/FeatureDescription
SOAP Client

SOAP web service functions are now released, thereby enabling integration with Salesforce.

Deprecations

The following deprecation has now been postponed to February  2, 2022.

Function/FeatureDescription
state.stream during variable insertion 

Usage Engine will no longer support variable insertion (interpolation) using state.stream. It is recommended to use meta instead. 

  • How to use?
    For example, the image below shows variable insertion using state.stream.FILENAME in an Amazon S3 Forwarder function. In this scenario, kindly update the stream configuration and replace it with meta.FILENAME.




The Filename field should be populated as shown below:



For more details, please go through Configuring Dynamic Naming in Fields for a simple example showing how to use variable insertion using the meta object.

If you have any questions, do not hesitate to contact your Customer Contact.

Release date: 11 November 2021

New Features
Function/FeatureDescription
Input Preview Data

When configuring a processor or forwarder function on the Stream Editor, it is now possible to view Input Preview Data along with the Output data. It is not possible to display Input preview data for collector functions.

Improvements
Function/FeatureDescription

SAP Subscription Billing

SAP SB Query

Salesforce Query

Salesforce Bulk Upload

The SAP and Salesforce functions have now been updated to include the Secrets Wallet toggle.
Stream importWhen importing a stream, you can now use the Import file option to select and upload, or, drag and drop a file in JSON format.
Beta Releases
Function/FeatureDescription
UDP DashboardAn exciting new graphical dashboard providing operational information about streams including data from logs, trends and stream running information.
Deprecations
Function/FeatureDescription
state.stream during variable insertion 

Usage Engine will no longer support variable insertion (interpolation) using state.stream. It is recommended to use meta instead. The change will take effect from December 1, 2021. For more information on how to use meta, see Configuring Dynamic Naming in Fields.

  • How to use?
    For example, the image below shows variable insertion using state.stream.FILENAME in an Amazon S3 Forwarder function. In this scenario, kindly update the stream configuration and replace it with meta.FILENAME.




The Filename field should be populated as shown below:



For more details, please go through Configuring Dynamic Naming in Fields for a simple example showing how to use variable insertion using the meta object.

If you have any questions, do not hesitate to contact your Customer Contact.

Release date: 25 October 2021

New Features
Function/FeatureDescription
HTTP Client Preview ToggleCustomers can toggle on/off the preview option in the HTTP Client function. This function is only released for certain accounts. 
User-defined Stream AuditThis is a new UDP function that enables customers to inspect streams in detail. An inspection into the audit logs allows for verification of usage data processing. 
Data Masking FunctionsA new Hash option enables customers to hide certain fields of data. Two-way data masking operations are implemented via the new Encryption and Decryption functions. 
Improvements
Function/FeatureDescription
MapThe round number option in the Map function has been improved. 
User Interface ImprovementsA new user interface featuring a common table for viewing Logs has been implemented. The Start button is now disabled for invalid streams. 
Secrets Wallet Configuration ImprovementsThe Secrets Wallet function has been improved by having the encryptedvalue key removed for security reasons. 
Delimiter ConfigurationThe Amazon S3 and STP nodes have an updated delimiter configuration.
Stream File ExportStreams can be exported to files and saved locally. 

Release date: September 29, 2021

New Features
Function/FeatureDescription
Secrets Wallet

Previously released as a Beta feature, Secrets Wallet is now accessible by all users of UDP.

Enables storing and managing user credentials or secrets in a Secrets Wallet for use across multiple streams and solutions in UDP.

Beta Releases
Function/FeatureDescription
Google Cloud StorageTwo new functions, the Google Cloud Storage collector and forwarder, are released as Beta. Google Cloud Storage is a cloud storage platform designed to store large unstructured datasets. It is a RESTful online file storage web service for storing and accessing data on the Google Cloud Platform infrastructure.

Release date: September 1, 2021

Improvements
Function/FeatureDescription
HTTP Server and Client

HTTP Server: Updated the HTTP Server function to be more robust and secure. Enabling context-type checking when parsing incoming data and provision of content-length of the body.

HTTP Client: Validation of the URL. If the URL is not interpolated a valid URI is expected, so you must provide the protocol at the beginning.

Data Masking (Encryption and Decryption) Improvements in existing Beta functions. The Encryption and Decryption functions have now been integrated with the Secrets Wallet feature.
Beta Releases
Function/FeatureDescription
Secrets WalletA new feature that enables the user to store, manage and reuse personal access credentials across multiple functions or streams in their UDP account.

Release date: July 21, 2021

Improvements
Function/FeatureDescription
No Code Validation

It is now easier to validate fields using the Validate function. Customers can use the revamped user interface to select properties and objects, as well as enter custom schema. 

HTTP Client and Count User Interface Changes

The unbound/bound limiter option has been removed. It is now easier to use these functions by simply specifying the maximum value of the execution iterations.  

Security Document for UDPA new security document is now available. It covers best practices and guidelines for using UDP in a secure manner.
HTTP Response Headers SupportIt is now possible to define the key name where HTTP headers are stored. 
Beta Releases
Function/FeatureDescription
Hash

The Hash function hides, or masks, personal data in order to comply with the GDPR rules.

Encryption

This function enables customers to mask data with a strong algorithm. 

Decryption

This function enables customers to unmask the data that has been processed using the Encryption operation.

Upcoming Changes
Function/FeatureDescription

Secrets Wallet

The Secrets Wallet feature will provide a safe storage for credentials. Once entered in the wallet, credentials can be re-used across functions in a convenient way.

Release date: July 1, 2021

Improvements
Function/FeatureDescription
HTTP Client

The HTTP Client node now supports response headers insertion. 

HTTP Server

The HTTP Server node now allows for HTTP body, header, and status code to be configured. 

Beta Releases
Function/FeatureDescription
HashThe Hash function hides, or mask, personal data in order to comply with the General Data Protection Regulation (GDPR).

Release date: 9 June 2021

Improvements
Function/FeatureDescription
ScheduleThe design of scheduling is updated and timezone handling added for single streams. Previously, only stream groups included timezone handling.
The UI for setting schedules is improved and the selections are easier to make.
These improvements to the function increases the user experience.
Map

The Map Fields configuration is improved and aligned with other functions in Usage Engine. 
The function now uses interpolation to properly handle more variants of field names, for example numbers as field names and field names containing spaces.

Resizing Configuration PanelsThe configuration panels can be resized, from the default 25% of the panel up to 75%. This improvement is particularly useful when using long lines in the Script function.
The complete panel, covering both the configuration and the preview parts, is also designed to be responsive, and scales to the size of your browser window.
Accessibility

Improved adherence to the accessibility guidelines. 

Deprecate Information
Function/FeatureDescription
Aggregate

The Aggregate function is now tagged with a Deprecate flag. The flag indicates that the function will be removed from the selectable functions in Usage Engine on July 1 2021.
Existing streams will remain working, even after this date, but the function can not be re-configured. More information will be provided later.

The Aggregate function is replaced by the Data Aggregator, which is now available for all users. We highly recommend users to migrate to, and only use, the new Data Aggregator function. 

Release date: 19 May 2021

Improvements
Function/FeatureDescription
User Experience and Accessibility Guidelines 

Improvements to the User Experience and closer adhering to accessibility guidelines. 

TooltipsA number of tooltips are made clearer and more complete.
Transaction SafetyImproved handling of transaction safety in connection with streams using multiple collectors.
Deprecate Information
Function/FeatureDescription
Aggregate

The Aggregate function is now tagged with a Deprecate flag. The flag indicates that the function will be removed from the selectable functions in Usage Engine on July 1 2021.
Existing streams will remain working, even after this date, but the function can not be re-configured. More information will be provided later.

The Aggregate function is replaced by the Data Aggregator, which is now available for all users. We highly recommend users to migrate to, and only use, the new Data Aggregator function. 

Upcoming Changes
Function/FeatureDescription

Stream Scheduling

In the next release, scheduling of streams and stream groups will be updated both to add features, as well as to increase the user experience.

Apart from handling Time Zones, the scheduling intervals have been modified. Most obvious is the change to the setting on minute level. You can quickly and easily select to run streams and every 15, 20, or 30 minutes.
Existing settings will remain unchanged until they are modified. More information will be provided in the next release.

Release date: 28 April 2021

Improvements
Function/FeatureDescription
Accessibility Guidelines

Improvements to the user experience adhering to accessibility guidelines: 

  • Color alignments
  • Other visual improvements
ScheduleThis release includes the first step to handle Time Zones. Currently Time Zones are only handled for Stream Groups.
HTTP Server

In this release the maximum length of the content, which the HTTP Server is capable of handling is extended to 1MB. This is a tenfold increase compared to the previous version.

In this release we also added support for more content-types.

Before this release, Usage Engine supported:

  • application/json
  • application/x-www-form-urlencoded

The following content-types are now added:

  • text/plain
  • text/xml
  • application/xml
 
SAP Subscription BillingNew JSON format support added, implementing new optional fields for usage records and subscription billing purposes. Custom references can be optionally used. 
Deprecate Information
Function/FeatureDescription
Aggregate

The Aggregate function is now tagged with a Deprecate flag. The flag indicates that the function will be removed from the selectable functions in Usage Engine on July 1 2021.
Existing streams will remain working, even after this date, but the function can not be re-configured. More information will be provided later.

The Aggregate function is replaced by the Data Aggregator, which is now available for all users. We highly recommend users to migrate to, and only use, the new Data Aggregator function. 

Release date: 12 April 2021

New features
Function/FeatureDescription
Data Aggregator

Previously released as Beta, the Data Aggregator function is now generally available (GA) for all users. The new Data Aggregator is an improved version of the Aggregate function. The Aggregate function is now tagged with a Deprecate flag and will be removed from Usage Engine in the next two months. 

Salesforce QueryPreviously released as Beta, the Salesforce Query is now generally available (GA) for all users. This function uses the Salesforce Object Query Language to query specific fields from a Salesforce object. Objects and fields can be found on the Salesforce website after user login.
Improvements
Function/FeatureDescription
Email Attachment

Improved Stream completion time when splitting large attachments using the Email Attachment function. 

Accessibility Guidelines

Multiple improvements to the user experience adhering to accessibility guidelines. 

  • Updated text across labels, tooltips
  • Improved mouse hover and keyboard focus behaviour
  • Other visual improvements
Deprecate Information
Function/FeatureDescription
Aggregate

The Aggregate function is now tagged with a Deprecate flag. The flag indicates that the function will be removed from Usage Engine within two months.

The Aggregate function is replaced by the Data Aggregator, which is now available for all users. 


  • No labels