SAP Data Intelligence – What’s New in DI:2023/05

[eduardo_haussen]

SAP Data Intelligence, cloud edition DI:2023/05 will soon be available.

Within this blog post, you will find updates on the latest enhancements in DI:2023/05. We want to share and describe the new functions and features of SAP Data Intelligence for the Q2 2023 release.

If you would like to review what was made available in the previous release, please have a look at this blog post.

Overview

This section will give you a quick preview about the main developments in each topic area. All details will be described in the following sections for each individual topic area.

SAP Data Intelligence 2023/05

 

 

 

Connectivity & Integration

This topic area focuses mainly on all kinds of connection and integration capabilities which are used across the product – for example: in the Metadata Explorer or on operator level in the Pipeline Modeler.

Connection to PostgreSQL

USE CASE DESCRIPTION:

• Introduce a new connection type to support connection to PostgreSQL DBs


• Support of PostgreSQL Version 13.X and 14.X


• Support of PostgreSQL connection via Cloud Connector


• Support of basic and X.509 authentication


• Support one-way TLS encryption


• Consumption of PostgreSQL via Generation 1 and Generation 2
  
  
  
  • Table Consumer
  
  
  • SQL Consumer
  
  
  • SQL Executor
  
  
  
  

 

 

BUSINESS VALUE – BENEFITS:

• Possibility to connect to one of the most widely used open source object-relational database systems

 

 

Support of SAP Cloud Connector for SAP IQ

USE CASE DESCRIPTION:

• Introduce the possibility to connect to SAP IQ databases over a configured Cloud Connector


• Support of SAP IQ Version 16.X


• Support of basic authentication


• Support one-way TLS encryption


• Consumption of SAP IQ via Generation 1 and Generation 2
  
  
  
  • Table Consumer
  
  
  • SQL Consumer
  
  
  • SQL Executor
  
  
  
  

 

 

BUSINESS VALUE – BENEFITS:

• Possibility to connect On-Premise deployed SAP IQ database to SAP Data Intelligence

 

 

Support of Oracle 19C database via Oracle Instant Client

USE CASE DESCRIPTION:

• Introduce the possibility to connect Oracle 19C database for the Oracle Instant Client


• Allows customers to access the newest release of Oracle database


• Consumption of Oracle database with following Gen 1 and Gen 2 operators:
  
  
  
  • Table Consumer
  
  
  • SQL Consumer
  
  
  • Flowagent SQL Executor
  
  
  
  

 

 

BUSINESS VALUE – BENEFITS:

• Possibility to use newly released Oracle database

 

 

Enable client certificates for ABAP RFC without SAP
Cloud Connector

USE CASE DESCRIPTION:

• Introduce the possibility to define client certificates for the ABAP RFC without SAP Cloud Connector


• Support of all previous supported ABAP RFC connections


• Consumption of ABAP RFC via Generation 1 and Generation 2, as also Replication Flows:
  
  
  
  • ABAP CDS Reader, ABAP ODP Reader, Custom ABAP Operator, SAP ABAP Operator, SLT Connector (Generation 1)
  
  
  • Read Data From SAP System (Generation 2)
  
  
  
  

 

 

BUSINESS VALUE – BENEFITS:

• Possibility to define a Client Certificate Authentication without setting up a SAP Cloud Connector

 

 

Pipeline Modelling

This topic area covers new operators or enhancements of existing operators. Improvements or new functionalities of the Pipeline Modeler and the development of pipelines.

Support custom Data Lakes as Pipeline Logs Storage

USE CASE DESCRIPTION:

• Possibility to store diagnostic archives of Pipeline runs in custom data lake


• Any data lake connection that is configured via the SAP Data Intelligence Cloud Connection Management is supported.


• Standard DI_DATA_LAKE connection is not supported


• Decide on garbage collector strategy
  
  
  
  • History: Lifetime of a diagnostics archive is bound to the lifetime of the (archived) graph (default: 3 months). Configurable via
    “Execution history retention time limit” configuration.
  
  
  • Never: Diagnostics archives are never deleted from the Data Lake
  
  
  
  


• Decide whether to store all pipeline diagnostics archives or only those of failed graphs

 

 

BUSINESS VALUE – BENEFITS:

• Capabilities to ensure longevity of Pipeline diagnostics archives


• Possibility to perform sustainable error analysis on Pipelines runs and errors

 

 

REST API Client  Operator for Generation 2 Pipelines

USE CASE DESCRIPTION:

• New standard operator for REST consumption in Generation 2 Pipelines


• Supported Connectivity
  
  
  
  • Connection Type: HTTP
  
  
  • Authentication: Basic and Oauth2 PW or Client credentials
  
  
  • Cloud Connector supported
  
  
  
  


• Retry mechanism for responses with 500 range status code via retry attempts, retry interval and request timeout configuration properties


• Customizable Error Handling
  
  
  
  • Terminate on Error
  
  
  • Log Error and ignore
  
  
  • Propagate to error port
  
  
  
  

 

 

BUSINESS VALUE – BENEFITS:

• Out-of-the-box REST API consumption for
  Generation 2 Pipelines with standardized error handling

 

 

Administration

This topic area includes all services that are provided by the system – like administration, user management or system management.

Allow admins to stop and restart graphs of other users

USE CASE DESCRIPTION:

• Let tenant administrators (e.g. user with sap.dh.admin policy) pause/restart/stop graphs of other users via the monitoring application.


• Pause/Restart/Stopactions will be displayed on graph detail view on Monitoring UI


• Restarting a paused graph will create a new instance of the graph that is owned by the user that started/owned the original graph.


• Feature not available for users that have only the sap.dh.monitoring policy assigned.

 

 

BUSINESS VALUE – BENEFITS:

• Possibility for administrators to control system load of tenants as well as perform emergency maintenance for Pipelines

 

 

These are the new functions, features and enhancements in SAP Data Intelligence, cloud edition DI:2023/05 release.

We hope you like them and, by reading the above descriptions, have already identified some areas you would like to try out.

If you are interested, please refer to What’s New in Data Intelligence – Central Blog Post.

For more updates, follow the tag SAP Data Intelligence.

We recommend visiting our SAP Data Intelligence community topic page to check helpful resources, links and what other community members post. If you have a question, feel free to check out the Q&A area and ask a question here.

Thank you & Best Regards,

Eduardo and the SAP Data Intelligence PM team