cancel
Showing results for 
Search instead for 
Did you mean: 

SAP Data Intelligence Jupyter Operator with Docker- Graph not running/ Docker not building

518299
Explorer

Hello,

i created a Jupyter Operator and wanted to use an own docker file to make it run. My docker builded and generated the right tags.

When running the graph I get the following error:

failed to prepare graph description: failed to select image: no matching dockerfile found for group 'group1' with runtime tags: {"hdbcli":"","jupyter":"","opensuse":"","python36":"","sqlalchemy":"","sqlalchemy-hana":"","tornado":"5.0.2","tweepy":""}; 
Alternatives are: 
{com.sap.opensuse.golang.zypper {"deprecated":"","opensuse":"","python36":"","sapgolang":"1.14.9-bin","tornado":"5.0.2","zypper":""}}
{com.sap.sles.node {"node":"","pandas":"1.0.3","python":"3.6","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.dsp.functional-services.image-services {"python36":"","tornado":"5.0.2","v2-image-services":"1.0.1"}}
{com.sap.sles.ml.functional-services {"deprecated":"","node":"10.16.0","pandas":"1.0.3","python":"3.6","python36":"","requests":"2.22.0","sapgolang":"1.14.9-bin","sles":"","tornado":"5.0.2"}}
{com.sap.sles.golang {"node":"10.16.0","pandas":"1.0.3","python":"3.6","python36":"","sapgolang":"1.14.9-bin","sles":"","tornado":"5.0.2"}}
{com.sap.sles.hana_replication {"hanareplication":"0.0.101","node":"10.16.0","pandas":"1.0.3","python36":"","sapjvm":"","sles":"","tornado":"5.0.2"}}
{org.opensuse {"deprecated":"","opensuse":"","python36":"","sapgolang":"1.14.9-bin","tornado":"5.0.2","zypper":""}}
{com.sap.dsp.functional-services.text-services {"python36":"","tornado":"5.0.2","v2-text-services":"1.0.1"}}
{com.sap.training.tyom-suse-pytorch-1_3-py36-gpu {"Pillow":"7.2.0","python36":"","pytorch":"1.3-gpu","sapdi":"0.3.33","sentencepiece":"0.1.91","sles":"","torchtext":"0.5.0","torchvision":"0.4.1+cu100","tornado":"5.0.2"}}
{com.sap.cpem.ampq {"cpem_ampq":"0.9.40","node":"","pandas":"1.0.3","python":"3.6","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.scenariotemplates.customdataprocessing.papaparse {"node":"","pandas":"1.0.3","papaparse":"4.1.2","python":"3.6","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.sles.sapjvm {"node":"10.16.0","pandas":"1.0.3","python36":"","sapjvm":"","sles":"","tornado":"5.0.2"}}
{com.sap.dsp.dsp-core-operators {"aiohttp":"3.5.4","backoff":"1.8.0","hana_ml":"2.5.20062605","hdbcli":"2.4.194","hdfs":"2.5.0","janus":"0.4.0","jsonschema":"3.2.0","pandas":"0.24.2","psutil":"5.7.0","python-dotenv":"0.10.3","python-rapidjson":"0.9.1","python36":"","requests":"2.22.0","sapdi":"2103.1.0","sapgolang":"1.14.9-bin","scikit-learn":"0.22.2","shortuuid":"0.5.0","sles":"","tornado":"5.0.2","ujson":"1.35","uvloop":"0.12.2"}}
{com.sap.sles.ml.python {"automated-analytics":"3.2.0.9","ml-python":"","numpy36":"","pandas":"1.0.3","pykalman36":"","python36":"","sapgolang":"1.14.9-bin","scipy":"1.1.0","sles":"","textblob36":"0.12.0","tornado":"5.0.2","tweepy36":"3.7.0"}}
{com.sap.training.tyom-suse-tf-2_0-py36-cpu {"Pillow":"7.2.0","h5py":"2.8.0","hyperopt":"0.1.1","keras":"2.2.4","lxml":"4.2.5","nltk":"3.3","numpy":"1.15.2","pandas":"0.23.4","python36":"","sapdi":"0.3.33","scikit-learn":"0.20.0","scipy":"1.1.0","seaborn":"0.9.0","sles":"","stop-words":"2018.7.23","tensorflow":"2.0-cpu","tornado":"5.0.2"}}
{com.sap.sles.dq {"node":"10.16.0","pandas":"1.0.3","python36":"","sles":"","tornado":"5.0.2","vflow_dh_dq":"2103.2.1"}}
{com.sap.opensuse.ml.rbase {"opensuse":"","python36":"","r":"3.5.0","rjsonlite":"","rmsgpack":"","rserve":"","tornado":"5.0.2","tree":""}}
{com.sap.sles.flowagent-operator {"flowagent":"2103.15.6","node":"","pandas":"1.0.3","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.dsp.functional-services.ocr-services {"python36":"","tornado":"5.0.2","v2-ocr-services":"1.0.1"}}
{com.sap.dsp.sapautoml {"deprecated":"","python36":"","sapautoml":"2.0.0","sles":"","tornado":"5.0.2"}}
{com.sap.training.tyom-suse-tf-1_15-py36-gpu {"Pillow":"7.2.0","h5py":"2.8.0","hyperopt":"0.1.1","keras":"2.2.4","lxml":"4.2.5","nltk":"3.3","numpy":"1.15.2","pandas":"0.23.4","python36":"","sapdi":"0.3.33","scikit-learn":"0.20.0","scipy":"1.1.0","seaborn":"0.9.0","sles":"","stop-words":"2018.7.23","tensorflow":"1.15-gpu","tornado":"5.0.2"}}
{twitter-api-setup {"hdbcli":"","node":"10.16.0","pandas":"1.0.3","python":"3.6","python36":"","sles":"","sqlalchemy":"","sqlalchemy-hana":"","tornado":"5.0.2","tweepy":""}}
{com.sap.training.tyom-suse-tf-2_0-py36-gpu {"Pillow":"7.2.0","h5py":"2.8.0","hyperopt":"0.1.1","keras":"2.2.4","lxml":"4.2.5","nltk":"3.3","numpy":"1.15.2","pandas":"0.23.4","python36":"","sapdi":"0.3.33","scikit-learn":"0.20.0","scipy":"1.1.0","seaborn":"0.9.0","sles":"","stop-words":"2018.7.23","tensorflow":"2.0-gpu","tornado":"5.0.2"}}
{com.sap.sles.base {"default":"","node":"10.16.0","pandas":"1.0.3","python":"3.6","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.scenariotemplates.customdataprocessing.pandas {"node":"10.16.0","pandas":"0.20.1","python":"3.6","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.sles.jupyter {"jupyter":"","opensuse":"","python36":"","sles":"","tornado":"5.0.2"}}
{com.sap.sles.streaming {"node":"10.16.0","pandas":"1.0.3","python36":"","sapjvm":"","sles":"","streaming_lite":"","tornado":"5.0.2"}}
{com.sap.dh.scheduler {"dh-app-base":"2103.15.4","node":"vflow-sub-node"}}
{com.sap.training.tyom-suse-tf-1_15-py36-cpu {"Pillow":"7.2.0","h5py":"2.8.0","hyperopt":"0.1.1","keras":"2.2.4","lxml":"4.2.5","nltk":"3.3","numpy":"1.15.2","pandas":"0.23.4","python36":"","sapdi":"0.3.33","scikit-learn":"0.20.0","scipy":"1.1.0","seaborn":"0.9.0","sles":"","stop-words":"2018.7.23","tensorflow":"1.15-cpu","tornado":"5.0.2"}}
{com.sap.training.tyom-suse-pytorch-1_3-py36-cpu {"Pillow":"7.2.0","python36":"","pytorch":"1.3-cpu","sapdi":"0.3.33","sentencepiece":"0.1.91","sles":"","torchtext":"0.5.0","torchvision":"0.4.1+cpu","tornado":"5.0.2"}}

Here are some pictures of the relevant screens:

After searching for the problem i found this Question (https://answers.sap.com/questions/12914504/sap-datahub-python-operator-with-docker.html), where it tells me to add the packages of the error to my docker.

When I tried to add these I got the following status/ error while building the docker:
build failed for image: 784510488785.dkr.ecr.eu-central-1.amazonaws.com/dh-8zz1a7rso/vora/vflow-node-1d023cd936c49f6a24e663421913f6e85c2633e6:2103.12.5-docker-twitter-20210618-134230
Here is a picture of my docker and tags.json:

Thanks for any Help!

Moritz Magel

Accepted Solutions (1)

Accepted Solutions (1)

AndreasForster
Product and Topic Expert
Product and Topic Expert

Hi Moritz, You dont have to reinstall all operator components yourself. It is easiest to inherit from the jupyter base image. This blog has an example

https://blogs.sap.com/2021/04/08/hands-on-tutorial-script-and-deploy-python-with-the-new-jupyter-ope...

518299
Explorer
0 Kudos

Hi Andreas, thanks a lot! Its working now!

anishkamoona
Discoverer
0 Kudos

Hi Andreas,

We are facing a build error even after loading from the in-built jupyter docker file. Can you please check and help us?

AndreasForster
Product and Topic Expert
Product and Topic Expert
0 Kudos

Hi anishkamoona , This SAP Note explains how to get a more detailed log of the failed Docker build. Hopefully this will shed some light on what's going wrong. https://me.sap.com/notes/3075569

anishkamoona
Discoverer
0 Kudos

Hi Andreas,

Thanks for the response! We could get through the error; changed the docker files and now it is working fine!

We are working towards intelligent lead time prediction using SAP DI and then setting up a connection to write back in SAP IBP. After following all steps, in the last stage - while writing back to IBP - we are getting the following validation error.

Can you please check and help us out?

screenshot-2023-11-13-002058.png

AndreasForster
Product and Topic Expert
Product and Topic Expert
0 Kudos

Hi anishkaamitmoona Not sure I can help here myself. But I can try to find a colleague, without promising anything... Are you working at a SAP customer or partner? Just send me a message please with your details.

Answers (0)