Hi, while creating a graph in the modeler, the need arose to put my (csv) data into a pandas dataframe using a python3 operator. This made it easy to perform data manipulation.
Afterwards the goal is to send this data to DWC using the Table Consumer Node. This has worked fine previously with the data transform operator, but using the python3 operator, this gives some trouble. To be able to connect the python node with the Table consumer node, I need to have an output port with the data type "table" on the python operator.
I have not been able to find how I can convert a dataframe to this "table" data type inside the python3 operator.
Does anyone know how this could be fixed?
Thanks in advance!
For reverence, my pipeline: