Hi gurus,
I have been trying to fetch 100+ records from a table which is stored in a Snowflake warehouse, however, everytime I make the call to the open connector it's just fetching 50 elements. Here is what I have tried:
I tried to connect to Snowflake via JDBC connector but it's not supported.
I tried to use Snowflake Bulk but it has the same limitation.
I tried to create my own Snowflake open connector by downloading the JSON config file, uploading it again and setting the Max Page Size to a number > 50.
I tried to call the SnowFlake open connector inside a looping process in CPI, attempting to use the Pagination feature, but I noticed that the API on the open connector endpoint is not returning any value in the header "Elements-Next-Page-Token" and therefore, only 1 page of 50 elements is returned.
I'm sure I'm not the first person facing an issue with this limitation. Could anybody please help me?
Thank you in advance.