Adapter Module debug: Failed to connect to remote VM.

Hello,

I am trying to debug a deployed Adapter Module through NWDS. The Debug port is on. But when i try to debug using the XI Server it throws this error:

Failed to connect to remote VM. Connection Refused

I have tried this on 3 different servers but no luck. Any reason why i am facing this error. I am debbuging it under the options Remote Java Application. Also can i debug my code as it is, that i ve written for Adapter Module?