Configure WAS 6.40 to reach outside internet

Our server ( xi server ) is behind our firewall - does anyone know how to insure that it hits the proxy server and is able to get out to the internet? I have looked around in ICM but don't really see much. Is this a config for our network guys? I can ping our internet proxy server from the command line of that box.