Looking at different message boards there are still people who have encountered the same problem as I have and yet no answer was given or found.
Here is how I installed and started Tomcat. (Windows 2003 Server, Tomcat 5.0, Java 1.4.2)
1. Installed Java and set JAVA_HOME path
2. Installed Tomcat as a service
3. Edited the Apache Tomcat Properties->Java->Java Options and Added the following
1st setup : -verbose:gc -Xprof -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
2nd setup : -Xloggc:gc.log -Xprof -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
3rd setup : -Xloggc:gc.log -verbose:gc -Xprof -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
4. Started Tomcat
After starting tomcat according to the pages and message board that I have visited you should be able to see garbage collection log either in the stdout.log file or the gc.log file which you set in -Xlogg: