Take a look at your log file (/var/log/secure for Fedora Core 4) and you will discover numerous automated ssh hacking attempts using dictionary attack. So now you have identified the offending addresses. How do you stop them?
Whew! Finally I have transferred my site to a sparkling new dedicated server.
It was a very eventful journey. Lots of challenges were overcome and I learned a lot. I will share some of it in the coming days.