Using CVS to address mirroring

We are looking for another host for our site.

The host must have an SSH server where I can log in to distrivbute the content for our site without any issues.

Why you might ask? Because it's the easier way to make our content available across the net.

This also means most our files will be posted for download, but we can still upload a file onto a sever without affecting the CVS copy.