Yes, you probably should disable TLS compression on the web server, if you use SSL on a highly security-sensitive site.
For most of your user base, this is not strictly necessary. Turning off TLS compression in the web server is useful only to protect the small fraction of users who are running older, vulnerable browsers. The only browsers that ever supported TLS compression were Firefox and Chrome. IE, Safari, Opera have never supported it. Firefox and Chrome have disabled TLS compression in their latest versions. Both of them use automatic updates so majority of users will upgrade to patched versions very soon. Therefore, most users will already be protected, even if you do nothing.
However, there may be some users still using older browser versions that support TLS compression, and thus are vulnerable. For instance, Ivan Ristić estimates that (as of September 2012) about 7% of visitors to his web site are using an older browser that supports TLS compression and is vulnerable to CRIME. I expect this number may decrease over time. Nonetheless, there is probably some benefit to turning off TLS compression in your server: it helps protect those users against the CRIME attack.
My thanks to Andrey Botalov for the reference to Ivan Ristić's estimates about the prevalence of vulnerable browsers.
For details on how to disable SSL compression on your web server, see this blog post from iSEC Partners.