so that begs the question, what is your hardware and software configuration of the server? Not to mention a ton of other things that could be affecting performance (collection update parameters, patch management updating, client configuration check in, etc).
Are you running v6 or v7?
Here is a link to some performance articles (geared to v6):
AKB38917