I'd start with the server because that is where the files are being served from. It wouldn't be bad for the client either, but that won't impact performance of AC like defragging the server does.
One other trick that you can try on the client machines is to setup a search for "*.tmp" files, and remove the TMP files as they get indexed into memory (depending on several factors), and can also impede performance.
