This is most often related to buffer size. The delay is cause by latency, which is the time it takes the pc to process the information. A smaller buffer means less latency, but more work for the computer. The computer needs to be up to the task with enough processor and ram.
Buffer is adjusted in the driver program for the interface you are using. For example, Presonus firewire devices ahve Universal Control as the driver application, and any buffer adjustments would happen there.