Are you running a bunch of FFT processes? I don’t think it is the hardware buffer size you should worry about. It is the block size. What is that set to? FFT processes, no matter the size of the FFT buffer, need to calculate inside one block size, and that can cause cpu spikes.
Sam