spu: handle channels better in 'IRQ wait' case