If one spouse has balance owing while the other has a refund, can we just pay the difference?

No. CRA deals with your returns individually. So one spouse should expect the full refund and the other has to pay full balance owing before April 30.