More or less my point, languages are weird with lots of arbitrary idiomatic things—‘would rather’ but ‘had better’.

After posting the comment I’ve thought ‘wait, it makes more sense for it to be should’ so my guesses are a bit off today.