Resetting altitudes didn't do it. But sliding the forecast window all the way to the right did.
Found that by accident, by suddenly remembering that's how it worked.
Is there a way to make that more obvious? Or to make it part of the Context menu instead? I can't see how a new user would know, or expect, that sliding the slider all the way to the right is "off."