Don't hide/show the line area during redraw when the change is minor

Because laying out the whole thing again is more work than what is
saved by manipulating it in hidden state.

Issue #892