I somehow managed to keep the window open with no items in it.
However, out of curiosity I set the "Does completion list show an item's description as a tooltip?" to off.
Now the auto-complete window stays open as expected. 
It seems that there is a problem with the tooltips.