You don't have to dig deep through the menu to access the Undo button. It's available in Gboard's menu button (also known as ...
This comes with a major UI change too. Currently, when you minimize the Gemini overlay, there's no trace of the AI assistant.