Toggle the Terminal Closed

[jrock2004]

So I set up a keymap to toggle the terminal which works great, but how can I use it again to close it while the terminal has focus? When I try I just see ,t in my terminal

{
  // Toggle terminal
  "before": ["<leader>", "t"],
  "commands": ["workbench.action.terminal.toggleTerminal"]
}

Do I just move the focus out of the terminal then close it?