You might consider formatting your TOC manually, and then turning the
page numbers into cross-references so they update automatically. This
would give you the freedom to format the TOC as you like without
worrying about forcing InDesign's TOC feature to do something it wasn't
really designed for.
To help you turn the page numbers into live cross-references, there's
this script: