In my opinion, toolbar buttons would be best (or a dropdown box with "symbols"). This would be a site-specific section in the toolbar area at the right of the standard buttons. There are probably other sites within StackExchange as well that have similar requests for special symbols (for example [Mathematics](http://math.stackexchange.com/)).