To enable vertical tabs in Firefox, just right-click on any empty area of the horizontal tab bar. If you've run out of space, ...

Also, you will have the choice of whether you want to show the Favourites Bar on all tabs (Always) or only on New tabs only. You can also turn on the Show favourites button on that page so that ...