I think Flouride is only toxic at high level concentrations, I'd have to check though to get the exact figure and compare with the typical water bottle in the house.
How much is Too Much?
Edit -- found some info here:
http://www.fluoridedebate.com/question21.html