If you plan to re-grout a small portion, you can buy a
grout saw to clean it out. I have the whole dremel kit and it sucked. The hand tool worked way better, faster, and cleaner.
The broken tile should be removed as best you can, then the sub floor cleaned so you can glue in a new one using the same glue FR uses, which sounds like epoxy.
Good luck.