Tonsil stones are caused by bacteria that forms hard deposits inside the tonsils. They will stay there until they are cleaned out, and in some cases, they may come out on their own. You may need to get them out by a doctor if they are not able to come out. You have another option: Surgical removal. However, this could leave scar tissue around the tonsil.