Is it safe to do this to your face?

Yes, get yourself a box of Arm & Hammer baking soda. Generally costs less and $2 and the box will last for months. Basically, it's a facial scrub .. which is actually what it also does for your teeth ...