To get rid of razor bumps, stop shaving and apply a warm compress. Razor bumps are caused when hair curves back into the skin after shaving. Using a sharp razor and preparing your skin can help ...