Nurse, nurse, nurse - or pump - to flush it out of your system. The warm compress is good as well. You could also try putting cabbage leaves in your bra, wrapped around your breasts - this is often used to reduce supply as well. Sounds like you are weaning a little too fast for your body to handle.
I hope it clears up quickly.