How do I clean the brown grime where the bathroom sink faucet and sink meet?

I don't want to ruin the rubber seal between the faucet and sink. Also, is that brown stuff getting into my water? Or is the sink protected?