Spoiled milk looks, smells, and tastes bad because of an overgrowth of bacteria. Drinking a sip won't hurt you; however, drinking a moderate amount of spoiled milk can result in digestive discomfort. Symptoms, including nausea, vomiting, and diarrhea, typically alleviate on their own in 12-24 hours.