Neglect Tiny Losses!