When we only hear one side of the story - absolutely.
When we also hear from the co-workers of the putative abusers that they recognize his behaviors? When the evidence put forth by the putative abuser actually confirms the original testimony of the abused?