Although the complete phrase would be "lose someone the good concept that was had of him", it is understood the same and does not become a locution.
LOSING THE CONCEPT in a conversation or an analysis, getting out of the central idea. In a design of something, get out of the desired style.