It is a locution, which would be a reduced version of "by the pretty face", although it can also be interpreted by other faces.