Crumb is a diminutive of the derogatory or already diminutive crumb for crumb ("soft part of bread, or its little leftovers"), which is also used as "little, small".