changing font size for y-axis factor labels

I am trying to reduce the font size for y-axis labels, not ylab, but the 
actual categorical names.  I have tried cex, cex.axis, cex.lab, font, 
but none seem to do the trick.  Any ideas?  thank you.