That is a bizarre situation...I have a few different guesses:
You may have subconsciously associated them with food for the reason that you once or frequently ate in the person's company; e.g. go to lunch with them all the time, etc.
You may simply see them each day when you are about to eat; more likely should you have a reliable daily schedule. (meaning you are not actually hungry because of them)
You may find some aspect of them aesthetically pleasing (perhaps subconsciously), which may cause you to salivate, which you in turn might associate with being hungry.