I believe the answer is: They lack power unless they are well funded
In lobbying, the more fund that a certain lobbyist group has, the larger their ability to increase the popularity of a certain candidate became.
Since lobbyist for farmworkers had low economic power, they wouldn't be able to support enough campaigns to help their candidate to win.