@LukeAlmighty I feel that most of the time this argument is made by lazy people trying to avoid responsibilities, but there are circumstances under which it's valid imo, mainly under some monopoly where your rights aren't technically violated, but there's only one available employer and it's not feasible to start your own business so your choice of association is limited.
Or with an example of speech, when majority of communication is done on the internet, but nobody wants to provide you service to host your legal site, none of your rights were violated, but your ability to say things gets in effect limited.