Lots of variables here. Obviously related to your neighbors your land provides something they want/need during the summer. As the season change the habitat on your neighbors land is addressing that need. I can assure you the answer is not in a bag of minerals or even as simple as a small food plot.
In the fall a good mast crop can significantly alter travel patterns, but you said this is a multi-year observation. Not sure that surrounding property mast crop would be that consistent with you not having any.
The cover structure could change to the extent that your cover is only good during spring/summer, but I don't think that's it either.
In the end my point is that you have to understand what it is that your neighbors have that you don't.
In the fall a good mast crop can significantly alter travel patterns, but you said this is a multi-year observation. Not sure that surrounding property mast crop would be that consistent with you not having any.
The cover structure could change to the extent that your cover is only good during spring/summer, but I don't think that's it either.
In the end my point is that you have to understand what it is that your neighbors have that you don't.