100 or more grains of copper and lead in bullets that we don't sweat, I don't think the polymer tip is anything to worry about.
QDM published a study a while ago where a guy ate venison multiple times per day for a year. He had the levels of lead in his blood measured before and after. If I remember right, they stayed level or dipped slightly. So....nothing to fret about, really.