Lead *is* harmful, but zillions of people have handled lead and had (led!) normal lives. It's not cyanide. If you (or your kids) handle lead regularly, you should have your lead levels checked during your annual checkup. If you're just shooting pellets, I probably wouldn't even bother. Shooting lead bullets - still not a problem. Reloading lead bullets - get the check. Casting lead bullets - definitely get checked. Point is, it takes pretty significant exposure to matter, but if you have significant exposure, you should get a routine check.
GsT (High in lead one year - switched to stainless wet tumbling and cleaned teh shop with Led-D-Solv and haven't had a problem since.)