Yes, you used the wrong tool. You used a patch worm, which is used for retrieving stuck cleaning patches.
If I were you, I'd go online to one of the muzzle loader supply houses, such as Track of the wolf, or Muzzle loader builder's supply, or Dixie gun works. Purchase a .50 caliber ball puller, the kind that has the brass bushing behind the screw. This type of puller will assure the screw will penetrate straight into the ball. Do not buy one that is just a screw, those kind can wander off center and damage the bore. Also buy a bore guide that slips over the ramrod, or range rod. A bore guide looks kind of like a small funnel. It is used to protect the crown of the muzzle from wear by the range rod. Use a T-Handle on your rod for leverage. You should be able to pull the ball fairly easily once you have the right equipment. if its tight, get an extra set of hands to hold the gun while you pull. It will be tight in some instances, but not all, but it will come out.
I would try this method before attempting to fire the ball out. Its easier and less messy.
Last edited by Blue Bird; 12-31-2016 at 11:02 AM.