I use one of
these but for dandelions it also kills the surrounding grass. To pull them out I use a screwdriver to losen the soil around it, because if you don't get the root it will just grow back. I had one earlier this year that wasn't a very big plant, but had a root over 2 feet long.
But yeah, I'm doing the weed and feed route myself too.