What makes a weed a weed?

While pulling weeds in the garden this afternoon I noticed these pretty yellow flowers. I suspect it's actually a weed but they do add a little bit of colour to a dull corner.

Made me think about why some plants are accepted and admired while others we fight to remove. Especially as I had a major fight with the roots of a very hardy weed - sadly I came off worse!