"Failed to use the skill due to an unknown reason."

For future reference, were any skills equipped to the gems? If yes, were they decent skills?

I did have haste/booster/shadow partner on them, but they had nothing on them when they were causing the text to keep appearing (which I think was the problem), and you can't put decent skills on auto buff gems at all (which is a shame because that'd be really useful)