Cast on minion death bugged

Running a COMD build, has comet, firestorm and spark along with pinpoint critical and boundless energy 2. Every couple of maps, I have to buy a new spirit gem and make a new one because it bugs out. After a few maps it'll say there's no skill gem socketed... Make a new one and it goes back to normal but that's real annoying... Anyone know if there's a fix? Pulling it and throwing different skill or support gems on it doesn't work, logging out and back in doesnt work... When it happens and you try to reactivate it, The character gives a voice line acting like it's been activated while it doesn't show up or do anything....