Does this "First Warning" thing ever go away?

Eventually. Don't remember exactly how long tho. It's a good while unfortunately.

90 days if you don’t get in anymore trouble.

90 days .. but it was a glitch last week that gave millions of us first warnings.. mine is gone now

Mine went away after a few days

I logged out of my account and logged back in like 3 days later and it was gone