Algorithm keeps resetting?

So my fyp is tailored to my interests (like indie games, memes, digital artists, alternative people, etc.) But every few scrolls I'm constantly having to press not interested because it completely resets and shows me stuff I've never been Interested in at all? (Mom and daughter stuff, makeup, viral dances, football/sports) and it annoys the hell out of me. Once I've pressed not interested enough my fyp goes back to normal for like 5 minutes, what's happening???