I wouldn’t worry. As others has said in this thread; a way more powerful magnet is present inside the HDD. Also fans produce magentic fields to a small degree. Then again, I don’t store anything important on the magnetic drive in my PC, so I’m not risking anything. 🤷♂️
You could always remove the magnet, and glue the support in.