High Network MS spikes

Recently I have been experiencing high Network spikes which gives me stutters and causing a lot of deaths on my characters. This week it's so bad that I can't run max mod maps because I need to keep in mind I can die once in a map because of it. I tested with PoE1 and I have the same problem. The weird thing is that I don't have this in any other games. I have been troubleshooting for the past week and I can't find any solution to this problem. I am also not sure if this is coming from my side or GGGs side. Does anyone experience the same problems as me?

Troubleshooting:

- Change Gateways
- DirectX11-12-Vulkan
- Clear Cache & increased Cache size
- Speed tests (no issues or remarkable outcome)
- Different hours of the day (problem stays the same)
- Closing background programs / overlays
- Reinstall PoE2
- Changed NVIDIA 3D settings
- Clean Installed GPU Drivers

I am lost and I don't know how I can continue playing the game like this. I enjoy the game a lot but it is taking away the fun. I really hope someone can help me. Thanks!