Vulkan renderer degrading performance.

[Asas]

I've noticed for quite a while now that running vulkan and playing for about two hours straight or longer. Generally playing multiple games in the one session will cause the games performance to degrade very slowly until it finally drops that last chunk by a lot and enters the low 12 - 15 fps. If that happens you have to restart the game which will fix the issue until it happens again. Typing disconnect in the console and rejoining can help but only temporarily which it'll then drop into the low fps mode so a full restart of the game delays it the longest.

Specs:
CPU: i5-9600k
GPU: nvidia 3070 TI
Storage: SSD
RAM: 32GB
OS: Windows 10

There are a few theories I have as to what I think it could be. The most obvious answer is that it's a memory leak which could be true but some quirks i've noticed makes me believe it might not just be that.

1. Once the performance tanks and enters the 'low fps mode' the severity of the fps degradation is based on where you are on the map and where you're looking. Being in base, in the far left or right of the map and avoiding looking towards the center of the map actually helps a little but the problem still persists.
2. What causes it to finally kick in is a couple things: opening the store is pretty reliable for 'activating' the bug once it reaches the point of wanting to enter 'low fps mode'. Walker stomps and big particles either through ults, etc are also methods of activating it as well.
3. The fps counter becomes inaccurate. It'll still show your fps being low but not nearly as bad as it is visually. I'm assuming when it displays ~30fps it's actually 12 - 15 fps.

When I get a chance i'll clip it happening and post it here.