VGCollect Forum
VGCollect Site Stuff => Site Feedback => Topic started by: sworddude on April 07, 2025, 06:10:59 am
-
In recent times the site seems slow. is something going on?
Loading times are really slow on just this site.
Others also experiencing this or just me
-
At times it does get slow. We are getting hit by a lot of bots and AIs who end up trying to scan the whole site. This issue is happening all over the web and has gotten worse once Deepseek was released to open source. We are looking into ways to mitigate it.
-
Yeah, it's been pretty slow. Good to know what's going on for a fix though.
-
Yeah, it's been pretty slow. Good to know what's going on for a fix though.
but what is going on to fix it? I see they say they are looking into it but no real explanation beyond that. This speed issue along with the site being down the other month makes adding anything to your collection on here a frustrating experience. I've been on here for 7 years and I've loved the site (even outwardly suggested it to people who have joined) but the last 6-12 months it feels like it has fallen into disrepair and I am starting to look into other options.
-
Thank you for posting that question, that is a very valid question.
Mainly the issue is scraping bots / AI (googles and Meta's models mainly), they are expensive to run and as such they scrape as much info as possible to monetize in any way possible.
There are generally a few main ways on how the bot and slow down the website as listed bellow.
- High Request Volume: and not enough bandwidth or processing power to provide for all the artificial visits.
- Insufficient Server Resources: such as relying on a single raid of hard drives (far slower than what an AI / Bot can handle hence why it can easily max out read write performance)
- Lack Of Caching: No caching means that it has to regenerate each page from scratch each time the Bot wants to read its contents
I hope that this helped to answer your question!
Kind Regards, Damian!