Thottbot did, until they kind of died, update profiles and information in a batch. It queued up all the incoming responces, sorted them out ( to kill many of the duplicates ) and them proccessed them at a certain time interval. WoW Rankings works the same way.
It's most efficient when you have such a large pool of data each update. Processing everything right away would bogg the server down a lot and it would not stop duplicate stuff from constantly being process (ie; char profiles).
|