Browsing works as well as it does because the browser overlaps many requests. This turns out to be especially true for the dynamic diagrams recently added via algorithmic markup in Graphviz plugin. Our goal has always been to explore a region of the wiki by following all of the links on a page at once. We've now enabled this mechanism with a deceptively small code change.
A context object holds what we know about a link. We make a new context for every link we follow. The old code (red) would start a GET request and then wait for that to finish. The new code (green) first checks to see if we have already started that request and if not, falls back to the old logic.
This logic is part of the HERE keyword. Think of it as saying, now that we are finally here, let's look closely at this page.
There is a corresponding small modification to the LINKS keyword. Think of it as rummaging through the links on a page and choosing some to follow. Most (but not all) context objects are created by LINKS. Now we slip into these context objects a partially completed GET request to be finished when only when needed.