Science  /  Retrieval

The 1970s Librarians Who Revolutionised the Challenge of Search

A group of 1970s campus librarians foresaw our world of distributed knowledge and research, and designed search tools for it.

It’s easy to see why librarians of the 1970s set out to revolutionise search. Work across the academy was expanding to such a degree that, soon, there would not be enough human librarians to support all of it. Yet, to get the information they needed, researchers would face a time-consuming, physically involved process that required librarian intervention. While academic researchers could browse new issues of journals in their field, for a focused search of all that had come before they still had to consult with a reference librarian to look up the correct Library of Congress subject headings within a multivolume manual. Armed with a set of subject headings, the researcher would then search across the library catalogue for books and in citation indexes for journal articles, including subscription databases such as the Science Citation Index as well as hand-built bibliographies created by their university’s subject librarians. Finally, they would physically track down the correct books and bound periodicals that included articles they thought might be relevant – if the volumes happened to be on the library shelves.

It’s no wonder that SUPARS participants found the system compelling, despite its limitations. And given how familiar university librarians were with the challenges of search, it makes sense that the system they designed bypassed subject headings and citation indexes. What’s more surprising is that, of all the online search experiments that took place during this period – including commercially focused search systems like Lockheed’s Dialog, which has since become an enterprise product – SUPARS mimicked contemporary web search more closely than any other, prefiguring several primary features of web-search protocols we rely on more than 50 years later.

SUPARS and other largely forgotten systems were the forerunners of the contemporary search engines we have today. While the popular history of the internet valorises Silicon Valley coders – or, sometimes, the former US vice president Al Gore – many of the original concepts for search emerged from library scientists focused on the accessibility of documents in time and space. Working with research and development funding from the military and industry, their advances can be seen everywhere in the current online information landscape – from general approaches to ingesting and indexing full-text documents, to free-text searching and a sophisticated algorithm utilising previous saved searches of others, a foundational building block for contemporary query expansion and autocomplete. Indeed, these and many other approaches developed by campus pioneers are still used by the multibillion-dollar businesses of web search and commercial library databases from Google to WorldCat today.