2021-10-20: Not Your Parents’ Web: Scope, Segmentation, Stability, Resilience, and Persistence

"Even though the documents on the Internet are the easy documents to collect and archive, the average lifetime of a document is 75 days and then it is gone." -- Brewster Kahle, November, 1996 Researchers from the Internet Archive , Protocol Labs , and Old Dominion University will revisit the question “how long does a web page last?” The answer frequently given is 44 , 75 , or 100 days, all of which stem from research that dates back to 1996--2003. It is well-known that “44-100 days on average” does not capture the complexity of HTTP activity, but it is an easy to remember scalar number that people can understand. Much of the circulating knowledge regarding this question comes from the 1990s and early 2000s, before the large-scale adoption of JavaScript in web pages for dynamically producing content and the proliferation of native mobile apps (e.g., the release of the iPhone in 2007 ). The Filecoin Foundation has generously funded ($75k) this yea...