Dismiss Notice
Join Physics Forums Today!
The friendliest, high quality science and math community on the planet! Everyone who loves science is here!

Wayback Machine to the rescue (almost)!

  1. Jul 14, 2007 #1


    User Avatar

    Staff: Mentor

    Last December, my college's Web server crashed because of a hard-disk failure. As I was fiddling with my most recent backup of my own Web pages, I clumsily managed to delete that, too. I had to resort to a much older backup that was missing several pages that I had created since then. I put the missing pages on my "to do" list to re-create, but never got around to doing it.

    Just today in a thread elsewhere on PF, someone mentioned the Wayback Machine, which I had forgotten about. I used it to search for my Web site, and voilĂ , there were the missing pages! :!!)

    There was just one problem. The pages are part of a large photo gallery, and all the images are in a directory that I've forbidden to Web crawlers via a robots.txt file. (Some people were slurping hundreds of pictures at once, and bogging the server down.) So the Wayback Machine has the Web page text, including the picture captions, but not the images. :cry:

    At least I can find the images again in my collection, based on the captions and URLs, but it will take some time to track them down and fix them up in Photoshop again. To make things easier in the future, I've added an entry to robots.txt that allows the Wayback Machine's crawler to fetch my images, while still forbidding other crawlers from doing so.
  2. jcsd
  3. Jul 14, 2007 #2


    User Avatar
    Gold Member

    Last edited: Jul 14, 2007
  4. Jul 14, 2007 #3
    "About the Wayback Machine:
    Browse through 85 billion web pages archived from 1996 to a few months ago. "

    "Thank you very much for considering us in your charitable giving. We appreciate and rely on donations from people like yourselves. The Internet Archive is a 501(c)(3) non-profit organization, therefore your donations are tax deductible as allowed by law."
    Last edited: Jul 14, 2007
Share this great discussion with others via Reddit, Google+, Twitter, or Facebook