Interesting information in that link.
I think I completely misunderstood what you were asking for (AI for search engines) with traditional AI low level search.
But it is not that today's search engines haven't incorporated artificial intelligence, because the latter is seen from many perspectives. Google, and Yahoo, for example search the web with the so called 'intelligent agents', or sometimes called robots, or Googlebots, etc.
What is asked to be incorporated further in the search engines is the higher level 'semantic search' in addition to 'syntax search'. That is, the search agents aren't supposed to look only for exact word matches, but also for texts that match in meaning to your keywords. So, expecting a dramatic increase in the information offered in web servers, it will be a daunting task to find for information resources that match your needs just with todays engines like Google, where syntax search is being employed.