Searching inside .zip files on internet

  • Thread starter Thread starter Vespero
  • Start date Start date
  • Tags Tags
    files Internet
AI Thread Summary
Searching through .zip files on the internet without downloading them is challenging, as most search engines do not support this functionality. Users typically need to download the entire .zip file to access its contents, regardless of the file type inside. HTTP version 1.1 allows for byte serving, which could help in some scenarios, but it does not eliminate the need to retrieve files locally. Custom search code could potentially filter files based on names, but it would still require downloading to access the contents. Ultimately, there is no straightforward method to search within .zip files remotely without first downloading them.
Vespero
Messages
26
Reaction score
0
Is anyone aware of a way to search through .zip files on the internet (such as in an archive site) without having to download and extract the files? For example, if I have a search phrase that may be in a .doc file inside a .zip file which is potentially stored with many other .zip files, I don't want to have to download them all and have to manually search through them, but would like to be able to at least find the correct .zip to download first.

Many thanks.
 
Computer science news on Phys.org
Vespero said:
Is anyone aware of a way to search through .zip files on the internet (such as in an archive site) without having to download and extract the files? For example, if I have a search phrase that may be in a .doc file inside a .zip file which is potentially stored with many other .zip files, I don't want to have to download them all and have to manually search through them, but would like to be able to at least find the correct .zip to download first.

Many thanks.

If your using HTTP version 1.1 then yes because you can use ranges.

http://en.wikipedia.org/wiki/Byte_serving
 
SixNein said:
If your using HTTP version 1.1 then yes because you can use ranges.

http://en.wikipedia.org/wiki/Byte_serving
I think he is hoping to use a search engine - and I don't think any of them do what he wants.

If he's writing the search code himself, your byte range thing would be useful if he could eliminate many of the files based on their filename. But whenever a zip file contained only files like *.txt, *.docx, he would still need to read the whole zip file.
 
I can't think of any way for a search bot to look inside any file out on a web server without first retrieving the file to local disk. It seems irrelevant whether the file is compressed (zipped) or not. If you are writing code, you can certainly get a library to open the zip so it can be searched as plain text or whatever format you expect.

Unless perhaps you were able to inject pernicious code onto the web server itself so that the code runs THERE, but that would be only if you are permitted to add code to a site. It would not apply to most sites. If your code is looking at files on the web, they must first be fetched to your local disk by the HTTP client. Period.
 
This week, I saw a documentary done by the French called Les sacrifiés de l'IA, which was presented by a Canadian show Enquête. If you understand French I recommend it. Very eye-opening. I found a similar documentary in English called The Human Cost of AI: Data workers in the Global South. There is also an interview with Milagros Miceli (appearing in both documentaries) on Youtube: I also found a powerpoint presentation by the economist Uma Rani (appearing in the French documentary), AI...
Back
Top