Automated data collection from the net database

AI Thread Summary
The discussion revolves around extracting data from a specific webpage, http://www.singaporepools.com.sg/fd_results3yrs/, which features a scroll-down button with multiple dates linked to individual pages. The goal is to copy data from these pages into a text file. A code snippet is provided that demonstrates how to load data into a single-dimensional array and write specific numerical values to a text file. The code includes checks to ensure only valid numerical entries are printed, indicating a focus on data integrity during extraction. The overall objective is to automate the data collection process efficiently.
vincent81
Messages
15
Reaction score
0
hi ..i have a little problem here...if u go to this site,
http://www.singaporepools.com.sg/fd_results3yrs/
u see the scroll down button...there are a lot of dates...each date links to a page in which i want to copy some data into a text file.
and this apples to all other dates...

anyone know any program which can do this job?
 
Computer science news on Phys.org
load into array(single dimentional, one cell per character)
open "C:\Textfile.txt" for output as #1
for x = 2 to ubound(array()) - 2
if isnumerical(array(x)) then
if isnumerical(array(x + 1)) then
if isnumerical(array(x + 2)) then
if isnumerical(array(x - 1)) then
if isnumerical(array(x - 2)) then
print #1, array(x)
end if
end if
end if
end if
end if
next x
close #1

Hopefully this code will help you
 
This week, I saw a documentary done by the French called Les sacrifiés de l'IA, which was presented by a Canadian show Enquête. If you understand French I recommend it. Very eye-opening. I found a similar documentary in English called The Human Cost of AI: Data workers in the Global South. There is also an interview with Milagros Miceli (appearing in both documentaries) on Youtube: I also found a powerpoint presentation by the economist Uma Rani (appearing in the French documentary), AI...
Back
Top