Automated data collection from the net database

In summary, the conversation is about searching for a program that can copy data from a website into a text file using a specific code. The user is looking for a way to easily copy data from multiple dates on the website."
  • #1
vincent81
15
0
hi ..i have a little problem here...if u go to this site,
http://www.singaporepools.com.sg/fd_results3yrs/
u see the scroll down button...there are a lot of dates...each date links to a page in which i want to copy some data into a text file.
and this apples to all other dates...

anyone know any program which can do this job?
 
Computer science news on Phys.org
  • #2
load into array(single dimentional, one cell per character)
open "C:\Textfile.txt" for output as #1
for x = 2 to ubound(array()) - 2
if isnumerical(array(x)) then
if isnumerical(array(x + 1)) then
if isnumerical(array(x + 2)) then
if isnumerical(array(x - 1)) then
if isnumerical(array(x - 2)) then
print #1, array(x)
end if
end if
end if
end if
end if
next x
close #1

Hopefully this code will help you
 
  • #3


There are several programs that can help with automated data collection from a website's database. One option is to use a web scraping tool, which can extract data from a website and save it in a structured format such as a text file. Another option is to use a programming language like Python or JavaScript to write a script that automates the process of navigating through the pages and extracting the desired data. It may also be helpful to consult with a web developer or data analyst for assistance with this task.
 

1. What is automated data collection from the net database?

Automated data collection from the net database refers to the process of using software or tools to automatically gather and extract data from the internet or online databases. This data can then be used for analysis, research, or other purposes.

2. How does automated data collection from the net database work?

Automated data collection from the net database works by using programming or scripting languages to automate the process of retrieving data from online sources. This can include web scraping, API calls, or data extraction from databases.

3. What are the benefits of using automated data collection from the net database?

The benefits of automated data collection from the net database include saving time and resources, reducing human errors, and being able to gather and analyze large amounts of data quickly. It also allows for real-time data collection and can provide more accurate and consistent results.

4. Are there any limitations or challenges to automated data collection from the net database?

Yes, there can be limitations and challenges when using automated data collection from the net database. These can include websites or databases with complex structures that are difficult to scrape, data quality and accuracy issues, and legal or ethical concerns regarding data privacy and ownership.

5. How can I ensure the data collected through automated data collection from the net database is reliable?

To ensure the reliability of the data collected through automated data collection from the net database, it is important to carefully select and test the tools or software being used. It is also crucial to regularly monitor and validate the data collected to identify any errors or inconsistencies. Additionally, using multiple sources and cross-checking the data can help improve its reliability.

Similar threads

  • Computing and Technology
Replies
1
Views
957
  • Programming and Computer Science
Replies
11
Views
995
  • Programming and Computer Science
2
Replies
65
Views
2K
  • Computing and Technology
Replies
3
Views
2K
  • Other Physics Topics
Replies
5
Views
1K
Replies
5
Views
1K
  • Programming and Computer Science
Replies
8
Views
2K
  • Biology and Medical
Replies
3
Views
6K
Replies
5
Views
942
Replies
2
Views
881
Back
Top