Spiders are taking over

  • Thread starter wolram
  • Start date

wolram

Gold Member
4,223
551
They are takeing over, there are more of them than users, pity they don't
post.
 
395
1
I have not seen a spider for three weeks now. Right now, they're just lots of ants crawling all over the place. :grumpy:

At least spiders don't invade a house in colonies.
 

dduardo

Staff Emeritus
1,894
3
If you really wanted to write a spider that could post you could. Basically you'll use wget to download the pages, then using a little regex you'll find all the "<a href=""></a>". You'll then do another wget, traversing link after link until you get to a page that has a post quick reply. Using the cURL library you'll POST the message you want to the server. One major thing that you'll need to do is send the cookie containing your userid to the server. Without this you'll never be able to post.
 

rachmaninoff

Mk

1,963
3
dduardo said:
If you really wanted to write a spider that could post you could. Basically you'll use wget to download the pages, then using a little regex you'll find all the "<a href=""></a>". You'll then do another wget, traversing link after link until you get to a page that has a post quick reply. Using the cURL library you'll POST the message you want to the server. One major thing that you'll need to do is send the cookie containing your userid to the server. Without this you'll never be able to post.
*shudders*
 
395
1
I had a blog once, which I maintained for around 3 months until I realised that most of the visitors I was getting were probably spiders.
 

Related Threads for: Spiders are taking over

  • Posted
Replies
21
Views
3K
Replies
18
Views
2K
Replies
8
Views
1K
  • Posted
2
Replies
30
Views
5K
  • Posted
2
Replies
25
Views
73K
Replies
57
Views
6K
Replies
20
Views
2K
  • Posted
Replies
19
Views
749

Physics Forums Values

We Value Quality
• Topics based on mainstream science
• Proper English grammar and spelling
We Value Civility
• Positive and compassionate attitudes
• Patience while debating
We Value Productivity
• Disciplined to remain on-topic
• Recognition of own weaknesses
• Solo and co-op problem solving

Hot Threads

Top