Sage With Yahoo Pipes - Fetch Page

  • Thread starter Thread starter John Creighto
  • Start date Start date
  • Tags Tags
    Pipes
Click For Summary
SUMMARY

Sage is a Firefox aggregator designed for efficient viewing of RSS feeds. Yahoo Pipes, specifically the FetchPage module, allows users to combine multiple RSS feeds into a single feed, even enabling the parsing of web pages into RSS format. This functionality is particularly useful for aggregating new posts from forums that may not have native RSS feeds. Users can leverage this tool to streamline their monitoring of forum activity by extracting data from HTML tables on new posts pages.

PREREQUISITES
  • Familiarity with RSS feeds and their structure
  • Basic understanding of HTML and web scraping techniques
  • Knowledge of Yahoo Pipes and its modules
  • Experience using Firefox and its extensions
NEXT STEPS
  • Explore Yahoo Pipes FetchPage documentation for detailed usage instructions
  • Research how to parse HTML tables into RSS feeds
  • Investigate alternative RSS aggregators for comparison
  • Learn about web scraping tools like Beautiful Soup for advanced data extraction
USEFUL FOR

This discussion is beneficial for web developers, content curators, and anyone interested in optimizing their RSS feed management, particularly those looking to aggregate forum posts efficiently.

John Creighto
Messages
487
Reaction score
2
Sage is an agragator for firefox which makes it quick and easy to view rss feeds. http://pipes.yahoo.com/ is a feed blender let's you combine several rss feeds into one feed.

I want to be able to more efficiently check new posts on forms, so I would like to be able to combine feeds from several formus into a single feed. I can do this provided the forum has an rss feed. Not all forms do but these forums often have a new post feature.

Yahoo pipes has a module called "http://pipes.yahoo.com/pipes/docs?doc=sources#FetchPage ", which will let you fetch a wep page and parse it into an RSS feed. Does anyone one have good example on how to use this on the new posts page of forums? These pages often structure the information as an HTML table.
 
Last edited by a moderator:
Computer science news on Phys.org
What I might want to do might be tricky but on something related I found this cool pipe that can extract information from a face book group. Check out the functionality they have!

http://pipes.yahoo.com/jasonsilver/facebookgroup
 
Last edited by a moderator:

Similar threads

Regular Expressions and Yahoo Pipes
  • · Replies 2 ·
Replies
2
Views
5K
April Fool's Physics Papers 2026
  • · Replies 2 ·
Replies
2
Views
622
TabletPCs for Science and Science Teaching [blog entry from 2006]
  • · Replies 3 ·
Replies
3
Views
5K
Undergrad Preventing Hysteresis in homemade Force Sensing Resistors
  • · Replies 3 ·
Replies
3
Views
4K
Requesting suggestions for languages, libraries, and architectures for parallel (and sometimes non parallel) numerical and scientific computations
  • · Replies 8 ·
Replies
8
Views
5K
Mathematica How to type mathematical equations using LaTeX
  • · Replies 3 ·
Replies
3
Views
2K
Programs Math minor, double major, and elective classes advice
  • · Replies 4 ·
Replies
4
Views
4K
Graduate An illustration of a limitation of Wikipedia's utility
  • · Replies 10 ·
Replies
10
Views
6K
LaTeX Guide to Using LaTeX for Equations
  • · Replies 4 ·
Replies
4
Views
5K
A suggestion for dolphin communication.
  • · Replies 6 ·
Replies
6
Views
6K