Skip to main content

Posts

Showing posts with the label dapper

Getting RSS from a site that doesn't offer RSS using Dapper and Yahoo Pipes

I was asked if it was possible to get RSS from a site that doesn't offer RSS. One site whose content I was interested in was " Community & Networks Connection " - it aggregates lots of "community and collaboration software" news.  Although the site offers RSS feeds, the news in the RSS feed looks like this below - all of the articles are chunked into daily digests forcing you to click through to the site and never, ever, catching your eye. Of course it would be possible to screen-scrape the data from the site and republish as RSS, maybe using a scripting language or the excellent ScaperWiki tool, but I really wanted something that anyone could use... in seconds. Dapper To The Rescue I began by visiting Dapper , a tool that lets you point and click and select which bits of a page you want to scrape. I began by clicking on the images of the news articles at the top. After a little fiddling, you can choose whether you want that data in...