During the last few weeks a new crawler and parser were developed for FeedShow.
The crawler is now running and you will see it in your logs. Its name is “Feedshow/0.3″.
This crawler supports ‘conditional GET’ requests and handles file compression (gzip, deflate). It also adapts the crawl period automatically. A smooth algorithm adapts the period from 2 hours to 1 day depending on the update period of the RSS files (the final target is 1h to 1day).
The new parser is based on a modified version of the feedparser by Mark Pilgrim.
It can handle RSS 0.90, Netscape RSS 0.91, Userland RSS 0.91, RSS 0.92, RSS 0.93, RSS 0.94, RSS 1.0, RSS 2.0, Atom 0.3, Atom 1.0, and CDF feeds. It also parses several popular extension modules, including Dublin Core and Apple’s iTunes extensions.
Not all of the features (data model) are currently used in the FeedShow user interface, but it would not be a problem to add some later.
I will now concentrate on fixing details in the user interface. No new features (for now), just concentrate on making FeedShow an easy, fast, robust, … RSS feed reader (agregator).