Semantic Wave Blog
News feeds and commentary by Jamie Pitts
Login  

« Bible Study | Main | Casual Ontology Development »

May 5, 2004

Distributing the Load of the Semantic Web

Ben Hammersley has put together a cool egoboo tracker for authors, culling data from Amazon, Technoratti, AllConsuming, and others (by way of Cory Doctorow). It is an interesting way to re-combine information.

Unfortunately, the Auctorial Ego Tracker is somewhat slow due to the fact that it assembles the source data in real-time. But it got me thinking about the use of web resources. As real-time meaning aggregators gain in popularity, they will begin to put a much heavier load on web services as well as web servers simply hosting RDF and XML files. If open source applications and useage practices are not developed to distribute the load, the power (and necessity) of well-funded intermediary services such as Google will continue to grow.

It is not surprising that one leading discussion among bloggers concerns the inefficient and potentially overwhelming consumption of RSS feeds. William Grosso's Sunday Afternoon Thoughts on the Design of RSS Aggregators does a good job of explaining this problem and offering solutions.

Some recent approaches to addressing interaction limitations actually borrow ideas from the internet, usenet, and web build-out, including pDNS and RSS over BitTorrent. There is also an interesting discussion on www-rdf-interest about distributing RDF queries.

On a related note, I have recently been sketching out how a small web community might maintain some sort of RDF cache / router / query platform to buffer the interaction between its members and the greater semantic web.

| TrackBack

Recent Entries
 Why we should call them "postmodern databases"
 Perl Upgrade to Semantic Wave
 Build Your Own Document Viewer
 local-openid: OpenID Authentication Only When I Need It
 Rapping About Proper HTML

Categories
 AI
 Blogs
 Business
 Data Munging
 Databases
 Development
 Formats
 How-To
 Ideas
 Languages
 Law
 Ontologies
 OWL
 People
 Perl
 Products
 Projects
 QOTD
 RDF
 Research
 Social Software
 SRM
 Standards
 Thinking Out Loud
 Trends
 Twitter
 Visualization
 W3C
 Web Services
 Wikis

Archives
 June 2010
 January 2010
 April 2009
 April 2008
 March 2008
 February 2008
 January 2008
 November 2007
 October 2007
 September 2007
 August 2007
 June 2007
 May 2007
 April 2007
 March 2007
 February 2007
 January 2007
 December 2006
 November 2006
 October 2006
 September 2006
 August 2006
 July 2006
 May 2006
 April 2006
 March 2006
 February 2006
 January 2006
 November 2005
 October 2005
 September 2005
 August 2005
 June 2005
 May 2005
 April 2005
 March 2005
 January 2005
 December 2004
 November 2004
 October 2004
 September 2004
 August 2004
 July 2004
 June 2004
 May 2004
 April 2004
 March 2004


Creative Commons License
This weblog is licensed under a Creative Commons License.

Powered by Movable Type

Copyright © Jamie Pitts