Skip to Content.
Sympa Menu

bluesky - Re: market-based data location (was Scalability)

bluesky AT lists.ibiblio.org

Subject: Global-Scale Distributed Storage Systems

List archive

Chronological Thread  
  • From: hal AT finney.org
  • To: bluesky AT franklin.oit.unc.edu
  • Subject: Re: market-based data location (was Scalability)
  • Date: Tue, 27 Feb 2001 09:20:16 -0800


Wei writes:
> Is there a paper that describes MojoNation in more detail than the
> technical overview? As far as I can tell from the technical overview[1],
> in MojoNation there is a central meta-tracker, which knows the address of
> every server in the network and what services they provide. And then there
> are content trackers and publication tracks which are distributed. My
> understanding is that content trackers provide keyword or metadata
> searching, and publication trackers are used by block servers to find and
> move data amongst themselves. So in order to find a data block from its
> content-hash ID, you first query the meta-tracker to obtain a block server
> whose block ID range covers your target. Then you query the block server,
> and it either gives you the block directly or finds it through publication
> trackers. Here the central meta-tracker is an obvious vulnerability and
> bottle neck.

There is a file describing their plans for distributed metatracking at
http://cvs.sourceforge.net/cgi-bin/cvsweb.cgi/~checkout~/evil/hackerdocs/distributed_metatracking.html?cvsroot=mojonation

However I am somewhat worried by:

This idea is simply "every broker a metatracker". I think we can use
the current metatracker protocols and the current source code to deploy
really good distributed metatracking.

I'm not sure it really moves us forward much if every node stores data,
every node runs trackers to index data, and now every node will run a
metatracker to index the trackers. It's starting to sound like "turtles
all the way down".

Hal




Archive powered by MHonArc 2.6.24.

Top of Page