bluesky AT lists.ibiblio.org
Subject: Global-Scale Distributed Storage Systems
List archive
- From: hal AT finney.org
- To: bluesky AT franklin.oit.unc.edu
- Subject: Re: market-based data location (was Scalability)
- Date: Tue, 27 Feb 2001 09:20:16 -0800
Wei writes:
> Is there a paper that describes MojoNation in more detail than the
> technical overview? As far as I can tell from the technical overview[1],
> in MojoNation there is a central meta-tracker, which knows the address of
> every server in the network and what services they provide. And then there
> are content trackers and publication tracks which are distributed. My
> understanding is that content trackers provide keyword or metadata
> searching, and publication trackers are used by block servers to find and
> move data amongst themselves. So in order to find a data block from its
> content-hash ID, you first query the meta-tracker to obtain a block server
> whose block ID range covers your target. Then you query the block server,
> and it either gives you the block directly or finds it through publication
> trackers. Here the central meta-tracker is an obvious vulnerability and
> bottle neck.
There is a file describing their plans for distributed metatracking at
http://cvs.sourceforge.net/cgi-bin/cvsweb.cgi/~checkout~/evil/hackerdocs/distributed_metatracking.html?cvsroot=mojonation
However I am somewhat worried by:
This idea is simply "every broker a metatracker". I think we can use
the current metatracker protocols and the current source code to deploy
really good distributed metatracking.
I'm not sure it really moves us forward much if every node stores data,
every node runs trackers to index data, and now every node will run a
metatracker to index the trackers. It's starting to sound like "turtles
all the way down".
Hal
-
market-based data location (was Scalability),
Wei Dai, 02/26/2001
- <Possible follow-up(s)>
- Re: market-based data location (was Scalability), hal, 02/27/2001
- Re: market-based data location (was Scalability), Wei Dai, 02/27/2001
- Re: market-based data location (was Scalability), hal, 02/27/2001
- Re: market-based data location (was Scalability), Oskar Sandberg, 02/27/2001
Archive powered by MHonArc 2.6.24.