Re: [Ebiness-crawler] Disk storage

[Sellaro <se...@ma...>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On Tue, 8 May 2001, Mike Davis wrote:

> Ummm, would be interesting, if you've got the time... What was your exa=
ct
> strategy going to be? B-Tree based system?

In fact, a B* or B+-tree.

> It seems to me that you're quite interested in the storage side and as
> such, I hereby delgate that aspect of the project to you ;->

Uhmmm. OKay. I accept the delegation ;)

Back to pre-hash algorithm, I would like to know if you have already
planned something. Have you thinked about key size? Hash algorithm? My
first impression was to use MD5 or some other similar algorithm, but I
noticed that their generated key size could affect somohow filesystem
performance. What do you think?

> So I think what I will do is organise a list of things that need doing =
and
> we can talk about them and then split them up amongst us (the intereste=
d
> parties). At the moment, I'm quite interested in pushing on and startin=
g
> work on the browser portion of the project, as we've now got a
> semi-functional crawler and quite a bit of data to play with.

Take your time. You could use SF's task manager. It really works! :)


- --
Sellaro

Network Administrator
Federal University of Cear=E1 (UFC)
Computer Science Dept.
PCT-Motorola Laboratory

PGP/GNU PG Public Key Available at http://sellaro.pathbot.com/
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.0.4 (GNU/Linux)
Comment: For info see http://www.gnupg.org

iD8DBQE6+Nx3x3CBMgQUSLYRAvL5AJ9hgbVdEvXBIy6+HdOQEYAWqFl3fACeKx8Q
OLMdfByrWZoEBx6R5XfyNrY=3D
=3DBqUA
-----END PGP SIGNATURE-----