grub-develop — Developers Issues

[Grub-develop] About the Server code

[Igor S. <oz...@gr...>]

Grubsters,

I was seek for the past couple of days, so I wasn't very productive.

In the next few days, I will put up a makefile for the Server, and also some
Server code that me and other developers have written.

In particular, I am almost done with the CRW module -- the module that
connects to the distributed Clients, and which also controls the behavior of
the threads (the IND module) responsible for carrying out the complete
protocol with Clients.

There will be a little code from the IND module, as well.

Ben will post the LOG module for the Server, as well.

There is also the ROOT module, which is basically where the main() function
will reside.  And, of course, the DBP module, which all these hot
discussions on the grub-database mailing list are about.  After we complete
these modules, we will be done with the first stage of our project (as far
as the Server is concerned), which will be prototype for the final release.

Cheers,

igor.

--------------------------------------------------------------
Igor Stojanovski                                 Grub.Org Inc.
Chief Technical Officer                 5100 N. Brookline #830
                                       Oklahoma City, OK 73112
oz...@gr...                            Voice: (405) 917-9894
http://www.grub.org                        Fax: (405) 848-5477
--------------------------------------------------------------

[Grub-develop] Update...

[Igor S. <oz...@gr...>]

Dear developers,

Little update on what's going on as far as development is concerned.
Remember that you can read about the modules at
http://www.grub.org/stage1.txt.

Rodrigo and Robert are working on the database -- designing the schema -
querying, etc...

Ramaseshan is working on the crawler (module code-named CRW).  This module
reads from a list of URLs the Client was previously given to crawl, and
crawls each one of those URLs.  Then, he distracts any links from those
pages, and stores them locally on the Client.  The contents of the crawled
pages is also stored.

Kosta is working and is probably finished by this time with modifying the
communications module for the Client, that is, a UNIX/Windows portable code
that abstracts TCP Sockets, and HTTP. (Module code-named CCOM.)

Mikhail and Puneet are given a module that will archive crawled the contents
of the crawled pages on the Client side.

I am working on the CRW and IND modules.  CRW works as a web server - waits
for any Clients to connect; IND implements the complete communication
protocol with the Client.  It interacts with the database to index data
arriving from the Client, or to give URLs to the Client -- whatever is
appropriate.  The protocol will be translated into C code.

Ben finished with the LOG module.

There are some other people involved in the project that are either busy
with their own stuff at the moment, or are still getting to know more about
the project.

Good job coding guys. (There ain't no girls involved yet... I think :)


Cheers,

igor.

--------------------------------------------------------------
Igor Stojanovski                                 Grub.Org Inc.
Chief Technical Officer                 5100 N. Brookline #830
                                       Oklahoma City, OK 73112
oz...@gr...                            Voice: (405) 917-9894
http://www.grub.org                        Fax: (405) 848-5477
--------------------------------------------------------------