htdig-dev — Developer Discussion for the ht://Dig project

[htdig-dev] Re: [htdig] Test platforms available?

[Lachlan A. <lh...@us...>]

Thanks, Neil!  The latest snapshot is at

<http://www.htdig.org/files/snapshots/htdig-3.2.0b4-20030615.tar.gz>

The standard tests we run are just
(a) ./configure --enable-tests && make check
(b) Add "robotstxt_name: master-htdig" to  htdig.conf  and do a dig of
    http://www.htdig.org
The second test produces a database of around 400MB.

Thanks again,
Lachlan

On Tue, 17 Jun 2003 04:34, Neil Kohl wrote:
> I've been on vacation for the last week so I just saw this message
> on the htdig list.
>
> Our production htdig was compiled with gcc, but I have Sun C++ on
> one of our Solaris boxes.  I'd be happy to give b5 a whirl. Where's
> the tarball?
>


--=20
lh...@us...
ht://Dig developer DownUnder  (http://www.htdig.org)

Re: [htdig-dev] 3.2.0b5 Next progress check :)

[Neal R. <ne...@ri...>]

On Tue, 17 Jun 2003, Lachlan Andrew wrote:

> Greetings all,
>
> Are people happy with the tentative timetable I mailed a week ago?  If
> so, the Unix code should be essentially complete now, and 3.2.0b5
> will be released in one week's time.  Neal and Jess, do you still
> plan to make any changes?

  Yes.  I'll do some more with memory-leak fixes and the Win32 port.

  I'm in the process of comparing my tree with the CVS tree and moving
changes over to CVS. I plan to commit code frequently this week and get
my tree synched.

  I will also take care of updating the GPL notifications to LGPL.

  Thanks!


> Geoff, could you please post a to-do list for the release docs?  All I
> can think of is
> - Replace all references to 3.2.0b4 as current with 3.2.0b5
>   (Can this be automated at all?)
> - Remove checklist and solved issues from STATUS
> - Update copyright (if possible -- I don't see this as critical...)
>
> Please let me know what I can do to help the release.
>
> Thanks,
> Lachlan
>
> On Sun, 8 Jun 2003 15:20, Lachlan Andrew wrote:
>
> > Thank you to everybody for your work towards getting 3.2.0b5 out.
> > Geoff:  Did you manage the copyright update?  If you have written
> > the sed script, but haven't had time to apply/commit, could you
> > please post it?  I should have some time this week to do that.
> >
> > Neal: It's good to hear that you're coming along with the Win32
> > port. From where I'm standing, the highest priority is applying the
> > memory-leak patch, so that the rest of us can test it thoroughly.
> > Could you please do that some time this week?
> >
> > Jess:  Any luck with the HP-UX configuration?  If you post the
> > config.log then one of the rest of us might have an idea why it is
> > failing.
> >
> > Does the following timeline sound feasible?
> > This time, I think the showstoppers are gone, so we can afford to
> > set a firm timeline (although not necessarily this one :)
> >
> > Sun 8 - Fri 13: Finalise Unix code / configuration
> > 		Update copyright
> > 		Other documentation updates?
> > Weekend 14-15: Unix code freeze, and re-test all available
> >                platforms
> >		 Ask "non-team" volunteers to "install/make check" the
> >		 snapshot
> > Mon 16-Fri 20: Finish Win32, or decide to postpone until
> 		 3.2.0b6 Further documentation updates?
> > 		 Testing by non-team volunteers
> > Weekend 21-22: Code freeze
> > 		 Test Win32 (if finished)
> > 		 Rename 3.2.0b4->3.2.0b5
> > Mon 23:        BETA RELEASE
> >
> > What docs need to be updated?
>
> --
> lh...@us...
> ht://Dig developer DownUnder  (http://www.htdig.org)
>
>
> -------------------------------------------------------
> This SF.NET email is sponsored by: eBay
> Great deals on office technology -- on eBay now! Click here:
> http://adfarm.mediaplex.com/ad/ck/711-11697-6916-5
> _______________________________________________
> htdig-dev mailing list
> htd...@li...
> https://lists.sourceforge.net/lists/listinfo/htdig-dev
>

Neal Richter
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485

[htdig-dev] 3.2.0b5 Next progress check :)

[Lachlan A. <lh...@us...>]

Greetings all,

Are people happy with the tentative timetable I mailed a week ago?  If=20
so, the Unix code should be essentially complete now, and 3.2.0b5=20
will be released in one week's time.  Neal and Jess, do you still=20
plan to make any changes?

Geoff, could you please post a to-do list for the release docs?  All I=20
can think of is
- Replace all references to 3.2.0b4 as current with 3.2.0b5
  (Can this be automated at all?)
- Remove checklist and solved issues from STATUS
- Update copyright (if possible -- I don't see this as critical...)

Please let me know what I can do to help the release.

Thanks,
Lachlan

On Sun, 8 Jun 2003 15:20, Lachlan Andrew wrote:

> Thank you to everybody for your work towards getting 3.2.0b5 out.
> Geoff:  Did you manage the copyright update?  If you have written
> the sed script, but haven't had time to apply/commit, could you
> please post it?  I should have some time this week to do that.
>
> Neal: It's good to hear that you're coming along with the Win32
> port. From where I'm standing, the highest priority is applying the
> memory-leak patch, so that the rest of us can test it thoroughly.
> Could you please do that some time this week?
>
> Jess:  Any luck with the HP-UX configuration?  If you post the
> config.log then one of the rest of us might have an idea why it is
> failing.
>
> Does the following timeline sound feasible?
> This time, I think the showstoppers are gone, so we can afford to
> set a firm timeline (although not necessarily this one :)
>
> Sun 8 - Fri 13: Finalise Unix code / configuration
> =09=09Update copyright
> =09=09Other documentation updates?
> Weekend 14-15: Unix code freeze, and re-test all available
>                platforms
>=09=09 Ask "non-team" volunteers to "install/make check" the
>=09=09 snapshot
> Mon 16-Fri 20: Finish Win32, or decide to postpone until
=09=09 3.2.0b6 Further documentation updates?
> =09=09 Testing by non-team volunteers
> Weekend 21-22: Code freeze
> =09=09 Test Win32 (if finished)
> =09=09 Rename 3.2.0b4->3.2.0b5
> Mon 23:        BETA RELEASE
>
> What docs need to be updated?

--=20
lh...@us...
ht://Dig developer DownUnder  (http://www.htdig.org)

[htdig-dev] Re: HTDig on IA64 Linux

[Lachlan A. <lh...@us...>]

Greetings David,

I think that the code is pretty much finalised now, and it would be=20
great if you could run some tests on the Itanium.

In particular, we have been testing with
(a) ./configure --enable-tests && make check
(b) Add "robotstxt_name: master-htdig" to  htdig.conf  and do a dig of
    http://www.htdig.org
The second test produces a database of around 400MB.

Thanks again,
Lachlan

On Mon, 2 Jun 2003 08:26, David Bannon wrote:

> If you have any specific tests you would like me to run, I'll do so
> and you can add RedHat AdvancedServer on Itanium II to your
> supported platforms. We are quite happy to undertake tests as
> requested or before a release.

--=20
lh...@us...
ht://Dig developer DownUnder  (http://www.htdig.org)

[htdig-dev] Re: Status of htdig development

[Lachlan A. <lh...@us...>]

No, we're still chugging along.

We hope to release a new beta (3.2.0b5) in about a week, which should=20
liven up the web site a bit.

Of course, we'd love to have some extra developers or beta-testers if=20
you'd like to hop on board :)

Cheers,
Lachlan

On Tue, 10 Jun 2003 02:51, Jeffrey Silverman wrote:
> What is the status of htDig?  has it died a quiet Open Source
> death?
>
> the ht://Dig website does not seem to have been much updated since
> February of 2002, so I was wondering...

--=20
lh...@us...
ht://Dig developer DownUnder  (http://www.htdig.org)

[htdig-dev] Current Status as of snapshot 3.2.0b4-20030615

[Geoff H. <ghu...@us...>]

STATUS of ht://Dig branch 3-2-x

CHECKLIST FOR 3.2.0b5:
* Apply memory leak patches (Neal)
* Check bugs listed in bug-tracker...
* Polish release docs (Geoff)
* Must be able to
	(a) make check  and
	(b) index  www.htdig.org  using  "robotstxt_name: master-htdig"
  on all systems listed as "supported".
  Systems tested so far:
    - Mandrake 8.2, gcc 3.2 (lha, 21 May)
    - FreeBSD 4.6, gcc 2.95.3 (lha, 23 May)
    - Debian, Linux kernel 2.2.19, gcc 2.95.4 (lha, 23 May)
    - SunOS 5.8 = Solaris 2.8, gcc 3.1 (lha, 25 May)
    - SunOS 5.8 = Solaris 2.8, Sun cc with g++ 3.1 (lha, 29 May)
    - OS X (Jim, 30 May)
  Partly tested:
    - RedHat 8 (Jim, 1 June.  make check requires tweaking for apache)
    - SunOS 5.8 = Solaris 2.8, gcc 2.95.2
	    (lha. Makes check minus apache, Digs small htdig.org. 27 May)
    - SunOS 5.8 = Solaris 2.8, Sun cc with g++ 2.95.2
	    (lha. Makes check minus apache, Digs small htdig.org. 2 June)
    - RedHat 7.3
	    (lha. Makes check minus apache. Digs small htdig.org. 25 May)
    - Alpha Debian
    	    (lha. Makes check minus apache. Digs small htdig.org. 25 May)
  To be tested:
    - HP-UX 10.20, gcc 2.8.1 (Jesse)
    - RedHat, other versions anyone?
    - RedHat AdvanceServer Itanium II (David Bannon)
  Known to have problems:
    - SGI/Irix 6.5.3 using SGI compilers
      <http://www.geocrawler.com/mail/msg.php3?msg_id=8025827&list=8825>





RELEASES:
   3.2.0b5: Next release, June 2003???
   3.2.0b4: "In progress" -- snapshots called "3.2.0b4" until prerelease.
   3.2.0b3: Released:  22 Feb 2001.
   3.2.0b2: Released:  11 Apr 2000.
   3.2.0b1: Released:   4 Feb 2000.

(Please note that everything added here should have a tracker PR# so
we can be sure they're fixed. Geoff is currently trying to add PR#s for
what's currently here.)

SHOWSTOPPERS:
* Mifluz database errors are a severe problem (PR#428295)
-- Does Neal's new zlib patch solve this for now?

KNOWN BUGS:
* Odd behavior with $(MODIFIED) and scores not working with
   wordlist_compress set but work fine without wordlist_compress.
   (the date is definitely stored correctly, even with compression on
    so this must be some sort of weird htsearch bug) PR#618737.
* META descriptions are somehow added to the database as FLAG_TITLE,
   not FLAG_DESCRIPTION. (PR#618738)
   Can anyone reproduce this?  I can't! -- Lachlan

PENDING PATCHES (available but need work):
* Additional support for Win32.
* Memory improvements to htmerge. (Backed out b/c htword API changed.)
* Mifluz merge.

NEEDED FEATURES:
* Quim's new htsearch/qtest query parser framework.
* File/Database locking. PR#405764.

TESTING:
* httools programs: 
  (htload a test file, check a few characteristics, htdump and compare)
* Tests for new config file parser
* Duplicate document detection while indexing
* Major revisions to ExternalParser.cc, including fork/exec instead of popen,
  argument handling for parser/converter, allowing binary output from an
  external converter.
* ExternalTransport needs testing of changes similar to ExternalParser.

DOCUMENTATION:
* List of supported platforms/compilers is ancient. (PR#405279)
* Document all of htsearch's mappings of input parameters to config attributes
   to template variables. (Relates to PR#405278.)
  Should we make sure these config attributes are all documented in
  defaults.cc, even if they're only set by input parameters and never
  in the config file?
* Split attrs.html into categories for faster loading.
* Turn defaults.cc into an XML file for generating documentation and 
  defaults.cc.
* require.html is not updated to list new features and disk space
   requirements of 3.2.x (e.g. regex matching, database compression.)
   PRs# 405280 #405281.
* TODO.html has not been updated for current TODO list and
   completions.
   I've tried.  Someone "official" please check and remove this -- Lachlan
* Htfuzzy could use more documentation on what each fuzzy algorithm
   does. PR#405714.
* Document the list of all installed files and default
   locations. PR#405715.

OTHER ISSUES:
* Can htsearch actually search while an index is being created?
* The code needs a security audit, esp. htsearch. PR#405765.

[htdig-dev] Re: recent cvs commits

[Lachlan A. <lh...@us...>]

Thanks for that, Gilles.  I must apologise for introducing the config=20
bug when I was zealously putting all default values in defaults.cc=20
some time back...

Have a good holiday!

Lachlan

On Fri, 13 Jun 2003 05:29, Gilles Detillieux wrote:
> OK, I've committed the translate_latin1 attribute addition.  I've
> also fixed the default value for "config" in defaults.cc, backed
> out Lachlan's hack for that in Display.cc, and fixed htsearch.cc's
> handling of boolean_keywords when more than one config is
> specified.  Please give this a test on your systems - I'm satisfied
> that my changes are OK on my Red Hat 9 system.
>
> I'll be away from this Saturday until July 2, so if you need me for
> anything before early July, let me know by tomorrow morning.

Re: [htdig-dev] Re: Feedback on configuring ht://Dig?

[Gilles D. <gr...@sc...>]

According to Jonathan Baron:
> I removed the second and the last sentence from the following and
> submitted it as a response to my original bug report to RedHat,
> #11074.  Hope that is OK.

That's great, thanks.  Thanks for the edits too.  I really need to install
that filter in my brain.  :)

> On 06/12/03 15:29, Gilles Detillieux wrote:
> >They point it to /var/www/html/htdig.  Actually, they do lots of really
> >dumb things in their RPM package.  First of all they set common_dir
> >and image_dir to the same thing, then they move /var/www/html/htdig
> >to /usr/share/htdig.  In previous RPMs, they then made a symlink from
> >/var/www/html/htdig (in the htdig-web package) over to /usr/share/htdig,
> >so that htsearch et al. only found the common files if you had installed
> >both htdig and htdig-web packages, and htsearch's images would only load
> >if you configure httpd to follow symlinks.  Now, to resolve the latter
> >problem, they use an Apache Alias instead of a symlink, so the images
> >load, but nothing will find the common files unless you fix common_dir
> >in your htdig.conf.  Maybe in another year or two they'll finally get
> >it right.
> >
> >I can send you their .spec file if you're interested.
> 
> No. Thanks.
> 
> Jon


-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

[htdig-dev] Re: "Compute Page Rank GPL Code"

[Geoff H. <ghu...@ws...>]

http://slashdot.org/article.pl?sid=03/06/12/1742209&mode=thread&tid=134

Basically, it looks like there's now a GPL'd Java implementation of 
what Google has published about their "PageRank" feature. The current 
ht://Dig "backlink_factor" is a quick-and-dirty hack I put in to try to 
get some of the benefit of the PageRank weightings that Google uses.

So if anyone's feeling interested, take a look at the Java code:
http://webgraph.dsi.unimi.it/

It also looks like there's a compact method for storing the link graph, 
which might add all sorts of useful features to ht://Dig (e.g. 
presenting pages that link to a search result, searching linked or 
linking pages for search words, etc.)

-Geoff

Re: [htdig-dev] Re: Red Hat

[Gilles D. <gr...@sc...>]

As far as I know, Apache has always allowed putting all access.conf
and srm.conf directives right in httpd.conf.  The 3 file setup was a
carryover from NCSA httpd, but I don't think Apache 1.x ever enforced any
context-specific stuff in any of the files.  With Apache 2, they've done
away with the deprecated files.  I think the portable way to configure
Apache would be to put everything in httpd.conf, but put out empty
srm.conf and access.conf files just to keep Apache 1 happy.

According to Lachlan Andrew:
> Excellent work, Jim!
> 
> Could you please mail a list of the lines you commented out?  It would 
> be really nice to have  make check  work "out of the box", and I 
> think most of the lines in *.conf are not necessary for any platform.
> 
> The first warning was due to a (trivial) bug, and I'll also get rid of 
> the last.  The other two seem harmless and platform-dependent, so 
> I'll leave them for now.
> 
> Thanks for your detective work :)
> Lachlan
> 
> On Sun, 1 Jun 2003 12:04, Jim Cole wrote:
> > I tested Friday's CVS on a Red Hat 8 system.
> >
> > I ran rundig against www.htdig.org using robotstxt_name:
> > master-htdig and did not encounter any noticeable problems. The
> > database sizes seemed reasonable and were searchable.
> >
> > Four of the tests fail outright and numerous errors are reported.
> > Most of the problems are due to the fact that the httpd.conf file
> > used is not entirely compatible with Apache 2. By merging
> > httpd.conf, access.conf, and srm.conf into a single file and then
> > commenting out everything that 'make check' complained about, I was
> > able to get three of the four problematic tests to pass.


-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

Re: [htdig-dev] Re: Feedback on configuring ht://Dig?

[Gilles D. <gr...@sc...>]

According to Lachlan Andrew:
> I'm sorry, I misread your bug report.  I take it that  common_dir  
> *wasn't* /usr/share/htdig in the RedHat RPM, but that it should have 
> been.  If the packagers configured it with  --prefix=/usr  (which the 
> package information says they did), then the default location for  
> common_dir  would be  /usr/share/htdig.  If that isn't what it is, 
> they must also have overridden either  --datadir=...  or  
> --with-common-dir=...
> 
> The point remains that the way the packagers choose to configure the 
> package is beyond our control.  We just provide the flexibility for 
> them to put things wherever they want.
> 
> Out of interest, do you know where they *did* point  common_dir  to?  
> I've tried to find out, haven't been able to :(

They point it to /var/www/html/htdig.  Actually, they do lots of really
dumb things in their RPM package.  First of all they set common_dir
and image_dir to the same thing, then they move /var/www/html/htdig
to /usr/share/htdig.  In previous RPMs, they then made a symlink from
/var/www/html/htdig (in the htdig-web package) over to /usr/share/htdig,
so that htsearch et al. only found the common files if you had installed
both htdig and htdig-web packages, and htsearch's images would only load
if you configure httpd to follow symlinks.  Now, to resolve the latter
problem, they use an Apache Alias instead of a symlink, so the images
load, but nothing will find the common files unless you fix common_dir
in your htdig.conf.  Maybe in another year or two they'll finally get
it right.

I can send you their .spec file if you're interested.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

Re: [htdig-dev] MATCH_MESSAGE

[Gilles D. <gr...@sc...>]

According to Lachlan Andrew:
> I've noticed that  MATCH_MESSAGE  is not "internationalised".  It is 
> set to "all" or "some", rather than the values in  method_names.  
> Moreover, if  method_names  doesn't use names "and" and "or", then it 
> isn't set at all.
> 
> Does anyone mind if I change the behaviour (after 3.2.0b5 is out) to 
> use  method_names?  The incompatibilities would be:
> 1. The default values would be "all" and "any", not "all" and "some"
> 2. If Boolean queries are used, it will be "Boolean", not empty.

None of the default template files use MATCH_MESSAGE, and I don't recall
ever seeing any discussion about it.  So, I don't expect changing this
is going to cause anyone much grief.  I'd say feel free to do it before
3.2.0b5 goes out.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

[htdig-dev] recent cvs commits

[Gilles D. <gr...@sc...>]

OK, I've committed the translate_latin1 attribute addition.  I've
also fixed the default value for "config" in defaults.cc, backed out
Lachlan's hack for that in Display.cc, and fixed htsearch.cc's handling
of boolean_keywords when more than one config is specified.  Please give
this a test on your systems - I'm satisfied that my changes are OK on
my Red Hat 9 system.

I'll be away from this Saturday until July 2, so if you need me for
anything before early July, let me know by tomorrow morning.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

Re: [htdig-dev] Bug in "CONFIG" template variable?

[Gilles D. <gr...@sc...>]

According to Lachlan Andrew:
> I've found what seems to be a bug in the setting of the CONFIG 
> template variable.  It is set to the complete path name of the config 
> file, but htsearch assumes that it will not have the leading path, or 
> the .conf  extension.
> 
> Could someone please confirm that running "Refine this search" from a 
> search result doesn't work because of this?  I have written a patch, 
> but want to make sure I'm not "fixing" a non-bug, so close to 
> 3.2.0b5...

As far as I've been able to tell, the problem only shows up when the
"config" input parameter is not specified.  In this case, htsearch uses
the value in defaults.cc, which is incorrectly set to DEFAULT_CONFIG_FILE.
It should default to "".  I can change that and back out the hack in
Display.cc.  So far, my testing has confirmed that htseach does the
right thing when the config input parameter is given, as long as the
hack in Display.cc is disabled.  I don't see anything else in the code
that could make this happen, unless there's some wierd memory leak that
some of you are running into.

If you can confirm that this problem happens even when the config input
parameter is specified, then please get to the bottom of this before
3.2.0b5 goes out.  The way I see things, the hack would break when
config is specified, and really break when collections are used (i.e.
more than one config parameter is given).

Speaking of collections, there's a bug with that and the new
boolean_keywords attribute.  I'll commit a fix for this today too.
The old list must be destroyed before a new one is created the next time
through the loop.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

[htdig-dev] New ht://Dig Mirror in Amsterdam, NL

[Kookel M. A. <mi...@ko...>]

Hello;

We've just setup a new Ht://Dig Mirror in Amsterdam, in Netherlands.
This mirror server is hosted on a 10Mb/s dedicated bandwidth, and is
publicly available at:

Ht://Dig Web/FTP Site: 
http://gnu.kookel.org/ftp/htdig/maindocs/
ftp://gnu.kookel.org/pub/htdig/maindocs/

Ht://Dig Files Web/FTP Site: 
http://gnu.kookel.org/htdig/maindocs/files/
ftp://gnu.kookel.org/pub/htdig/ftp.htdig.org/files/

Ht://Dig Patch Web/FTP Site:
http://gnu.kookel.org/htdig/maindocs/htdig-patches/
ftp://gnu.kookel.org/pub/htdig/ftp.ccsf.org/htdig-patches/

Ht://Dig Developer Web/FTP Site:
http://gnu.kookel.org/ftp/htdig/maindocs/dev/
ftp://gnu.kookel.org/pub/htdig/maindocs/dev/

Feel free to update the Ht://Dig official mirror page accordingly.
This mirror is updated nightly.

Please use "Kelkoo.com GNU Mirrors" in the Organisation field, pointing
to 'http://www.kelkoo.com'
If you need a contact email address, you can use mi...@ko...

Thanks !
Best Regards,

Re: [htdig-dev] Bug in "CONFIG" template variable?

[wu_zeng <zw...@so...>]

eWVzLCBJIGhhdmUgbWV0IHRoZSBzYW1lIHByb2JsZW0gDQotLS0tLSBPcmlnaW5hbCBNZXNzYWdl
IC0tLS0tIA0KRnJvbTogIkxhY2hsYW4gQW5kcmV3IiA8bGhhQHVzZXJzLnNvdXJjZWZvcmdlLm5l
dD4NClRvOiA8aHRkaWctZGV2QGxpc3RzLnNvdXJjZWZvcmdlLm5ldD4NClNlbnQ6IFR1ZXNkYXks
IEp1bmUgMTAsIDIwMDMgNzo0MSBQTQ0KU3ViamVjdDogW2h0ZGlnLWRldl0gQnVnIGluICJDT05G
SUciIHRlbXBsYXRlIHZhcmlhYmxlPw0KDQoNCkdyZWV0aW5ncyBhbGwsDQoNCkkndmUgZm91bmQg
d2hhdCBzZWVtcyB0byBiZSBhIGJ1ZyBpbiB0aGUgc2V0dGluZyBvZiB0aGUgQ09ORklHIA0KdGVt
cGxhdGUgdmFyaWFibGUuICBJdCBpcyBzZXQgdG8gdGhlIGNvbXBsZXRlIHBhdGggbmFtZSBvZiB0
aGUgY29uZmlnIA0KZmlsZSwgYnV0IGh0c2VhcmNoIGFzc3VtZXMgdGhhdCBpdCB3aWxsIG5vdCBo
YXZlIHRoZSBsZWFkaW5nIHBhdGgsIG9yIA0KdGhlIC5jb25mICBleHRlbnNpb24uDQoNCkNvdWxk
IHNvbWVvbmUgcGxlYXNlIGNvbmZpcm0gdGhhdCBydW5uaW5nICJSZWZpbmUgdGhpcyBzZWFyY2gi
IGZyb20gYSANCnNlYXJjaCByZXN1bHQgZG9lc24ndCB3b3JrIGJlY2F1c2Ugb2YgdGhpcz8gIEkg
aGF2ZSB3cml0dGVuIGEgcGF0Y2gsIA0KYnV0IHdhbnQgdG8gbWFrZSBzdXJlIEknbSBub3QgImZp
eGluZyIgYSBub24tYnVnLCBzbyBjbG9zZSB0byANCjMuMi4wYjUuLi4NCg0KVGhhbmtzIDopDQpM
YWNobGFuDQoNCg0KLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t
LS0tLS0tLS0tLQ0KVGhpcyBTRi5uZXQgZW1haWwgaXMgc3BvbnNvcmVkIGJ5OiAgRXRudXMsIG1h
a2VycyBvZiBUb3RhbFZpZXcsIFRoZSBiZXN0DQp0aHJlYWQgZGVidWdnZXIgb24gdGhlIHBsYW5l
dC4gRGVzaWduZWQgd2l0aCB0aHJlYWQgZGVidWdnaW5nIGZlYXR1cmVzDQp5b3UndmUgbmV2ZXIg
ZHJlYW1lZCBvZiwgdHJ5IFRvdGFsVmlldyA2IGZyZWUgYXQgd3d3LmV0bnVzLmNvbS4NCl9fX19f
X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fDQpodGRpZy1kZXYgbWFp
bGluZyBsaXN0DQpodGRpZy1kZXZAbGlzdHMuc291cmNlZm9yZ2UubmV0DQpodHRwczovL2xpc3Rz
LnNvdXJjZWZvcmdlLm5ldC9saXN0cy9saXN0aW5mby9odGRpZy1kZXYNCg==

RE: [htdig-dev] Re: Mirror of HtDig at http://htdig.host1.com.au

[David B. <D.B...@vp...>]

Looks like I (also being in au) can see it (htdig.host1.com.net). But its a
blank page, nothing but a title.

David

-------------------------------------------------------------
David Bannon                       D.B...@vp...
Phone 61 03 9925 4733              Fax 61 03 9925 4647
Mobile 0418 525687                 http://www.vpac.org
Systems Manager, Victorian Partnership for Advanced Computing
-------------------------------------------------------------
..... Humpty Dumpty was pushed !




> -----Original Message-----
> From: htd...@li...
> [mailto:htd...@li...]On Behalf Of Lachlan
> Andrew
> Sent: Wednesday, June 11, 2003 9:08 PM
> To: Campbell McLeay; htd...@li...
> Subject: [htdig-dev] Re: Mirror of HtDig at http://htdig.host1.com.au
>
>
> Greetings,
>
> That URL doesn't seem to exist, and nor does
> <http://www.htdig.host1.com.au>.  Could you please check the URL and
> let us know again?  It will be great to have a mirror in Oz :)
>
> Lachlan
>
> On Mon, 26 May 2003 16:07, Campbell McLeay wrote:
>
> > This is just to let you know that we have set up
> > a mirror of http://htdig.org/ (main site) at
> > http://htdig.host1.com.au.
>
>
> -------------------------------------------------------
> This SF.net email is sponsored by:  Etnus, makers of TotalView, The best
> thread debugger on the planet. Designed with thread debugging features
> you've never dreamed of, try TotalView 6 free at www.etnus.com.
> _______________________________________________
> htdig-dev mailing list
> htd...@li...
> https://lists.sourceforge.net/lists/listinfo/htdig-dev

Re: [htdig-dev] Score factors almost ignored

[Geoff H. <ghu...@ws...>]

I'm guessing you mean the scoring in the 3.2 code?

> The base score of documents I search for is typically 0.0001, while
> the backlink factor is typically 2000.  Since these are added, the
> weight given to the document itself is approximately zero!
>
> Does anyone know how this came about?

Well, that makes some sense. We haven't "recalibrated" the scoring, 
though we trimmed out the whole "words in the front get higher score" 
bit. And since I assumed that somewhere along the 3.2 development, we'd 
add in some sort of "proximity weighting," I didn't really worry about 
it.

As far as changing the weightings, I don't think anyone minds as long 
as it's explained up-front in release documentation. In particular, now 
that you don't have to reindex to change weightings, it's an easy 
change to your config file.

-Geoff

[htdig-dev] New ht://Dig Mirror in Amsterdam, NL

[Vincent J. <Vin...@ke...>]

Hello;

We've just setup a new Ht://Dig Mirror in Amsterdam, in Netherlands.
This mirror server is hosted on a 10Mb/s dedicated bandwidth, and is
publicly available at:

Ht://Dig Web/FTP Site: 
http://gnu.kookel.org/ftp/htdig/maindocs/
ftp://gnu.kookel.org/pub/htdig/maindocs/

Ht://Dig Files Web/FTP Site: 
http://gnu.kookel.org/htdig/maindocs/files/
ftp://gnu.kookel.org/pub/htdig/ftp.htdig.org/files/

Ht://Dig Patch Web/FTP Site:
http://gnu.kookel.org/htdig/maindocs/htdig-patches/
ftp://gnu.kookel.org/pub/htdig/ftp.ccsf.org/htdig-patches/

Ht://Dig Developer Web/FTP Site:
http://gnu.kookel.org/ftp/htdig/maindocs/dev/
ftp://gnu.kookel.org/pub/htdig/maindocs/dev/

Feel free to update the Ht://Dig official mirror page accordingly.
This mirror will be updated nightly.

Please use "Kelkoo.com GNU Mirrors" in the Organisation field, pointing
to 'http://www.kelkoo.com'
If you need a contact email address, you can use mi...@ke...

Thanks !
Best Regards,

-- 
########################################################
 Kelkoo Security Manager / Networks & Systems Architect 
 	    JID: por...@ja... 	        
 Office: +(33)04 7629 7163 / Mobile: +(33)06 806 409 62 
########################################################
Kelkoo.com --- GNU/Linux Powered.

[htdig-dev] Score factors almost ignored

[Lachlan A. <lh...@us...>]

Greetings all,

There seems to be a problem with the relative weights given to=20
backlinks/date vs actual content of the documents in  htsearch.

The base score of documents I search for is typically 0.0001, while=20
the backlink factor is typically 2000.  Since these are added, the=20
weight given to the document itself is approximately zero!

Does anyone know how this came about?  It is easily fixed by=20
multiplying the base score by 1e6, but this would break the settings=20
of anyone who had set backlink_factor and date_factor to tiny values=20
to overcome the initial bug.

Suggestions?

Lachlan

[htdig-dev] Re: Mirror of HtDig at http://htdig.host1.com.au

[Lachlan A. <lh...@us...>]

Greetings,

That URL doesn't seem to exist, and nor does =20
<http://www.htdig.host1.com.au>.  Could you please check the URL and=20
let us know again?  It will be great to have a mirror in Oz :)

Lachlan

On Mon, 26 May 2003 16:07, Campbell McLeay wrote:

> This is just to let you know that we have set up
> a mirror of http://htdig.org/ (main site) at
> http://htdig.host1.com.au.

[htdig-dev] Bug in "CONFIG" template variable?

[Lachlan A. <lh...@us...>]

Greetings all,

I've found what seems to be a bug in the setting of the CONFIG=20
template variable.  It is set to the complete path name of the config=20
file, but htsearch assumes that it will not have the leading path, or=20
the .conf  extension.

Could someone please confirm that running "Refine this search" from a=20
search result doesn't work because of this?  I have written a patch,=20
but want to make sure I'm not "fixing" a non-bug, so close to=20
3.2.0b5...

Thanks :)
Lachlan

[htdig-dev] Status of htdig development

[Jeffrey S. <je...@jh...>]

What is the status of htDig?  has it died a quiet Open Source death?

the ht://Dig website does not seem to have been much updated since 
February of 2002, so I was wondering...

Thank you!
-- 
later...

Jeffrey D. Silverman
je...@jh... * 410-516-5303
Johns Hopkins University * Baltimore, MD

[htdig-dev] Re: [htdig] Test platforms available?

[Lachlan A. <lh...@us...>]

Thanks for that :)

I'll try to digest it, and then may ask more questions.
Sometimes there are problems with including standard include paths=20
explicitly.  Was there a reason for listing  -I/usr/include ?

Regarding your feature requests:
1. The ssl directory can be configured with  --with-ssl=3DDIR
2. The argument for --with-apache  is the path to the actual
   executable, not just the directory.
   Anyway, Apache isn't used by ht://Dig itself.  It is just
   used by four of the 14 tests.  (The other 10 should pass with
   any version of Apache, or without it.)  Rewriting the tests to
   use Apache2 will probably come soon after the release of 3.2.0b5.

Thanks again,
Lachlan

On Mon, 9 Jun 2003 01:03, Joerg Behrens wrote:

> The built failed as you can see under
> http://origin.takenet.de/htdig/32bit_built_report.txt
>
> System: IRIX64 origin 6.5 04091957 IP27
> Compiler: MIPSpro Compilers: Version 7.4
> Environment:
> export CC=3Dcc
> export
> CFLAGS=3D"-O3 -apo -mp -mips4 -OPT:Olimit=3D0 -TARG:platform=3DIP27
> -Xcpluscomm -I/usr/local/include -I/usr/include=20
> -I/usr/freeware/include" export CXXFLAGS=3D"-O3 -mips4"
> export
> LDFLAGS=3D"-mp -W,rpath=3D/usr/local/lib  -W,rpath=3D/usr/lib32
> -W,rpath=3D/usr/freeware/lib32"
> export CXX=3DCC
> export NOWARN=3D'-woff
> 1009,1014,1048,1110,1116,1185,1188,1204,1230,1233
> -Wl,-woff,85,-woff,84'
>
> Feature request:
> made SSL dir configureable
> support apache2 when compiling with '--enable-tests'

Re: [htdig-dev] Re: Red Hat

[Jim C. <li...@yg...>]

On Monday, June 2, 2003, at 07:08 AM, Lachlan Andrew wrote:

> Could you please mail a list of the lines you commented out?  It would
> be really nice to have  make check  work "out of the box", and I
> think most of the lines in *.conf are not necessary for any platform.

The httpd.conf file I used in order to get all the tests to pass is 
attached. Lines starting with '#J' are lines that I commented out. The 
only thing that I added is 'Listen 7400', which replaces 'Port 7400'.

I also appended access.conf and srm.conf to httpd.conf; even with 
1.3.x, there was a move away from using the three separate files. The 
old syntax for specifying the access.conf and srm.conf is no longer 
valid in Apache 2.

Jim