htdig-dev — Developer Discussion for the ht://Dig project

Re: [htdig-dev] SF.net: Compile farm

[Ted Stresen-R. <ted...@ma...>]

Apple has a different linker even though libtool may be installed. I  
had to use it recently to get libpng and libjpeg to function. I can't  
remember, unfortunately, what it's called, but once I ran it it worked  
perfectly. I found this quote that hints at the difference, but I don't  
understand half of it...

"The Mac OS X runtime model supports dynamic shared libraries. This  
model uses Mach-O and PEF binary file formats; the dynamic link editor  
(dyld) and the Code Fragment Manager (CFM) use these formats  
respectively. The kernel supports execve() with Mach-O binaries.  
Mapping and management of Mach-O dynamic shared libraries, as well as  
launching of PEF-based applications, are performed by user-space code."

http://developer.apple.com/techpubs/macosx/Darwin/General/ 
KernelProgramming/BSD/Differences_S_X_and_BSD.html

Ted Stresen-Reuter

On Wednesday, January 29, 2003, at 10:56  AM, Gabriele Bartolini wrote:

> [PPC - G4] MacOS X 10.1 SERVER Edition   (I still have some problems  
> with the linker - I know though there's some problems with libtool);  
> if statically linked it works (it's the same with ht://Check)

[htdig-dev] SF.net: Compile farm

[Gabriele B. <an...@ti...>]

Hi guys,

    I have been trying to use sf.net compile farm, in order to test the 
compilation of ht://Dig on those platforms. Here is what they offer:

[x86] Linux 2.4 (Debian 2.2)
[x86] Linux 2.4 (Redhat 7.3)
[x86] FreeBSD (4.7-STABLE)
[Alpha] Linux 2.4 (Debian 3.0)
[PPC - G4] MacOS X 10.1 SERVER Edition
[Sparc - Ultra60] Linux 2.4 (Debian 3.0)
[Sparc - R220] Sun Solaris (8)

    Also, I have a RH8.0.

    I am gonna try all of them between today and tomorrow. For now, I 
compiled successfully here:

[x86] Linux 2.4 (Redhat 7.3)
[x86] Linux 2.4 (Redhat 8.0)
[PPC - G4] MacOS X 10.1 SERVER Edition   (I still have some problems with 
the linker - I know though there's some problems with libtool); if 
statically linked it works (it's the same with ht://Check)

    I already failed here:

[Sparc - R220] Sun Solaris (8)

    I'll let you know by tomorrow, as tests go on. Any comments?

Ciao ciao
-Gabriele
--
Gabriele Bartolini - Web Programmer - ht://Dig & IWA Member - ht://Check 
maintainer
Current Location: Prato, Tuscany, Italia
an...@ti... | http://www.prato.linux.it/~gbartolini | ICQ#129221447

[htdig-dev] How To: remove multi-space from String?

[Jessica B. <jes...@ya...>]

Can anyone give me a clue as to how to remove multiple
spaces from a String?

Also, is there a better way to do search and replace
other than Stringname.replace('a','b')?  I'd really
like to use regular expressions on the first matching
comparison value.

-Jes

p.s. I'm using htdig-3.2.0b4 and I'm in Display.cc

__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com

[htdig-dev] HTDig will not install

[Abbie G. <ag...@th...>]

Dear Sir or Madame,
  I just downloaded HTDig, followed all instructions up to typing 'Make'
to install the program.  I get the following error message:
=20
Make: *** No rule to make target 'install'.  Stop.
=20
  I am running this as root on RedHat Linux 8.0.  I updated the prefix
to /usr/local/htdig as well as making it writable to all groups.  Any
help would truly be appreciated.
=20
Thanks!

[htdig-dev] HTDIG and AIX

[Richard L. <rle...@im...>]

Hi all,
Has anybody already implemented htdig on an AIX (4.3 or higher) platform ?
Thanks for any feedback on this

Regards
Richard
________________________________
Richard Legendre
Technical Manager
iManage France
114 bis rue Michel-Ange - 75016 PARIS
Office + 33 1 40 71 28 18
Cell + 33 6 22 30 25 24
rle...@im...
________________________________ 

[htdig-dev] Autotools and macros

[Gabriele B. <an...@ti...>]

Ciao guys,

   by playing around a bit with autotools I came up with some questions.
Foreword: everytime I have to use autotools it is such a pain the **** fo=
r
me! :-)

   I have used new autotools with ht://Check and they work fine for me;
it's just that before putting on ht://Dig I just wanna be sure of what I
am doing (portability is much more important and hard here!).

   There are two things I basically found, apart from the actual versions=

we use; here they are:

1) AC_LIBOBJ vs. LIBOBJS
In configure.in, when trying to run configure, I got a warning aimed to
inform me about a new feature: I modify the code as follows:

168c168
<    [AC_MSG_RESULT(yes);LIBOBJS=3D"$LIBOBJS regex.${ac_objext}"],
---
>    [AC_MSG_RESULT(yes);AC_LIBOBJ([regex])],
174,175d173
< LTLIBOBJS=3D`echo "$LIBOBJS" | sed 's/\.o/.lo/g'`
< AC_SUBST(LTLIBOBJS)

2) CHECK_SSL
I have seen this macro to be defined as part of the ac-archive, and put
by Geoff in the aclocal.m4 almost one year ago. Can we move it into acinc=
lude.m4
so, everytime we run aclocal, it is automatically included into aclocal.m=
4?

Well ... for now I think it is enough. Please let me know what you think!=

;-)

Ciao ciao
-Gabriele

[htdig-dev] Important: automake issues

[Gabriele B. <an...@ti...>]

Hi guys,

    when porting my ht://Check's changes to ht://Dig for Cookies management 
(in particular pre-load of users' cookies from a text file), I encountered 
a problem (a warning) when running automake. I write you just to make sure 
that I am not doing something wrong.

    Anyway, I got this message:

configure.in:27: your implementation of AM_INIT_AUTOMAKE comes from an
configure.in:27: old Automake version.  You should recreate aclocal.m4
configure.in:27: with aclocal and run automake again.

    I got this question: can I just ignore it and go on with automake? I 
have these autotools versions (that come with RH 8.0):

- automake (GNU automake) 1.6.3
- autoconf (GNU Autoconf) 2.53
- libtoolize (GNU libtool) 1.4.2

    I am awaiting for orders, guys. Do you think I can upload the new 
Makefile.in files or do you think it is better that some of you perform the 
update through automake? What about upgrading to new autotools, by running 
aclocal, autoconf, automake, etc.?

    Please let me know.

Ciao and thanks!
-Gabriele
--
Gabriele Bartolini - Web Programmer - ht://Dig & IWA Member - ht://Check 
maintainer
Current Location: Prato, Tuscany, Italia
an...@ti... | http://www.prato.linux.it/~gbartolini | ICQ#129221447

Re: [htdig-dev] Re: ht/dig project - dead?

[Neal R. <ne...@ri...>]

Lachlan,

	Great job forward porting 3.1.6 features!  I'm porting your
changes to libhtdig and will make a new snapshot avaliable soon.

	What DB errors are you speaking of?  Turning on
wordlist_compress_zlib should be a workaround for the DB errors I know
about.

	Thanks!

Neal Richter

On Mon, 20 Jan 2003, Lachlan Andrew wrote:

> IMHO, this question highlights the need to get 3.2.0b[45] out ASAP.
> Am I correct in believing that the hold-up is basically database
> errors?  If so, could we set a target "acceptable bug level" just to
> get the other bug-fixes/features out there?  After all, people who
> are savvy enough to run betas are able to choose to keep using
> 3.2.0b3 if they want.
>
> I don't know anything about the database code, but if someone points
> the way, I'm happy to spend some time working on it.  Do we need a
> test dataset which reproducibly tickles a bug?
>
> Cheers,
> Lachlan
>
> On Saturday 18 January 2003 02:32, Geoff Hutchison wrote:
> > To quote Mark Twain... "Reports of my demise have been greatly
> > exaggerated."
>
>
>
> -------------------------------------------------------
> This SF.NET email is sponsored by: FREE  SSL Guide from Thawte
> are you planning your Web Server Security? Click here to get a FREE
> Thawte SSL guide and find the answers to all your  SSL security issues.
> http://ads.sourceforge.net/cgi-bin/redirect.pl?thaw0026en
> _______________________________________________
> htdig-dev mailing list
> htd...@li...
> https://lists.sourceforge.net/lists/listinfo/htdig-dev
>

Neal Richter
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485

RE: [htdig-dev] Cookie file development started

[Gabriele B. <an...@ti...>]

Please let me know your opinion, guys! :-)

>    So ...are you ok with this configuration attribute?
>
>cookies_input_file
>default value: empty
>When empty no input operation will be performed.

However I have already written the code for ht://Check and it seems to wo=
rk
fine.

If you are ok with my changes, let me know and tomorrow I'll commit to ht=
://Dig's
branch.

I'll also have to add a new file to Makefile.am (HtCookieInFileJar). Anyt=
hing
I should be aware of?

Ciao ciao
-Gabriele

[htdig-dev] Cookie file development started

[Gabriele B. <an...@ti...>]

Ciao guys,

   I am sick at home and I decided to implement the cookie file feature,
as many users requested.

   I think the most reasonable solution is to follow Netscape's way of ma=
naging
cookies, in a text file easily manageable.

   The format is a tab separated fields description, and here are the det=
ails
I found on http://www.cookiecentral.com/faq/#3.5 :

.netscape.com     TRUE   /  FALSE  946684799   NETSCAPE_ID  100103

From left-to-right, here is what each field represents:

domain - The domain that created AND that can read the variable.
flag - A TRUE/FALSE value indicating if all machines within a given domai=
n
can access the variable. This value is set automatically by the browser,
depending on the value you set for domain.
path - The path within the domain that the variable is valid for.
secure - A TRUE/FALSE value indicating if a secure connection with the do=
main
is needed to access the variable.
expiration - The UNIX time that the variable will expire on. UNIX time is=

defined as the number of seconds since Jan 1, 1970 00:00:00 GMT.
name - The name of the variable.
value - The value of the variable. 

   My idea is to build a class derived from HtCookieMemJar, called HtCook=
ieInFileJar,
which just loads the file into memory; thanks to inheritance, the object
is therefore addressable as a memory jar too (my intentions are to either=

use it directly or through the copy constructor pass it to the one alread=
y
used).

    Please let me know if you are ok with this solution.

    Also, if interested, it would be pretty straightforward to implement
the opposite solution, an output cookie (next time).

    So ...are you ok with this configuration attribute?

cookies_input_file
default value: empty
When empty no input operation will be performed.

Ciao and thanks!
-Gabriele
--
Gabriele Bartolini - Web Programmer - ht://Dig & IWA Member - ht://Check
maintainer
Current Location: Melbourne, Victoria, Australia
bar...@in... | http://www.prato.linux.it/~gbartolini | ICQ#1292=
21447

[htdig-dev] Current Status as of snapshot 3.2.0b4-20030126

[Geoff H. <ghu...@us...>]

STATUS of ht://Dig branch 3-2-x

RELEASES:
   3.2.0b5: Next release, tentatively 1 Feb 2003.
   3.2.0b4: "In progress" -- snapshots called "3.2.0b4" until prerelease.
   3.2.0b3: Released:  22 Feb 2001.
   3.2.0b2: Released:  11 Apr 2000.
   3.2.0b1: Released:   4 Feb 2000.

(Please note that everything added here should have a tracker PR# so
we can be sure they're fixed. Geoff is currently trying to add PR#s for
what's currently here.)

SHOWSTOPPERS:
* Mifluz database errors are a severe problem (PR#428295)
-- Does Neal's new zlib patch solve this for now?

KNOWN BUGS:
* Odd behavior with $(MODIFIED) and scores not working with
   wordlist_compress set but work fine without wordlist_compress.
   (the date is definitely stored correctly, even with compression on
    so this must be some sort of weird htsearch bug) PR#618737.
* META descriptions are somehow added to the database as FLAG_TITLE,
   not FLAG_DESCRIPTION. (PR#618738)

PENDING PATCHES (available but need work):
* Additional support for Win32.
* Memory improvements to htmerge. (Backed out b/c htword API changed.)
* Mifluz merge.

NEEDED FEATURES:
* Field-restricted searching. (e.g. PR#460833)
* Quim's new htsearch/qtest query parser framework.
* File/Database locking. PR#405764.

TESTING:
* httools programs: 
  (htload a test file, check a few characteristics, htdump and compare)
* Tests for new config file parser
* Duplicate document detection while indexing
* Major revisions to ExternalParser.cc, including fork/exec instead of popen,
  argument handling for parser/converter, allowing binary output from an
  external converter.
* ExternalTransport needs testing of changes similar to ExternalParser.

DOCUMENTATION:
* List of supported platforms/compilers is ancient. (PR#405279)
* Add thorough documentation on htsearch restrict/exclude behavior
   (including '|' and regex).
* Document all of htsearch's mappings of input parameters to config attributes
   to template variables. (Relates to PR#405278.)
  Should we make sure these config attributes are all documented in
  defaults.cc, even if they're only set by input parameters and never
  in the config file?
* Split attrs.html into categories for faster loading.
* Turn defaults.cc into an XML file for generating documentation and 
  defaults.cc.
* require.html is not updated to list new features and disk space
   requirements of 3.2.x (e.g. regex matching, database compression.)
   PRs# 405280 #405281.
* TODO.html has not been updated for current TODO list and
   completions.
* Htfuzzy could use more documentation on what each fuzzy algorithm
   does. PR#405714.
* Document the list of all installed files and default
   locations. PR#405715.

OTHER ISSUES:
* Can htsearch actually search while an index is being created?
* The code needs a security audit, esp. htsearch. PR#405765.

Re: [htdig-dev] Multi-word query matches, but the excerpts aren't shown - any fix?

[Jessica B. <jes...@ya...>]

Hi Neal.  I'm using the 3.2.0b4 snapshots.  I was
using an older one and just tested the latest and
still have the same results.

--- Neal Richter <ne...@ri...> wrote:
> 
> What version of the HtDig you are running?
> 
> Thanks.
> 
> 
> On Thu, 23 Jan 2003, Jessica Biola wrote:
> 
> > I have a couple documents that have text like
> this:
> >
> >    A123-456
> >
> > I've turned off the punctuation characters in
> htdig
> > configuration file.  When I search for: A123-456 I
> get
> > an exact match with the excerpt highlighted.  But,
> if
> > I search for: "A123 456" I also get a document
> match,
> > but the excerpt does not show up.
> >
> > I am guessing that the reason it is not showing up
> is
> > because there is a routine looking for the
> matching
> > text header/document to add to excerpt and
> highlight.
> > While the search term does match (both words are
> > within one word of proximity in the phrase) the
> > document, the excerpt doesn't.
> >
> > Can someone help me fix this?  Some of our
> employees
> > are searching our parts indexes and get confused
> as to
> > why sometimes excerpts show up and sometimes they
> do
> > not.  Its so useful to have them show up in the
> > results page because it helps them save time
> (knowing
> > the context of the search query in a document is
> very
> > helpful).
> >
> > I think that the same problem pops up with word
> > endings (i.e. "test running" would match "tests
> run"
> > but an excerpt would not show up unless the query
> > matched the appearance of hte matching text
> verbatim).
> >
> > -Jes
> >
> > __________________________________________________
> > Do you Yahoo!?
> > Yahoo! Mail Plus - Powerful. Affordable. Sign up
> now.
> > http://mailplus.yahoo.com
> >
> >
> >
>
-------------------------------------------------------
> > This SF.NET email is sponsored by:
> > SourceForge Enterprise Edition + IBM + LinuxWorld
> = Something 2 See!
> > http://www.vasoftware.com
> > _______________________________________________
> > htdig-dev mailing list
> > htd...@li...
> >
>
https://lists.sourceforge.net/lists/listinfo/htdig-dev
> >
> 
> Neal Richter
> Knowledgebase Developer
> RightNow Technologies, Inc.
> Customer Service for Every Web Site
> Office: 406-522-1485
> 
> 
> 
> 
>
-------------------------------------------------------
> This SF.NET email is sponsored by:
> SourceForge Enterprise Edition + IBM + LinuxWorld =
> Something 2 See!
> http://www.vasoftware.com
> _______________________________________________
> htdig-dev mailing list
> htd...@li...
>
https://lists.sourceforge.net/lists/listinfo/htdig-dev


__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com

Re: [htdig-dev] Multi-word query matches, but the excerpts aren't shown - any fix?

[Neal R. <ne...@ri...>]

What version of the HtDig you are running?

Thanks.


On Thu, 23 Jan 2003, Jessica Biola wrote:

> I have a couple documents that have text like this:
>
>    A123-456
>
> I've turned off the punctuation characters in htdig
> configuration file.  When I search for: A123-456 I get
> an exact match with the excerpt highlighted.  But, if
> I search for: "A123 456" I also get a document match,
> but the excerpt does not show up.
>
> I am guessing that the reason it is not showing up is
> because there is a routine looking for the matching
> text header/document to add to excerpt and highlight.
> While the search term does match (both words are
> within one word of proximity in the phrase) the
> document, the excerpt doesn't.
>
> Can someone help me fix this?  Some of our employees
> are searching our parts indexes and get confused as to
> why sometimes excerpts show up and sometimes they do
> not.  Its so useful to have them show up in the
> results page because it helps them save time (knowing
> the context of the search query in a document is very
> helpful).
>
> I think that the same problem pops up with word
> endings (i.e. "test running" would match "tests run"
> but an excerpt would not show up unless the query
> matched the appearance of hte matching text verbatim).
>
> -Jes
>
> __________________________________________________
> Do you Yahoo!?
> Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
> http://mailplus.yahoo.com
>
>
> -------------------------------------------------------
> This SF.NET email is sponsored by:
> SourceForge Enterprise Edition + IBM + LinuxWorld = Something 2 See!
> http://www.vasoftware.com
> _______________________________________________
> htdig-dev mailing list
> htd...@li...
> https://lists.sourceforge.net/lists/listinfo/htdig-dev
>

Neal Richter
Knowledgebase Developer
RightNow Technologies, Inc.
Customer Service for Every Web Site
Office: 406-522-1485

[htdig-dev] Multi-word query matches, but the excerpts aren't shown - any fix?

[Jessica B. <jes...@ya...>]

I have a couple documents that have text like this:

   A123-456

I've turned off the punctuation characters in htdig
configuration file.  When I search for: A123-456 I get
an exact match with the excerpt highlighted.  But, if
I search for: "A123 456" I also get a document match,
but the excerpt does not show up.

I am guessing that the reason it is not showing up is
because there is a routine looking for the matching
text header/document to add to excerpt and highlight. 
While the search term does match (both words are
within one word of proximity in the phrase) the
document, the excerpt doesn't.

Can someone help me fix this?  Some of our employees
are searching our parts indexes and get confused as to
why sometimes excerpts show up and sometimes they do
not.  Its so useful to have them show up in the
results page because it helps them save time (knowing
the context of the search query in a document is very
helpful).

I think that the same problem pops up with word
endings (i.e. "test running" would match "tests run"
but an excerpt would not show up unless the query
matched the appearance of hte matching text verbatim).

-Jes

__________________________________________________
Do you Yahoo!?
Yahoo! Mail Plus - Powerful. Affordable. Sign up now.
http://mailplus.yahoo.com

Re: [htdig-dev] Re: File Locking ...

[J. op d. B. <ht...@op...>]

Basicly there are three methods:

flock()  (on some versions of *nix)
lockf()  (on other versions, like HP-UX)
ioctl()   (on yet other versions),

So we need to find what versions are supported. Some implementations
can only lock a whole file, some can lock parts of a file.

Geoff Hutchison wrote:

>>> * File/Database locking. PR#405764.
>>
>>
>> Can you tell me a little more about this - I had started
>> working on a generalized file locking mechanism as part
>> of my Adjustable Logging patch, implemented using a
>> "factory" method to create objects to an interface
>
>
> I don't know about a "factory" method.
> But the item hasn't changed in any substantial way since the previous 
> discussion of locking (which looks like Sep-2002).
>
> http://sourceforge.net/mailarchive/message.php?msg_id=2014435
>
> -- 
> -Geoff Hutchison
> Williams Students Online
> http://wso.williams.edu/

--Jesse

[htdig-dev] Re: ht/dig project - dead?

[Lachlan A. <lh...@us...>]

IMHO, this question highlights the need to get 3.2.0b[45] out ASAP.
Am I correct in believing that the hold-up is basically database=20
errors?  If so, could we set a target "acceptable bug level" just to=20
get the other bug-fixes/features out there?  After all, people who=20
are savvy enough to run betas are able to choose to keep using=20
3.2.0b3 if they want.

I don't know anything about the database code, but if someone points=20
the way, I'm happy to spend some time working on it.  Do we need a=20
test dataset which reproducibly tickles a bug?

Cheers,
Lachlan

On Saturday 18 January 2003 02:32, Geoff Hutchison wrote:
> To quote Mark Twain... "Reports of my demise have been greatly
> exaggerated."

[htdig-dev] Current Status as of snapshot 3.2.0b4-20030119

[Geoff H. <ghu...@us...>]

STATUS of ht://Dig branch 3-2-x

RELEASES:
   3.2.0b5: Next release, tentatively 1 Feb 2003.
   3.2.0b4: "In progress" -- snapshots called "3.2.0b4" until prerelease.
   3.2.0b3: Released:  22 Feb 2001.
   3.2.0b2: Released:  11 Apr 2000.
   3.2.0b1: Released:   4 Feb 2000.

(Please note that everything added here should have a tracker PR# so
we can be sure they're fixed. Geoff is currently trying add PR#s for
what's currently here.)

SHOWSTOPPERS:
* Mifluz database errors are a severe problem (PR#428295)
-- Does Neal's new zlib patch solve this for now?

KNOWN BUGS:
* Odd behavior with $(MODIFIED) and scores not working with
   wordlist_compress set but work fine without wordlist_compress.
   (the date is definitely stored correctly, even with compression on
    so this must be some sort of weird htsearch bug) PR#618737.
* META descriptions are somehow added to the database as FLAG_TITLE,
   not FLAG_DESCRIPTION. (PR#618738)

PENDING PATCHES (available but need work):
* Additional support for Win32.
* Memory improvements to htmerge. (Backed out b/c htword API changed.)
* Mifluz merge.

NEEDED FEATURES:
* Field-restricted searching. (e.g. PR#460833)
* Handle noindex_start & noindex_end as string lists.
* Quim's new htsearch/qtest query parser framework.
* File/Database locking. PR#405764.

TESTING:
* httools programs: 
  (htload a test file, check a few characteristics, htdump and compare)
* Tests for new config file parser
* Duplicate document detection while indexing
* Major revisions to ExternalParser.cc, including fork/exec instead of popen,
  argument handling for parser/converter, allowing binary output from an
  external converter.
* ExternalTransport needs testing of changes similar to ExternalParser.

DOCUMENTATION:
* List of supported platforms/compilers is ancient. (PR#405279)
* Add thorough documentation on htsearch restrict/exclude behavior
   (including '|' and regex).
* Document all of htsearch's mappings of input parameters to config attributes
   to template variables. (Relates to PR#405278.)
  Should we make sure these config attributes are all documented in
  defaults.cc, even if they're only set by input parameters and never
  in the config file?
* Split attrs.html into categories for faster loading.
* Turn defaults.cc into an XML file for generating documentation and 
  defaults.cc.
* require.html is not updated to list new features and disk space
   requirements of 3.2.x (e.g. regex matching, database compression.)
   PRs# 405280 #405281.
* TODO.html has not been updated for current TODO list and
   completions.
* Htfuzzy could use more documentation on what each fuzzy algorithm
   does. PR#405714.
* Document the list of all installed files and default
   locations. PR#405715.

OTHER ISSUES:
* Can htsearch actually search while an index is being created?
* The code needs a security audit, esp. htsearch. PR#405765.

[htdig-dev] Re: ht/dig project - dead?

[Geoff H. <ghu...@ws...>]

To quote Mark Twain... "Reports of my demise have been greatly
exaggerated." Of course that's not to say that more development isn't
welcome (as always). But you clearly haven't looked at any of the ht://Dig
mailing lists.

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

On Fri, 17 Jan 2003, Frank Piwarski wrote:

> Hello,
> 
> It looks to me that the ht/dig project is dead ... or fatally wounded.
> 
> Is this the case.
> 
> Thanks.
> Frank
> 
> 
> 

[htdig-dev] Re: File Locking ...

[Geoff H. <ghu...@ws...>]

>> * File/Database locking. PR#405764.
>
> Can you tell me a little more about this - I had started
> working on a generalized file locking mechanism as part
> of my Adjustable Logging patch, implemented using a
> "factory" method to create objects to an interface

I don't know about a "factory" method.
But the item hasn't changed in any substantial way since the previous 
discussion of locking (which looks like Sep-2002).

http://sourceforge.net/mailarchive/message.php?msg_id=2014435

--
-Geoff Hutchison
Williams Students Online
http://wso.williams.edu/

Re: [htdig-dev] Strange problem (about $&(MATCHES)

[Gilles D. <gr...@sc...>]

According to Vladimir Lopukhov:
> I've got a really strange problem with $&(MATCHES). Sometimes, I have 
> only less documents found, than $&(MATCHES) value
>  $&(LASTDISPLAYED) on the last page is equal $&(MATCHES).
> Is that bug, or I have a misconfigured ht://dig?

Sounds like the database corruption problem described in
http://www.htdig.org/FAQ.html#q5.11
Try reindexing.

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

[htdig-dev] Strange problem (about $&(MATCHES)

[Vladimir L. <ww...@gz...>]

Hi there.

I've got a really strange problem with $&(MATCHES). Sometimes, I have =
only less documents found, than $&(MATCHES) value
 $&(LASTDISPLAYED) on the last page is equal $&(MATCHES).
Is that bug, or I have a misconfigured ht://dig?


wwl

Re: [htdig-dev] Re: ssl and 3.2.0b4-20021110

[Gilles D. <gr...@sc...>]

According to Budd, Sinclair:
> Hello
>   After much scrambling, I found the script  "handler.pl"  by Geoffrey
> Hutchison <ghu...@ws...> which is used with
> "external_protocols" to fetch https  pages. 
>  
>    IT WORKS A WONDER.
> 
> There is a small documentation issue .  In  attrs.html  under
> "external_protocols" the statement  "The first field is a single character
> that specifies the record type." appears.  In the handler.pl  the first
> field is shown as "character:"   i.e. there are two characters.
>      Also from the documentation it is not clear whether the  u  record is
> mandatory or it is only needed for a redirect.  In the handler.pl  script
> the u record is only reported if the Location header is returned from the
> web server.

The 'u' record is indeed only used for redirects, and is by no means
mandatory, as far as I can tell by looking at the code.  I don't think
it would hurt anything if an external transport did issue 'u' records
without also issuing an 's' (status) record that triggered a redirect,
but there's no point in doing so, let alone a need to do so.

As for the colon, it seems to be totally optional as far as the transport
record processing is concerned.  Indeed, the tab character is absolutely
essential, but the parsing code seems to ignore any characters between
the first letter of the record and the tab.

I don't know what the problem is with the built-in HTTPS handling code
in 3.2.0b4, but with all the problem reports we've had on it it's safe
to say this code is broken, and you should use an external transport
for HTTPS until the problem is resolved.  Anyone out there know HTTPS
enough to take a crack at this?

-- 
Gilles R. Detillieux              E-mail: <gr...@sc...>
Spinal Cord Research Centre       WWW:    http://www.scrc.umanitoba.ca/
Dept. Physiology, U. of Manitoba  Winnipeg, MB  R3E 3J7  (Canada)

[htdig-dev] Re: ssl and 3.2.0b4-20021110

[Budd, S. <s....@ic...>]

Hello
  After much scrambling, I found the script  "handler.pl"  by Geoffrey
Hutchison <ghu...@ws...> which is used with
"external_protocols" to fetch https  pages. 
 
   IT WORKS A WONDER.

There is a small documentation issue .  In  attrs.html  under
"external_protocols" the statement  "The first field is a single character
that specifies the record type." appears.  In the handler.pl  the first
field is shown as "character:"   i.e. there are two characters.
     Also from the documentation it is not clear whether the  u  record is
mandatory or it is only needed for a redirect.  In the handler.pl  script
the u record is only reported if the Location header is returned from the
web server.

File Locking ... Re: [htdig-dev] Current Status as of snapshot 3.2.0b4-20021229

[Brian W. <bw...@st...>]

>...
>NEEDED FEATURES:
>...
>* File/Database locking. PR#405764.

Can you tell me a little more about this - I had started
working on a generalized file locking mechanism as part
of my Adjustable Logging patch, implemented using a
"factory" method to create objects to an interface

I might be able to do this one.

Regs

Brian

-------------------------
Brian White
Step Two Designs Pty Ltd
Knowledge Management Consultancy, SGML & XML
Phone: +612-93197901
Web:   http://www.steptwo.com.au/
Email: bw...@st...

Content Management Requirements Toolkit
112 CMS requirements, ready to cut-and-paste

Re: [htdig-dev] AdjustableLoggingPatch

[Brian W. <bw...@st...>]

Hello - I have been on Holidays for the last 3 weeks
so I am going through and doing a big email cleanout!

--------------------------------------------------------


I had been doing some work on it, but I decided to do defaults.xml
first and then ran out of time to do any more work on it.

Is there still time to get it into b4?

Brian

At 21:33 26/11/2002, Budd, Sinclair wrote:

>Hello.
>   Is there any intention of incorporating the AdjustableLoggingPatch into
>Htdig-3.2.0b4(5)
>
>
>
>ftp://ftp.ccsf.org/htdig-patches/3.1.6/AdjustableLoggingPatch.tar.gz
>
>Regards
>Sinclair Budd
>s....@ic...
>
>
>-------------------------------------------------------
>This SF.net email is sponsored by: Get the new Palm Tungsten T
>handheld. Power & Color in a compact size!
>http://ads.sourceforge.net/cgi-bin/redirect.pl?palm0002en
>_______________________________________________
>htdig-dev mailing list
>htd...@li...
>https://lists.sourceforge.net/lists/listinfo/htdig-dev

-------------------------
Brian White
Step Two Designs Pty Ltd
Knowledge Management Consultancy, SGML & XML
Phone: +612-93197901
Web:   http://www.steptwo.com.au/
Email: bw...@st...

Content Management Requirements Toolkit
112 CMS requirements, ready to cut-and-paste