noffle-users Mailing List for Noffle - news server (Page 5)
Brought to you by:
bears
Menu
▾
▴
noffle-users
You can subscribe to this list here.
| 2000 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(2) |
Jul
(2) |
Aug
(4) |
Sep
|
Oct
(1) |
Nov
(1) |
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2001 |
Jan
(4) |
Feb
|
Mar
(2) |
Apr
(2) |
May
|
Jun
(2) |
Jul
|
Aug
|
Sep
(1) |
Oct
(1) |
Nov
|
Dec
|
| 2002 |
Jan
|
Feb
|
Mar
(1) |
Apr
(6) |
May
|
Jun
(3) |
Jul
(1) |
Aug
(2) |
Sep
(3) |
Oct
(1) |
Nov
|
Dec
(1) |
| 2003 |
Jan
(17) |
Feb
(24) |
Mar
(3) |
Apr
(1) |
May
(27) |
Jun
(5) |
Jul
(7) |
Aug
(9) |
Sep
(8) |
Oct
(13) |
Nov
(9) |
Dec
(5) |
| 2004 |
Jan
|
Feb
|
Mar
(24) |
Apr
(5) |
May
(5) |
Jun
(2) |
Jul
(10) |
Aug
(8) |
Sep
(8) |
Oct
(18) |
Nov
(5) |
Dec
(1) |
| 2005 |
Jan
|
Feb
|
Mar
(1) |
Apr
(1) |
May
(2) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(1) |
| 2006 |
Jan
(3) |
Feb
(3) |
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
(1) |
Aug
(48) |
Sep
|
Oct
|
Nov
|
Dec
|
| 2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
(1) |
Sep
|
Oct
|
Nov
|
Dec
|
| 2023 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
(1) |
|
From: Rolf L. <vs...@ex...> - 2003-11-28 10:53:33
|
Hi Jim, thank you very much for your help. Jim Hague <jim...@ac...> writes: > On 09-Nov-2003 Rolf Leggewie wrote: >> I have some trouble to compile noffle for use in my Cygwin system. [...] > First, check the version of GDBM you have installed. You should have > CygWin packages libgdbm *and* libgdbm-devel installed. In usr/share/doc/ there > should be a libgdbm-devel directory with a version number; e.g. > libgdbm-devel-1.8.3 (the current version). What is the version number? It is 1.8.3. > How up to date is your CygWin installation? I updated cygwin and gcc along with their dependent packages to the most recent version and that almost did the trick. I can compile now but hit another problem when doing 'make install'in that neither user nor group 'news' exist for my Cygwin system on Windows98. There seems to be no command adduser or addgroup for Cygwin according to Google. Can I tell configure.sh to use another user? Best regards Rolf Leggewie -- http://home.arcor.de/leggewie/ http://leggewie.biz/hamster.htm |
|
From: Jim H. <jim...@ac...> - 2003-11-13 08:58:47
|
On 13-Nov-2003 Miernik wrote: > It look like LIST NEWSGROUPS command is not implemented in noffle. > Does this mean that I can't use tin with a Noffle server? LIST NEWSGROUPS works fine here. It sounds as if Noffle may be dying for some reason. Can you set "log-debug all" in your noffle.conf, try it again, and check over (or mail) the log? -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Miernik <mi...@ct...> - 2003-11-13 07:25:03
|
It look like LIST NEWSGROUPS command is not implemented in noffle.
Does this mean that I can't use tin with a Noffle server?
I try rtin 1.7.2 release 20031019 ("Berneray") and it always sends a
LIST NEWSGROUPS command to the newsserver, and Noffle then sends a FIN
to the client.
On the screen it looks like this:
rtin 1.7.2 release 20031019 ("Berneray") [UNIX] (c) Copyright 1991-2003 Iain Lea.
Ok
Your server does not have Xref: in its XOVER information.
Tin will try to use XHDR XREF instead (slows down things a bit).
Reading keymap file...
Reading input history file...
Reading groups from active file...\
Reading groups from newsrc file...|
Reading global attributes file...
Reading attributes file...
Connection to news server has timed out. Reconnect? (Y/n) Y
But I examined the connection with tethereal, and the problem is LIST
NEWSGROUPS.
miernik@tarnica:~$ telnet localhost 10119
Trying ::1...
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
200 NNTP server NOFFLE 1.1.5
LIST NEWSGROUPS
Connection closed by foreign host.
miernik@tarnica:~$
--
Miernik ________________________ jabber:mi...@am...
___________________/__ tel: +48608233394 __/ mailto:mi...@ct...
Sing a declaration against US invasion in Iraq:
http://www.moveon.org/declaration/
|
|
From: Jim H. <jim...@ac...> - 2003-11-09 21:29:31
|
On 09-Nov-2003 Rolf Leggewie wrote: > I have some trouble to compile noffle for use in my Cygwin system. > [...] >| gcc -g -O2 -o noffle authenticate.o client.o configfile.o content.o >| control.o >| database.o dynamicstring.o expire.o fetch.o fetchlist.o filter.o group.o >| itemli >| st.o lock.o log.o noffle.o online.o outgoing.o over.o post.o protocol.o >| pseudo.o >| request.o server.o util.o wildmat.o -lgdbm >| database.o: In function `errMsg': >| /usr/src/noffle-1.1.5/src/database.c:67: undefined reference to >| `gdbm_errno' >| group.o: In function `errMsg': >| /usr/src/noffle-1.1.5/src/group.c:67: undefined reference to `gdbm_errno' >| collect2: ld returned 1 exit status >| make[2]: *** [noffle] Error 1 >| make[2]: Leaving directory `/usr/src/noffle-1.1.5/src' >| make[1]: *** [all-recursive] Error 1 >| make[1]: Leaving directory `/usr/src/noffle-1.1.5' >| make: *** [all-recursive-am] Error 2 I must confess that while I have built Noffle on Cygwin in the past, it was a one-off. I don't have regular access to a Windows machine to keep Noffle up to date on Cygwin. That being said, it looks to me like this isn't far from working. I notice that the configure seems to have found gdbm.h and found gdbm_open, which implies it found the gdbm library. Your problem is coming at link time, when gdbm_errno isn't found in the library. This is rather curious. > I am no expert at compiling things. From what I gathered in the gdbm > manpage, gdbm_errno should be available in gdbm.h which resides in > /usr/include. Explicitly passing --includedir=/usr/include and > --with-gdbm-include=/usr/include to ./configure did not alleviate the > problem. From what I can see, finding gdbm.h isn't the problem. The problem is with the gdbm library, which will be either libgdbm.a or libgdbm.so. Either this library isn't being found - which is strange, as the configure says it found it - or it is missing gdbm_errno. Which is equally strange. First, check the version of GDBM you have installed. You should have CygWin packages libgdbm *and* libgdbm-devel installed. In usr/share/doc/ there should be a libgdbm-devel directory with a version number; e.g. libgdbm-devel-1.8.3 (the current version). What is the version number? How up to date is your CygWin installation? Secondly, can you find the GDBM library - which will be /usr/lib/libgdbm.a. Do you get anything from running the command 'strings /usr/lib/libgdbm.a | grep gdbm_errno'? Finally, also try reconfiguring with --enable-debug=yes, and then rebuild. That will enable a good number of compiler warnings, and there may be a clue there. -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Rolf L. <vs...@ex...> - 2003-11-09 12:58:10
|
Hi,
I have some trouble to compile noffle for use in my Cygwin system.
,----- [ compile log ]
|
| leggewie@prod5 /usr/src/noffle-1.1.5
| $ ./configure
| loading cache ./config.cache
| checking for a BSD compatible install... /usr/bin/install -c
| checking whether build environment is sane... yes
| checking whether make sets ${MAKE}... yes
| checking for working aclocal... found
| checking for working autoconf... found
| checking for working automake... found
| checking for working autoheader... found
| checking for working makeinfo... missing
| checking for gcc... gcc
| checking whether the C compiler (gcc ) works... yes
| checking whether the C compiler (gcc ) is a cross-compiler... no
| checking whether we are using GNU C... yes
| checking whether gcc accepts -g... yes
| checking how to run the C preprocessor... gcc -E
| checking whether gcc needs -traditional... no
| checking for a BSD compatible install... /usr/bin/install -c
| checking whether make sets ${MAKE}... (cached) yes
| checking for sendmail... 'notfound'
| checking for AIX... no
| checking for POSIXized ISC... no
| checking for minix/config.h... no
| checking for gethostent... no
| checking for gethostent in -lnsl... no
| checking for setsockopt... yes
| checking for gdbm_open in -lgdbm... yes
| checking for gdbm.h... yes
| checking for ANSI C header files... yes
| checking for dirent.h that defines DIR... yes
| checking for opendir in -ldir... no
| checking for syslog.h... yes
| checking for sys/resource.h... yes
| checking for sys/utsname.h... yes
| checking for fnmatch.h... yes
| checking for errno.h... yes
| checking for getopt.h... yes
| checking for time.h... yes
| checking for sys/time.h... yes
| checking for signal.h... yes
| checking for netdb.h... yes
| checking for sys/socket.h... yes
| checking for fcntl.h... yes
| checking for limits.h...
| checking for unistd.h... yes
| checking for sys/types.h... yes
| checking for regex.h... yes
| checking for pwd.h... yes
| checking for working const... yes
| checking for size_t... yes
| checking whether time.h and sys/time.h may both be included... yes
| checking whether struct tm is in sys/time.h or time.h... time.h
| checking socklen_t... yes
| checking return type of signal handlers... void
| checking for strftime... yes
| checking for working fnmatch... yes
| checking for fdopen... yes
| checking for mkdir... yes
| checking for select... yes
| checking for socket... yes
| checking for gethostname... yes
| checking for uname... yes
| checking for snprintf... yes
| checking for vsnprintf... yes
| checking for __vsnprintf... no
| checking for __snprintf... no
| checking for strerror... yes
| checking for strstr... yes
| checking for mktime... yes
| checking for timegm... no
| checking usersfile... /etc/noffle.users
| checking other documentation directory... /usr/local/share/doc/noffle
| checking spooldir... /var/spool/noffle
| checking configfile... /etc/noffle.conf
| updating cache ./config.cache
| creating ./config.status
| creating Makefile
| creating src/Makefile
| creating docs/Makefile
| creating packages/Makefile
| creating packages/redhat/Makefile
| creating config.h
|
| leggewie@prod5 /usr/src/noffle-1.1.5
| $ make
| make all-recursive
| make[1]: Entering directory `/usr/src/noffle-1.1.5'
| Making all in src
| make[2]: Entering directory `/usr/src/noffle-1.1.5/src'
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c authenticate.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c client.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c configfile.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c content.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c control.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c database.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c dynamicstring.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c expire.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c fetch.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c fetchlist.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c filter.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c group.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c itemlist.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c lock.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c log.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c noffle.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c online.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c outgoing.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c over.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c post.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c protocol.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c pseudo.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c request.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c server.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c util.c
| gcc -DHAVE_CONFIG_H -I. -I. -I.. -g -O2 -c wildmat.c
| gcc -g -O2 -o noffle authenticate.o client.o configfile.o content.o control.o
| database.o dynamicstring.o expire.o fetch.o fetchlist.o filter.o group.o itemli
| st.o lock.o log.o noffle.o online.o outgoing.o over.o post.o protocol.o pseudo.o
| request.o server.o util.o wildmat.o -lgdbm
| database.o: In function `errMsg':
| /usr/src/noffle-1.1.5/src/database.c:67: undefined reference to `gdbm_errno'
| group.o: In function `errMsg':
| /usr/src/noffle-1.1.5/src/group.c:67: undefined reference to `gdbm_errno'
| collect2: ld returned 1 exit status
| make[2]: *** [noffle] Error 1
| make[2]: Leaving directory `/usr/src/noffle-1.1.5/src'
| make[1]: *** [all-recursive] Error 1
| make[1]: Leaving directory `/usr/src/noffle-1.1.5'
| make: *** [all-recursive-am] Error 2
|
| leggewie@prod5 /usr/src/noffle-1.1.5
| $ ls -l /usr/include/gdbm.h
| -rw-r--r-- 1 leggewie 544 4744 Jul 20 09:59 /usr/include/gdbm.h
|
| leggewie@prod5 /usr/src/noffle-1.1.5
| $ uname -a
| CYGWIN_98-4.10 PROD5 1.3.11(0.53/3/2) 2002-06-23 22:31 i586 unknown
|
`-----
I am no expert at compiling things. From what I gathered in the gdbm
manpage, gdbm_errno should be available in gdbm.h which resides in
/usr/include. Explicitly passing --includedir=/usr/include and
--with-gdbm-include=/usr/include to ./configure did not alleviate the
problem. I am stuck at this point. Your help is greatly appreciated.
Best regards
Rolf Leggewie
--
http://home.arcor.de/leggewie/
http://leggewie.biz/hamster.htm
|
|
From: Dan J. <ji...@ji...> - 2003-11-03 20:36:39
|
Gentlemen, introducing http://jidanni.org/comp/ppp/noffle-wipe-last-request Exciting action shots: # noffle-wipe-last-request removing this line from /var/spool/noffle/requested/news.gmane.org <l03020901b6d56c0c23dc@[216.221.130.241]> Plus, limited bumble protection: # noffle-wipe-last-request bin/noffle-wipe-last-request: Not exactly one file in /var/spool/noffle/requested changed in last minute |
|
From: Dan J. <ji...@ji...> - 2003-10-30 04:20:13
|
I have topped Carles's solution with http://jidanni.org/comp/ppp/noffle-newgroups , i.e.: echo newgroups $(date +%Y%m%d\ %H%M%S -d "$1 days ago")| netcat -q 22 localhost 119| awk '/^\./{next};{sub(/\r/,"")};/^[0-9]+ /{print;next};{print $NF,$1}'| sort -k 2 |
|
From: Miernik <mi...@ct...> - 2003-10-20 11:19:01
|
On 2003-10-19, Mirko Liss <mir...@we...> wrote:
> In fact, it does. falloc.c:_gdbm_alloc() looks for the first available
> block of sufficient size. It reclaims as much as it it needs and frees
> the rest. falloc.c:_gdbm_free() merges adjacent blocks of available
> space to prevent fragmentation. Some fragmentation does still occur, but
> IMHO gdbm does a fairly good job of managing freed space.
>
> Well. This applies to the old, musty gdbm-1.8.0 from 1999. But the
> ancient, mouldy gdbm-1.7.3 from 1994 is not able to merge blocks of
> available space.
>
> Miernik, which version of gdbm is used by your distribution?
Debian unstable libgdbm3 1.8.3-2
--
Miernik ________________________ jabberid:mi...@am...
___________________/__ tel: +48608233394 __/ mailto:mi...@ct...
Truth about Bush's military operations:
http://www.TruthAboutWar.org/
|
|
From: Mirko L. <mir...@we...> - 2003-10-19 23:04:12
|
Jim Hague: > On 19-Oct-2003 Mirko Liss wrote: > > BTW: Articles crossposted to groups with different expiry periods will > > be deleted at the _first_ possible date, not the last one. > > Do they? I tried to make them expire at the last possible date; see code in > expire.c, calcExpireDays(). You tried and did. > Have I got it wrong? Sorry, it was my mistake. That was a bug in a local version I messed up and forgot to delete. I'd tried to move the headers x-noffle-status and x-noffle-lastaccess to the overviews and out of articles.gdbm. |
|
From: Mirko L. <mir...@we...> - 2003-10-19 20:58:07
|
Jim Hague: > On 19-Oct-2003 Miernik wrote: > > My /var/spool/noffle/data/articles.gdbm file never gets smaller in > > size. > > Unfortunately, that's right. Noffle uses a gdbm file to store articles. Gdbm > doesn't shrink files normally and desn't appear to be that good at reclaiming > deleted space, though the gdbm manual page claims gdbm will reuse space vacated > by deleted records. In fact, it does. falloc.c:_gdbm_alloc() looks for the first available block of sufficient size. It reclaims as much as it it needs and frees the rest. falloc.c:_gdbm_free() merges adjacent blocks of available space to prevent fragmentation. Some fragmentation does still occur, but IMHO gdbm does a fairly good job of managing freed space. Well. This applies to the old, musty gdbm-1.8.0 from 1999. But the ancient, mouldy gdbm-1.7.3 from 1994 is not able to merge blocks of available space. Miernik, which version of gdbm is used by your distribution? |
|
From: Miernik <mi...@ct...> - 2003-10-19 20:11:24
|
On 2003-10-19, Jim Hague <jim...@ac...> wrote:
> On 19-Oct-2003 Miernik wrote:
>> My /var/spool/noffle/data/articles.gdbm file never gets smaller in
>> size.
>
> To really shrink the files, you need to use noffle's rebuild option.
> Check the noffle manual page for 'noffle --rebuild'.
Thanks, after --rebuild my 200+ MB file srinked to circa 4 MB.
And I made a mistake in the first post - the numbers of articles where
the numbers of articles in the overview, not numer of fetched
articles.
Does the same apply to groupinfo.gdbm ?
It's 13110335 bytes in size now, and I have 54626 groups avialable at
my server (Usenet+Gmane). Is that the usual size?
--
Miernik ________________________ jabberid:mi...@am...
___________________/__ tel: +48608233394 __/ mailto:mi...@ct...
Sing a declaration against US invasion in Iraq:
http://www.moveon.org/declaration/
|
|
From: Jim H. <jim...@ac...> - 2003-10-19 18:51:48
|
On 19-Oct-2003 Mirko Liss wrote: > BTW: Articles crossposted to groups with different expiry periods will > be deleted at the _first_ possible date, not the last one. Do they? I tried to make them expire at the last possible date; see code in expire.c, calcExpireDays(). Have I got it wrong? -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Mirko L. <mir...@we...> - 2003-10-19 18:09:02
|
Miernik: > My /var/spool/noffle/data/articles.gdbm file never gets smaller in > size. $ ls --size /var/spool/noffle/data/articles.gdbm 83196 /var/spool/noffle/data/articles.gdbm $ noffle --expire Expiring articles [..bla bla.. overviews deleted from group ..bla bla..] $ ls --size /var/spool/noffle/data/articles.gdbm 83196 /var/spool/noffle/data/articles.gdbm $ noffle --rebuild Rebuilding article database $ ls --size /var/spool/noffle/data/articles.gdbm 62520 /var/spool/noffle/data/articles.gdbm Jim Hague added the --rebuild option in June 2002. In earlier versions, it was performed during expire. But gdbm databases are copied during reorganisation. If you were low on disc space, 'noffle --expire' used to fail. If you don't '--rebuild' after each '--expire', slack space in your database may be used to store new articles. The file articles.gdbm will not grow continually. I've told cron to '--expire' weekly and to '--rebuild' four times per year. BTW: Articles crossposted to groups with different expiry periods will be deleted at the _first_ possible date, not the last one. |
|
From: Jim H. <jim...@ac...> - 2003-10-19 15:02:48
|
On 19-Oct-2003 Miernik wrote: > My /var/spool/noffle/data/articles.gdbm file never gets smaller in > size. Unfortunately, that's right. Noffle uses a gdbm file to store articles. Gdbm doesn't shrink files normally and desn't appear to be that good at reclaiming deleted space, though the gdbm manual page claims gdbm will reuse space vacated by deleted records. To really shrink the files, you need to use noffle's rebuild option. Check the noffle manual page for 'noffle --rebuild'. -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Miernik <mi...@ct...> - 2003-10-19 09:23:15
|
I use noffle 1.1.5 from Debian (1.1.5-4).
My /var/spool/noffle/data/articles.gdbm file never gets smaller in
size.
time size articles bytes/article
2003-07-20 23:39 158367585 27955 5665
2003-08-20 00:34 177582869 20065 8850
2003-10-05 00:32 206119867 9274 22226
2003-10-19 09:27 207628812 11015 18850
articles.gdbm file grows in size, even though number of articles gets
smaller. I think it's very unlikely for my average article size to
grow so much (4 times).
I get an impression noffle never physically deletes the articles from
the articles.gdbm file.
--
Miernik ________________________ jabberid:mi...@am...
___________________/__ tel: +48608233394 __/ mailto:mi...@ct...
Bush "won" 2000 elections with 537 Florida votes. More people where illegaly
prevented to vote: http://www.gregpalast.com/detail.cfm?artid=122&row=1
|
|
From: Carles A. <ll...@ar...> - 2003-10-16 17:46:14
|
Dan Jacobson wrote:
>
<>
> echo Newsgroups added in the last ${1?} days:
> noffle -g|perl -wlane '
> use Date::Parse;
> BEGIN{$now=str2time();}
> my $then = str2time($F[6]);
> if (($now-$then)/3600/24 <= '${1?}'){print $F[6], " ", $F[0]}
> '|sort -k 2
> #P.S. perhaps in anacrontab try e.g.
> #11 22 noffnew /home/you/bin/noffle-newgroups 13
>
> After someone tells me how to make this a non-embarrassing pure perl
> script, I will put it on my website.
echo Newsgroups added in the last ${1?} days:
noffle -g | awk -v d=$(date +%Y-%m-%d -d"$1 days ago") \
'{if ($7 >= d) print $1" "$7}' | sort -k 2
do work as well.
Regards,
Carles Arjona
|
|
From: Dan J. <ji...@ji...> - 2003-10-06 04:03:37
|
Fellas, introducing #!/bin/sh -e # noffle-newgroups -- show new groups added in the last $1 days # Copyright : http://www.fsf.org/copyleft/gpl.html # Author : Dan Jacobson -- http://jidanni.org/ # Created On : Mon Oct 6 11:21:02 2003 # Last Modified On: Mon Oct 6 11:42:40 2003 # Update Count : 6 #Usage: noffle-newgroups number_of_days echo Newsgroups added in the last ${1?} days: noffle -g|perl -wlane ' use Date::Parse; BEGIN{$now=str2time();} my $then = str2time($F[6]); if (($now-$then)/3600/24 <= '${1?}'){print $F[6], " ", $F[0]} '|sort -k 2 #P.S. perhaps in anacrontab try e.g. #11 22 noffnew /home/you/bin/noffle-newgroups 13 After someone tells me how to make this a non-embarrassing pure perl script, I will put it on my website. |
|
From: Jim H. <jim...@ac...> - 2003-10-02 10:46:18
|
(Sorry about the delay getting back on this - work has been a bit pressing of late...) On 26-Sep-2003 Dan Jacobson wrote: > sample of syslog: > Getting remote overviews 233-676 for group gmane.emacs.bbdb.user > Article number inconsistent (gmane.emacs.bugs rmt=1-1356, next=5850). > Refetching from 913 > Getting remote overviews 913-1356 for group gmane.emacs.bugs > > there must be a stage in the communication where if the remote > connection drops, all counters for all the groups for that server are > in danger all at once. The next counter is updated at the end of (successful) processing each downloaded group of overviews. Anyway, looking at gmane.emacs.bugs, the next counter looks about right. The remote article range last counter looks completely stuffed, though. That is read straight from the response to the GROUP command. So, the question is did the Gmane INN server have a brainfart and really return "211 13?? 1 1356" or did Noffle manage to mis-parse the reply? The group reply line is <status> <estimated articles in spool> <first article no> <last article no> and currently we pay no attention to the estimated articles. I suppose we could try checking (last - first) >= estimated, and log a warning if not. BTW, news.gmane.org is currently saying group gmane.emacs.bugs 211 5819 1 5895 gmane.emacs.bugs Unfortunately unless you were logging all the NNTP traffic there currently isn't a log for what was actually read for the group first and last. How frequently do you have this problem? Would it be possible for you to pop 'log-debug protocol' into your noffle.conf until this happens again? This will log all NNTP traffic so it will produce sizeable log files. -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Dan J. <ji...@ji...> - 2003-09-26 03:51:49
|
Jim> The next counter is the counter Noffle stored at the end of the previous fetch Jim> as being the article number of the next article to fetch. Jim> The inconsistency message is generated when "next > last + 1". These days when running big downloads on my little modem, many competing nntp connections might poop out. well, ok, I' try connect-timeout 120 #was 60, but still, I have a guess/feeling that noffle isn't doing enough to safeguard counter integrity at each step of the game. >>>>> ""[" == "[ NOFFLE ]" <news> writes: "[> [ NOFFLE INFO: Article counter inconsistent ] "[> [ This group's article counter is not ] "[> [ consistent Probably the remote news server ] "[> [ was changed or has reset its article counter ] "[> [ for this group. As a consequence there could ] or more likely, last time our connection was dropped, and we threw away what we knew[?] "[> [ be some articles be duplicated in this group ] "[> [ Group: gmane.network.noffle.user ] "[> [ Remote first article number: 1 ] "[> [ Remote last article number: 96 ] "[> [ Remote next article number: 101 ] "[> [ Refetching from article: 1 ] sample of syslog: Getting remote overviews 233-676 for group gmane.emacs.bbdb.user Article number inconsistent (gmane.emacs.bugs rmt=1-1356, next=5850). Refetching from 913 Getting remote overviews 913-1356 for group gmane.emacs.bugs there must be a stage in the communication where if the remote connection drops, all counters for all the groups for that server are in danger all at once. |
|
From: Jim H. <jim...@ac...> - 2003-09-25 14:57:41
|
On 22-Sep-2003 Dan Jacobson wrote: > Sniff, something happened to all the gmane article numbers for me. > > I'm OK, but did see old articles dragged in. > >>>>>> "Lars" == Lars Magne Ingebrigtsen <la...@gn...> writes: > > Lars> Dan Jacobson <ji...@ji...> writes: >>> [ This group's article counter is not ] >>> [ consistent Probably the remote news server ] >>> [ was changed or has reset its article counter ] >>> [ for this group. As a consequence there could ] >>> [ be some articles be duplicated in this group ] >>> [ Group: gmane.discuss ] > > Lars> Nothing happened to the Gmane article numbers as far as I can see. > > so it must have been a hiccup at my end. The psuedo-message (and the log) should have the remote first, last and next counters. Any chance you could dig them out? The first and last counters are the first article no./last article no. the upstream server reported when it changed to the group. The next counter is the counter Noffle stored at the end of the previous fetch as being the article number of the next article to fetch. The inconsistency message is generated when "next > last + 1". -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Dan J. <ji...@ji...> - 2003-09-22 05:27:06
|
Sniff, something happened to all the gmane article numbers for me. I'm OK, but did see old articles dragged in. >>>>> "Lars" == Lars Magne Ingebrigtsen <la...@gn...> writes: Lars> Dan Jacobson <ji...@ji...> writes: >> [ This group's article counter is not ] >> [ consistent Probably the remote news server ] >> [ was changed or has reset its article counter ] >> [ for this group. As a consequence there could ] >> [ be some articles be duplicated in this group ] >> [ Group: gmane.discuss ] Lars> Nothing happened to the Gmane article numbers as far as I can see. so it must have been a hiccup at my end. |
|
From: Ivan V. <iv...@fe...> - 2003-09-19 20:14:45
|
Jim Hague: >I assume your primary problem is that Noffle considers not >having an upstream >server defined in noffle.conf to be a fatal error(*). Yes, that was my problem. I'll try it out. :) -- Every sufficiently advanced magic is indistinguishable from technology - Arthur C Anticlarke |
|
From: Dan J. <ji...@ji...> - 2003-09-18 23:27:12
|
So often do I select a message only to find it is one that must be requested from the server on the next connection, due to my complex filter rules. If I had know that then usually I wouldn't have selected that article. Therefore, I wish there could be some way to tell, say an asterisk prepended to the Subject or something, that we could activate in /etc/news/noffle.conf . Or maybe change their Lines to 0 or prepend a * [will break stuff though]. |
|
From: Jim H. <jim...@ac...> - 2003-09-18 10:29:12
|
On 18-Sep-2003 Ivan Voras wrote: > Can noffle be used as an standalone news server, without external feeds? You should be able to. > How? I assume your primary problem is that Noffle considers not having an upstream server defined in noffle.conf to be a fatal error(*). So put one in. I think you can put in any old name. The point is that it's only if you issue 'noffle --query' or 'noffle --fetch' that Noffle tries to access the upstream server (in normal use - 'online mode' will cause other server accesses). So, if you don't issue 'noffle --query groups' or 'noffle --fetch' you will be fine. Use 'noffle --create' to create local groups, and post away. 'noffle --modify' can be used to set a group description and change posting status. You will still want to run 'noffle --expire' regularly if you want it to expire articles. Please tell us if you have problems. (*) Maybe we should change that error into a warning. Comments? -- Jim Hague - jim...@ac... Never trust a computer you can't lift. |
|
From: Ivan V. <iv...@fe...> - 2003-09-18 09:22:31
|
Can noffle be used as an standalone news server, without external feeds? How? -- Every sufficiently advanced magic is indistinguishable from technology - Arthur C Anticlarke |
60 messages has been excluded from this view by a project administrator.
