[Noffle-devel] [ noffle-Bugs-532545 ] Strange behaviour adding large newsgroup
Brought to you by:
bears
Menu
▾
▴
[Noffle-devel] [ noffle-Bugs-532545 ] Strange behaviour adding large newsgroup
|
From: SourceForge.net <no...@so...> - 2004-09-07 19:34:48
|
Bugs item #532545, was opened at 2002-03-20 16:22 Message generated for change (Settings changed) made by bears You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=101044&aid=532545&group_id=1044 Category: None Group: None >Status: Closed Priority: 5 Submitted By: Nobody/Anonymous (nobody) Assigned to: Jim Hague (bears) Summary: Strange behaviour adding large newsgroup Initial Comment: I'm using noffle-1.0.1 on Linux. Adding a newsgroup with a large number of articles and then fetching mails leads to strange behaviour which smells like a buffer overflow: root# noffle -S news.admin.net-abuse.email Adding news.admin.net-abuse.email to fetch list in full mode. root# noffle -f Fetch from 'news.cis.dfn.de' Connected to 130.133.1.4:119 Updating groupinfo No new articles in alt.sys.pdp10 No new articles in de.comm.uucp Missing articles (news.admin.net-abuse.email first=1460366 next=1443472) Cutting number of overviews to 32767 Getting remote overviews 1587578-1620344 for group news.admin.net-abuse.email Could not save group No such file or directory: ÔV Could not save group No such file or directory: ÕV Could not save group No such file or directory: ÖV Could not save group No such file or directory: ×V Could not save group No such file or directory: ØV Could not save group No such file or directory: ÙV Could not save group No such file or directory: ÚV Could not save group No such file or directory: ÛV Could not save group No such file or directory: ÜV Could not save group No such file or directory: ÝV Could not save group No such file or directory: ÞV Could not save group No such file or directory: ßV Could not save group No such file or directory: àV Could not save group No such file or directory: áV Could not save group No such file or directory: âV Could not save group No such file or directory: ãV Could not save group No such file or directory: äV Could not save group No such file or directory: åV Could not save group No such file or directory: æV Could not save group No such file or directory: çV Could not save group No such file or directory: èV Could not save group No such file or directory: éV Could not save group No such file or directory: êV Could not save group No such file or directory: ëV Could not save group No such file or directory: ìV Could not save group No such file or directory: íV Could not save group No such file or directory: îV Could not save group No such file or directory: ïV Could not save group No such file or directory: ðV Could not save group No such file or directory: ñV Could not save group No such file or directory: òV Could not save group No such file or directory: óV Could not save group No such file or directory: ôV Could not save group No such file or directory: õV Could not save group No such file or directory: öV Could not save group No such file or directory: ÷V Could not save group No such file or directory: øV Could not save group No such file or directory: ùV Could not save group No such file or directory: úV Could not save group No such file or directory: ûV Could not save group No such file or directory: üV Could not save group No such file or directory: ýV Could not save group No such file or directory: þV Could not save group No such file or directory: ÿV Could not save group No such file or directory: Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory:W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Would not save group No such file or directory: Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: W Could not save group No such file or directory: !W Could not save group No such file or directory: "W Could not save group No such file or directory: #W Could not save group No such file or directory: $W Could not save group No such file or directory: %W Could not save group No such file or directory: &W Could not save group No such file or directory: 'W Could not save group No such file or directory: (W Could not save group No such file or directory: )W Could not save group No such file or directory: *W Could not save group No such file or directory: +W Could not save group No such file or directory: ,W Could not save group No such file or directory: -W Could not save group No such file or directory: .W Could not save group No such file or directory: /W Could not save group No such file or directory: 0W Could not save group No such file or directory: 1W Could not save group No such file or directory: 2W Could not save group No such file or directory: 3W Could not save group No such file or directory: 4W Could not save group No such file or directory: 5W Could not save group No such file or directory: 6W Could not save group No such file or directory: 7W Could not save group No such file or directory: 8W Could not save group No such file or directory: 9W Could not save group No such file or directory: :W Could not save group No such file or directory: ;W Could not save group No such file or directory: <W Could not save group No such file or directory: =W Could not save group No such file or directory: >W Could not save group No such file or directory: ?W Could not save group No such file or directory: @W Could not save group No such file or directory: AW Could not save group No such file or directory: BW Could not save group No such file or directory: CW Could not save group No such file or directory: DW Could not save group No such file or directory: EW Could not save group No such file or directory: FW Could not save group No such file or directory: GW Could not save group No such file or directory: HW Could not save group No such file or directory: IW Could not save group No such file or directory: JW Could not save group No such file or directory: KW Could not save group No such file or directory: LW Could not save group No such file or directory: MW Could not save group No such file or directory: NW Could not save group No such file or directory: OW Could not save group No such file or directory: PW Could not save group No such file or directory: QW Could not save group No such file or directory: RW Could not save group No such file or directory: SW Could not save group No such file or directory: TW Could not save group No such file or directory: UW Could not save group No such file or directory: VW Could not save group No such file or directory: WW Could not save group No such file or directory: XW Could not save group No such file or directory: YW Could not save group No such file or directory: ZW Could not save group No such file or directory: [W Could not save group No such file or directory: \W Could not save group No such file or directory: ]W Could not save group No such file or directory: ^W Could not save group No such file or directory: _W Could not save group No such file or directory: `W Could not save group No such file or directory: aW Could not save group No such file or directory: bW Could not save group No such file or directory: cW Could not save group No such file or directory: dW Could not save group No such file or directory: eW Could not save group No such file or directory: fW Could not save group No such file or directory: gW Could not save group No such file or directory: hW Could not save group No such file or directory: iW Could not save group No such file or directory: jW Could not save group No such file or directory: kW Could not save group No such file or directory: lW Could not save group No such file or directory: mW Could not save group No such file or directory: nW Could not save group No such file or directory: oW Could not save group No such file or directory: pW Could not save group No such file or directory: qW Could not save group No such file or directory: rW Could not save group No such file or directory: sW Could not save group No such file or directory: tW Could not save group No such file or directory: uW Could not save group No such file or directory: vW Could not save group No such file or directory: wW Could not save group No such file or directory: xW Could not save group No such file or directory: yW Could not save group No such file or directory: zW Could not save group No such file or directory: {W Could not save group No such file or directory: |W Could not save group No such file or directory: }W Could not save group No such file or directory: ~W Could not save group No such file or directory: W Could not save group No such file or directory: ?W Could not save group No such file or directory: ?W Could not save group No such file or directory: 'W Could not save group No such file or directory: W Could not save group No such file or directory: "W Could not save group No such file or directory: .W Could not save group No such file or directory: +W Could not save group No such file or directory: +W Could not save group No such file or directory: ^W Could not save group No such file or directory: %W Could not save group No such file or directory: SW Could not save group No such file or directory: <W Could not save group No such file or directory: OW Could not save group No such file or directory: ?W Could not save group No such file or directory: ZW Could not save group No such file or directory: ?W Could not save group No such file or directory: ?W Could not save group No such file or directory: 'W Could not save group No such file or directory: 'W Could not save group No such file or directory: "W Could not save group No such file or directory: "W Could not save group No such file or directory: W Could not save group No such file or directory: -W Could not save group No such file or directory: -W Could not save group No such file or directory: ~W Could not save group No such file or directory: TW Could not save group No such file or directory: sW Could not save group No such file or directory: >W Could not save group No such file or directory: oW Could not save group No such file or directory: ?W Could not save group No such file or directory: zW Could not save group No such file or directory: YW Could not save group No such file or directory: W Could not save group No such file or directory: ¡W Could not save group No such file or directory: ¢W Could not save group No such file or directory: £W Could not save group No such file or directory: ¤W Could not save group No such file or directory: ¥W Could not save group No such file or directory: ¦W Could not save group No such file or directory: §W Could not save group No such file or directory: ¨W Could not save group No such file or directory: ©W Could not save group No such file or directory: ªW Could not save group No such file or directory: «W Could not save group No such file or directory: ¬W Could not save group No such file or directory: W Could not save group No such file or directory: ®W Could not save group No such file or directory: ¯W Could not save group No such file or directory: °W Could not save group No such file or directory: ±W Could not save group No such file or directory: ²W Could not save group No such file or directory: ³W Could not save group No such file or directory: ´W Could not save group No such file or directory: µW Could not save group No such file or directory: ¶W Could not save group No such file or directory: ·W Could not save group No such file or directory: ¸W Could not save group No such file or directory: ¹W Could not save group No such file or directory: ºW Could not save group No such file or directory: »W Could not save group No such file or directory: ¼W Could not save group No such file or directory: ½W Could not save group No such file or directory: ¾W Could not save group No such file or directory: ¿W Could not save group No such file or directory: ÀW Could not save group No such file or directory: ÁW Could not save group No such file or directory: ÂW Could not save group No such file or directory: ÃW Could not save group No such file or directory: ÄW Could not save group No such file or directory: ÅW Could not save group No such file or directory: ÆW Could not save group No such file or directory: ÇW Could not save group No such file or directory: ÈW Could not save group No such file or directory: ÉW Could not save group No such file or directory: ÊW Could not save group No such file or directory: ËW Could not save group No such file or directory: ÌW Could not save group No such file or directory: ÍW Could not save group No such file or directory: ÎW Could not save group No such file or directory: ÏW Could not save group No such file or directory: ÐW Could not save group No such file or directory: ÑW Could not save group No such file or directory: ÒW Could not save group No such file or directory: ÓW Could not save group No such file or directory: ÔW Could not save group No such file or directory: ÕW Could not save group No such file or directory: ÖW Could not save group No such file or directory: ×W Could not save group No such file or directory: ØW Could not save group No such file or directory: ÙW Could not save group No such file or directory: ÚW Could not save group No such file or directory: ÛW Could not save group No such file or directory: ÜW Could not save group No such file or directory: ÝW Could not save group No such file or directory: ÞW Could not save group No such file or directory: ßW Could not save group No such file or directory: àW Could not save group No such file or directory: áW Could not save group No such file or directory: âW Could not save group No such file or directory: ãW Could not save group No such file or directory: äW Could not save group No such file or directory: åW Could not save group No such file or directory: æW Could not save group No such file or directory: çW Could not save group No such file or directory: èW Could not save group No such file or directory: éW Could not save group No such file or directory: êW Could not save group No such file or directory: ëW Could not save group No such file or directory: ìW Could not save group No such file or directory: íW Could not save group No such file or directory: îW Could not save group No such file or directory: ïW Could not save group No such file or directory: ðW Could not save group No such file or directory: ñW Could not save group No such file or directory: òW Could not save group No such file or directory: óW Could not save group No such file or directory: ôW Could not save group No such file or directory: õW Could not save group No such file or directory: öW Could not save group No such file or directory: ÷W Could not save group No such file or directory: øW Could not save group No such file or directory: ùW Could not save group No such file or directory: úW Could not save group No such file or directory: ûW Could not save group No such file or directory: üW Could not save group No such file or directory: ýW Could not save group No such file or directory: þW Could not save group No such file or directory: ÿW Could not save group No such file or directory: Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory:X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Xould not save group No such file or directory: Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: X Could not save group No such file or directory: !X Could not save group No such file or directory: "X Could not save group No such file or directory: #X Could not save group No such file or directory: $X Could not save group No such file or directory: %X Could not save group No such file or directory: &X Could not save group No such file or directory: 'X Could not save group No such file or directory: (X Could not save group No such file or directory: )X Could not save group No such file or directory: *X Could not save group No such file or directory: +X Could not save group No such file or directory: ,X Could not save group No such file or directory: -X Could not save group No such file or directory: .X Could not save group No such file or directory: /X Could not save group No such file or directory: 0X Could not save group No such file or directory: 1X Could not save group No such file or directory: 2X Could not save group No such file or directory: 3X Could not save group No such file or directory: 4X Could not save group No such file or directory: 5X Could not save group No such file or directory: 6X Could not save group No such file or directory: 7X Could not save group No such file or directory: 8X Could not save group No such file or directory: 9X Could not save group No such file or directory: :X Could not save group No such file or directory: ;X Could not save group No such file or directory: <X Could not save group No such file or directory: =X Could not save group No such file or directory: >X Could not save group No such file or directory: ?X Could not save group No such file or directory: @X Could not save group No such file or directory: AX Could not save group No such file or directory: BX Could not save group No such file or directory: CX Could not save group No such file or directory: DX Could not save group No such file or directory: EX Could not save group No such file or directory: FX Could not save group No such file or directory: GX Could not save group No such file or directory: HX Could not save group No such file or directory: IX Could not save group No such file or directory: JX Could not save group No such file or directory: KX Could not save group No such file or directory: LX Could not save group No such file or directory: MX Could not save group No such file or directory: NX Could not save group No such file or directory: OX Could not save group No such file or directory: PX Could not save group No such file or directory: QX Could not save group No such file or directory: RX Could not save group No such file or directory: SX Could not save group No such file or directory: TX Received signal 2 (SIGINT). Aborting. (I hit ^C here.) ---------------------------------------------------------------------- Comment By: Peter Backes (rtc1) Date: 2004-09-04 08:51 Message: Logged In: YES user_id=845643 You can close this, it didn't occur anymore. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2002-03-23 01:19 Message: Logged In: NO I added both patches and recompiled with debug mode. I tried hard, but I'm unable to reproduce the behaviour again, obviously because the situation on the server side has changed. The first time I tried to reproduce it, I used the old database, which however already had the article counter for the group increased by the erroneous fetch, thus it didn't reduce the article count to 32767 and worked fine. I then erased any file in /var/spool/noffle and the contents of any of it's subdirectories to start with an untouched installation, loaded a new group list from the server, subscribed to the large group and finally fetched news. But it didn't provoke the misbehavior and again worked fine. Here's the output: [debug lines removed] Fetch from 'news.cis.dfn.de' Connected to 130.133.1.4:119 Updating groupinfo Cutting number of overviews to 32767 Getting remote overviews 1589305-1622071 for group news.admin.net-abuse.email Added news.admin.net-abuse.email 1460781-1486928 26148 articles marked for download in news.admin.net-abuse.email Retrieving article list Retrieving <9fn...@4a...> Retrieving <3C5...@ne....loopback> Retrieving <3C5...@cl...> Retrieving <1IR78.38440$Ni2.218793@news-ser [...] As you can see it still differs by missing one significant line from the erroneous fetch run: Missing articles (news.admin.net-abuse.email first=1460366 next=1443472) So I guess the error had something to do with this, maybe in conjunction with the download reduction to 32767 articles. Sorry if I wasn't of great help here. ---------------------------------------------------------------------- Comment By: Jim Hague (bears) Date: 2002-03-21 09:27 Message: Logged In: YES user_id=184 OK. Looks like you should be OK. I'm not convinced we're seeing the right error message here. Would it be possible for you to try this and re-run? diff -c -r1.3.2.1 group.c *** group.c 17 Jul 2000 13:40:10 -0000 1.3.2.1 --- group.c 21 Mar 2002 09:08:23 -0000 *************** *** 57,64 **** static const char * errMsg( void ) { - if ( errno != 0 ) - return strerror( errno ); return gdbm_strerror( gdbm_errno ); } Also if you could re-run configure with --enable-debug=yes. After both those, re-run the fetch (kill it after the first Could not save group error) and upload the output. I'm wondering if the problem is some feature of a particular article. I'll try the same here against my upstream news server. ---------------------------------------------------------------------- Comment By: Nobody/Anonymous (nobody) Date: 2002-03-20 18:21 Message: Logged In: NO Thanks for the patch. > However, there does seem to be something going wrong. > Do you have plenty of free disc space? I think I have enough. There's enough on /, which is relevant for the /tmp directory, /var for the noffle spool and /usr for the installed binaries. But judge yourself: root# df Filesystem 1k-blocks Used Available Use% Mounted on /dev/hda5 132185 36354 89005 29% / /dev/hda6 513147 443600 43042 92% /usr /dev/hda7 513147 35489 451153 8% /var /dev/hda8 513147 217757 268885 45% /home/daemons /dev/hda9 2035606 1840165 90217 96% /home/localhost /dev/hda12 4036617 3687372 140402 97% /mnt/data /dev/hdb1 241763 227703 1575 100% /mnt/backup root# rpm -qvl noffle -rw------- news news 1776 Sep 16 2001 /etc/noffle.conf -rwsr-xr-x news news 141676 Sep 16 2001 /usr/bin/noffle drwxr-xr-x root wheel 1024 Sep 16 2001 /usr/doc/noffle-1.0.1 -rw-r--r-- root root 17989 May 5 2000 /usr/doc/noffle-1.0.1/COPYING -rw-r--r-- root root 26586 Jun 15 2001 /usr/doc/noffle-1.0.1/ChangeLog -rw-r--r-- root root 1546 May 5 2000 /usr/doc/noffle-1.0.1/FAQ -rw-r--r-- root root 11609 Feb 28 2001 /usr/doc/noffle-1.0.1/INSTALL -rw-r--r-- root root 5758 May 19 2000 /usr/doc/noffle-1.0.1/INTERNALS -rw-r--r-- root root 7127 Sep 10 2000 /usr/doc/noffle-1.0.1/NOTES -rw-r--r-- root root 2992 Feb 28 2001 /usr/doc/noffle-1.0.1/README -rw-r--r-- root root 1776 May 5 2000 /usr/doc/noffle-1.0.1/noffle.conf.example -rw-r--r-- root root 677 May 5 2000 /usr/doc/noffle-1.0.1/noffle.lsm -rw-r--r-- root wheel 2846 Sep 16 2001 /usr/man/man1/noffle.1.gz -rw-r--r-- root wheel 2479 Sep 16 2001 /usr/man/man5/noffle.conf.5.gz drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle/data drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle/lock drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle/outgoing drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle/overview drwxr-sr-x news news 1024 Sep 16 2001 /var/spool/noffle/requested ---------------------------------------------------------------------- Comment By: Jim Hague (bears) Date: 2002-03-20 17:29 Message: Logged In: YES user_id=184 Thanks for the report. The garbage characters at the end of each error message aren't the sign of a buffer overflow, but a coding error when printing the error message. If you're building from source, this patch should show the intended message: diff -c -r1.3.2.1 group.c *** group.c 17 Jul 2000 13:40:10 -0000 1.3.2.1 --- group.c 20 Mar 2002 17:28:48 -0000 *************** *** 146,152 **** val.dptr = buf; val.dsize = bufLen; if ( gdbm_store( grp.dbf, key, val, GDBM_REPLACE ) != 0 ) ! Log_err( "Could not save group %s: %s", errMsg() ); free( buf ); } --- 146,152 ---- val.dptr = buf; val.dsize = bufLen; if ( gdbm_store( grp.dbf, key, val, GDBM_REPLACE ) != 0 ) ! Log_err( "Could not save group %s: %s", grp.name, errMsg() ); free( buf ); } However, there does seem to be something going wrong. Do you have plenty of free disc space? ---------------------------------------------------------------------- You can respond by visiting: https://sourceforge.net/tracker/?func=detail&atid=101044&aid=532545&group_id=1044 |
