Menu

#116 Minimum RAM to use in digifits

version_1.0
open
nobody
None
5
2024-11-26
2024-08-01
Mugundhan
No

Hi,

I'm trying to get some guppi files dedispersed, and write as psrfits for further processing. When I try this with digifits without a RAM size, it suggests a size, but when I include that in the command line, it doesn't seem to have been recognized by the program.. An example copied below with the error I get:

digifits -U 8192 -o /media/mugundhan/1d46be89-271a-4dcc-aca0-a12aafaf2b1d/data/proj51/sess_sid20240611T110000_SE607/ar/B0531+21_60472_39599_16070.fits -b 8 -p 4 -t 0.00032768 -T 16.384 -F 122:D -D 56.778 -K -do_dedisp /media/mugundhan/1d46be89-271a-4dcc-aca0-a12aafaf2b1d/data/proj51/sess_sid20240611T110000_SE607/raw/B0531+21_60472_39599_16070.raw
dsp::GUPPIFile::open_file WARNING assuming that first and only header is correct
digifits: requested tsamp=0.00032768 rate=195312
actual tsamp=0.00032768 (tscrunch=64)
digifits: input data not detected
digifits: performing coherent dedispersion at 56.778
digifits: creating 122 by 131072 back channel filterbank
digifits: dedispersion filter length=131072 (minimum=16384) complex samples
digifits: 122 channel convolving filterbank requires 131072 samples

Error::stack
dsp::LoadToFITS::prepare
dsp::SingleThread::set_block_size
Error::InvalidState
Error::message
insufficient RAM: limit=256 MB -> block=0 samples
require=131072 samples -> a minimum of "-U 4982.5" on command line

I tried in different variations, but to no avail.

Mugundhan

Related

Bugs: #116

Discussion

  • Willem van Straten

    Hi Mugundhan,

    I'm not able to reproduce this error on my end, but I did find some duplicated handling of the -U option. I've deleted the duplicate code on a development branch. Could you please try it out on your end? To get the experimental code, please run

    cd dspsr
    git pull
    git checkout bugs-116-digifits-min-ram
    

    and then build and install.

    Cheers,
    Willem

     
  • Willem van Straten

    Hi Mugundhan,

    Have you had an opportunity to test out the code on the bugs-116-digifits-min-ram branch?

    Cheers,
    Willem

     
    • Mugundhan

      Mugundhan - 2024-11-26

      Hi Willem,

      No, I still haven't tried this and I've been in parental leave and vacation. So I'll try to test this once I get back in December. Sorry for the delay.

      Sent from Outlook for iOShttps://aka.ms/o0ukef


      From: bugs@dspsr.p.re.sourceforge.net bugs@dspsr.p.re.sourceforge.net on behalf of Willem van Straten straten@users.sourceforge.net
      Sent: Tuesday, November 26, 2024 4:21 AM
      To: [dspsr:bugs] 116@bugs.dspsr.p.re.sourceforge.net
      Subject: [dspsr:bugs] #116 Minimum RAM to use in digifits

      Hi Mugundhan,

      Have you had an opportunity to test out the code on the bugs-116-digifits-min-ram branch?

      Cheers,
      Willem


      [bugs:#116]https://sourceforge.net/p/dspsr/bugs/116/ Minimum RAM to use in digifits

      Status: open
      Group: version_1.0
      Created: Thu Aug 01, 2024 12:43 PM UTC by Mugundhan
      Last Updated: Fri Aug 02, 2024 01:31 PM UTC
      Owner: nobody

      Hi,

      I'm trying to get some guppi files dedispersed, and write as psrfits for further processing. When I try this with digifits without a RAM size, it suggests a size, but when I include that in the command line, it doesn't seem to have been recognized by the program.. An example copied below with the error I get:

      digifits -U 8192 -o /media/mugundhan/1d46be89-271a-4dcc-aca0-a12aafaf2b1d/data/proj51/sess_sid20240611T110000_SE607/ar/B0531+21_60472_39599_16070.fits -b 8 -p 4 -t 0.00032768 -T 16.384 -F 122:D -D 56.778 -K -do_dedisp /media/mugundhan/1d46be89-271a-4dcc-aca0-a12aafaf2b1d/data/proj51/sess_sid20240611T110000_SE607/raw/B0531+21_60472_39599_16070.raw
      dsp::GUPPIFile::open_file WARNING assuming that first and only header is correct
      digifits: requested tsamp=0.00032768 rate=195312
      actual tsamp=0.00032768 (tscrunch=64)
      digifits: input data not detected
      digifits: performing coherent dedispersion at 56.778
      digifits: creating 122 by 131072 back channel filterbank
      digifits: dedispersion filter length=131072 (minimum=16384) complex samples
      digifits: 122 channel convolving filterbank requires 131072 samples

      Error::stack
      dsp::LoadToFITS::prepare
      dsp::SingleThread::set_block_size
      Error::InvalidState
      Error::message
      insufficient RAM: limit=256 MB -> block=0 samples
      require=131072 samples -> a minimum of "-U 4982.5" on command line

      I tried in different variations, but to no avail.

      Mugundhan


      Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/dspsr/bugs/116/

      To unsubscribe from further messages, please visit https://sourceforge.net/auth/subscriptions/

       

      Related

      Bugs: #116

  • Willem van Straten

    No worries! Enjoy your time on leave!

     

Log in to post a comment.