Work at SourceForge, help us to make it a better place! We have an immediate need for a Support Technician in our San Francisco or Denver office.

Close

#59 working with over 100k observations

closed
None
5
2010-10-15
2010-10-13
Tomas Houska
No

I was trying an answer to why is gretl limited by 100k observations and I was surpriced to not find it. Could someone please give me some info on that? I am working with 99k observations due to the limit, and all the work seems pretty seamless, no crashing etc. It seems to me that the computation core could come with more than 100k observations...

thank you for any info that this!

Discussion

  • Allin Cottrell
    Allin Cottrell
    2010-10-13

    • assigned_to: nobody --> allin
     
  • Allin Cottrell
    Allin Cottrell
    2010-10-13

    What gives you the impression that gretl is limited to 100K
    observations? The following script, for example, runs OK:

    nulldata 500000
    series y = normal()
    series x = normal()
    ols y 0 x

     
  • Tomas Houska
    Tomas Houska
    2010-10-13

    ok, I guess I didnt specify my question right. There is a 100k limit when working with panel data, isnt there? every time I try to put more than 100k observations into the dialog when creating new panel data set, it always corrects me so that the max. number of observations used is 100k.

     
  • Allin Cottrell
    Allin Cottrell
    2010-10-13

    The 100k limit applies only if you're constructing a dataset from
    scratch via the GUI, and it's designed to avoid bringing the GUI
    to a halt by displaying a huge data editor. But there's no fixed
    limit if you use the "nulldata" script command, nor if you bring in data
    from file (as would be the usual procedure).

    I don't understand why you're using the GUI "create a dataset" option:
    surely you're not planning to type in hundreds of thousands of values?

     
  • Tomas Houska
    Tomas Houska
    2010-10-15

    I am using data from MySQL that I am importing to Gretl. I am trying to insert data from my MySQL db, but for some reason by time variable is probably in a wrong format. If I use nulldata to create a data file, then I import all data (not marked as a panel yet) - including place and time index variables, next step is to use "setobs x y --panel-var", but as I said, my time var is probably in a worng format. (in db I have it as e.g. 4M2007 - april 2007, but only the first number gets imported. so the var is eventually just 1-12 - for 12 moths in a year). That is why I was using the GUI to set up the data set manually - I couldnt do it via script.

    hmmm... now that I think of it I would welcome some "gretl trobleshooting forum" where users could share their experience and ask questions if necessary. I think that since Gretl is quite widespread already it shouldnt be that hard to find some admins for such a forum...

     
  • Allin Cottrell
    Allin Cottrell
    2010-10-15

    The gretl-users mailing list is a good place to raise this sort of question.
    http://lists.wfu.edu/mailman/listinfo/gretl-users

    Anyway, I have reset the maximum series length to 1000000 in the
    GUI "new dataset" dialog.

     
  • Allin Cottrell
    Allin Cottrell
    2010-10-15

    • status: open --> closed