Activity for Deez Nutz
-
Deez Nutz posted a comment on discussion Help
if gd2 is retired then BBOS should be officially closed. and, if it will not load all games there is no time to fix it anymore unless someone else would like to take over. however, I still see data https://gd2.mlb.com/components/game/mlb/year_2019/month_09/day_28/gid_2019_09_28_atlmlb_nynmlb_1/inning/inning_1.xml remember that if you navigate to https://gd2.mlb.com/components/game/mlb/year_2019/month_09/day_28 you will get data but this, with the / at the end, will not https://gd2.mlb.com/components/game/mlb/year_2019/month_09/day_28/...
-
6.7.1
-
Ok, all the issues I could find with uploading 2019 have been fixed as well as anything I could find that erred for 2018. 2018 has games that are missing the game_pk also. Mostly spring games. Those should now load as well if you grab version 6.7.1. There was also an issue that Python's urllib class starting taking forwever to download a single files. I had to swap out the use of that library for urllib2. This seems to work but I have only run it against 2019 and 18 as mentioned. Let me know if you...
-
I did get the same error on 2019. no timeline to fix it though. April I hope...? On Wed, Mar 13, 2019 at 7:34 AM Addison addy@users.sourceforge.net wrote: same error for me. also, the 2007 and earlier games seem to have an issue with the park attributes which prevents loading any games at all. i've dug into the code a bit but still cannot resolve - has anyone else been successful fixing this bug? Attachments: bbos_gamepk_error.PNG https://sourceforge.net/p/baseballonastic/discussion/820145/thread/3005a7284e/f9dd/attachment/bbos_gamepk_error.PNG...
-
I do plan on loading data from 2019 in the coming weeks but I have not yet. I'll see if i get an error at that time also On Sun, Mar 3, 2019 at 9:37 PM Mark O'L phunpolo@users.sourceforge.net wrote: Hi folks, Seeing the following error while trying to load 2019 games. Is anyone else dealing with this? ERROR 2019-03-03 23:18:16,392 Thread-6 bbos.consume.83 Died with Exception: Exception in thread Thread-6: Traceback (most recent call last): File "C:\Python27\lib\threading.py", line 801, in bootstrap_inner...
-
it is hard using the gameday data as is. it will also include spring and post season if you loaded those games. but i believe what you have is the general idea. this is why the "normalize" sql script is there. it makes nice relational tables out of the data. you could try running that and then query the "mlb" schema it creates. it basically makes a whole new nicer database and cleans up lots of junk data. if you want to use the gameday schema as is then the sql in the normalize.sql can help you see...
-
each db statement relies on the previous succeeding. so what is the first statement that throws an actual error (non-group by/table does not exist) and what is that error? also watch out for those lines that say 0 rows effected. that could mean a query that is supposed to find some data didn't and that the gameday data didn't actually all load On Mon, May 21, 2018 at 12:22 AM, Steven J Tighe resumeman@users.sourceforge.net wrote: So for the record I found the "group by" error - the server was set...
-
i think your best bet it to run it by hand. you can make it work but it requires changing coding. the table does not exist error is normal, because it deletes each table and then creates it. so if the script has yet to work it will always give those errors. i think you want to look for the errors it is giving that are not "table doesn't exist" cause if you only have two tables then it went wrong at some point. you could also pick apart the file and run one part at a time to make sure each part works...
-
there is a file called bbosConfig.py. please open it with notepad or another text editor. it contains a line that has the word INFO in it. change that to DEBUG please. save the file then rerun and we will see what it is doing more closely. thank you On Thu, Apr 19, 2018 at 1:23 PM, Derek Carty dcbb14@users.sourceforge.net wrote: Yup, 2/24 is the last date I get data for as well pitchfx data seems to be unavailable https://sourceforge.net/p/baseballonastic/discussion/820145/thread/d67e82ee/?limit=25&page=2#d737/c493/14f4/dfc7/afb9/5358/3721...
-
i tried a month of bios and it was working. i also tried the minors and it was working. so, can you grab the latest version 6.6.2 i just posted to ensure we have the same stuff. then when you run first please go to bbosConfig.py and change INFO to DEBUG. this will make a lot more stuff print to the screen. you will be able to see more if it is hung or just chugging away at something. then try the -d or -m month option please so it isnt trying to chug through a year before it loads anything. then...
-
what table are you referring to in 2)? I think you've explained this before but a long time ago. gameday marks the home and away teams so im not sure what the numbering is for. 3) it does not use inning_all and never has. it uses the individual inning files because the inning_all didn't used to exist I believe. i also believe they have the exact same stuff or did in the past. i tried a sample day and I got rows in my feedplays table and actions. "Pitching Change: Pedro Baez replaces Clayton Kershaw,...
-
6.6.2
-
gave all options to bios also
-
gave bios same url opions
-
added by month option
-
removed some bad defaults
-
added some spring tables
-
First, thank you for the donation! Second, I will look into it. I did fix -r also but have not published it yet. Its a busy week in my real job unfortunately. Sorry to make you wait. the JSON data is where the speed off the bat and distance stuff comes from. if there is none for a particular game it is supposed to ignore it. apparently it is not. On Wed, Apr 4, 2018 at 9:37 PM, Derek Carty dcbb14@users.sourceforge.net wrote: Hey DeezNuts, was hoping you might have a suggestion for why I'm getting...
-
i think you do not have the latest changes to the database. basically you would have to go through the createGameday.sql file and find the columns that have been added or expanded so they do not fail and either add them to your DB or alter them to be larger. personally i always just start with a fresh database by running createGameday.sql. it takes days to reload the db if you want past years, but its the computer's time for the most part, not yours. alternatively you can go in gamedayConfig.py and...
-
there is a 6.6.1 cause when I tried 6.6 on 2018 it had a blank field it wouldnt load in one game. however, your issue is that it did not find games. i tried it, doesn't work for me either. I would say that -r does not work currently. and i would guess it is because of the bug that started this thread with the / needing to be not there now. but i am leaving for the weekend. so i will fix next week. for now I would just do bbos.py -y 2018. it will take longer cause it will check every day of the year,...
-
i don't personally use those values so maybe someone else has more information, but I don't believe they are present in the data, and that is why there are no values. I picked a random game from last year and you can see there is a break y for each pitch but no X and Z in the data. http://gd2.mlb.com/components/game/mlb/year_2017/month_07/day_14/gid_2017_07_14_phimlb_milmlb_1/inning/inning_4.xml On Thu, Mar 29, 2018 at 11:26 PM, Erin Bristow baseballgal@users.sourceforge.net wrote: It's working!...
-
well if you run createGameday.sql it will delete the entire database and create a blank one. so you could do that and then download 2017 again. On Thu, Mar 29, 2018 at 6:08 PM, Erin Bristow baseballgal@users.sourceforge.net wrote: Thanks for putting together a new version of this! I have all of 2017 in my DB, but I downloaded files that someone else exported for me (because of the links issue) and there's errors in the data, so I definitely need to start fresh. You said that it's as simple as deleting...
-
6.6.1
-
bug for no position and a coupld fantasy baseball tables
-
im through march and on to april loading the 2016 bios and am not having an issue. the error you have is saying it can't find a setting in the BBOSConfig.py file. is yours missing a line somehow? it should look like this import logging import osandio.fileUtils import os from osandio._7ZipController import _7ZipController class BBOSConfig: #Gameday gamedayURL = 'http://gd2.mlb.com/components/game/' statsapiURL = 'http://statsapi.mlb.com/api/v1/game/' gamedayDaysBackToLoad = 2 dbUser = 'bbos' dbPass...
-
removed all years option that should not be used and was broken
-
remove this from bbosPlayerBio.py elif options.all != None: gamedayGameURLs = gamedayDirectory.getGameURLsForAllAvailable() it is a relic of loading all years at once. you were probably using -y before and so never ran into the issue. On Mon, Feb 26, 2018 at 11:08 PM, Derek Carty dcbb14@users.sourceforge.net wrote: Thanks! I want to keep my old databases and just use the updated scripts to continue adding new data to them. I didn't download data to the playerbios table for 2017 yet, though, so I'm...
-
it depends on if you want to keep the data in your gameday database or replace it with new stuff. also I would be careful with deleting anything without a backup as I have not had time to run it against older years yet. if you are keeping your old DB intact then you need to know the database changes that were needed. i removed UNSIGNED from every database column that had it. but you probably only need to remove it from the columns on the pitches table. apparently there are now negative values for...
-
updated for null pitch type and new year
-
removed cvs dirs
-
new version posted. sourceforge was having issues today but it seems back online now. On Sat, Feb 24, 2018 at 11:20 AM, Deez Nutz willkoky@users.sourceforge.net wrote: I think I have it working for all of 2017 mlb now. I will put out a new version hopefully later today. There wasn't just one thing that changed. aside form the directory structure several new data values were too long or needed massaging within the 2017 data. thanks On Wed, Feb 14, 2018 at 9:00 AM, Beth Woerner woerneea@users.sourceforge.net...
-
added pycs
-
changes for 2017
-
I think I have it working for all of 2017 mlb now. I will put out a new version hopefully later today. There wasn't just one thing that changed. aside form the directory structure several new data values were too long or needed massaging within the 2017 data. thanks On Wed, Feb 14, 2018 at 9:00 AM, Beth Woerner woerneea@users.sourceforge.net wrote: Erin, text me and I'll help you figure it out pitchfx data seems to be unavailable https://sourceforge.net/p/baseballonastic/discussion/820145/thread/d67e82ee/?limit=25#8d1c/8fe8...
-
added pycs
-
well it sounds like sometime you need the / and sometimes you don't. so the code will have to change to understand which situation it is in. I would think the easiest thing to do would be to leave the / in place and then tell the game list code to remove it before fetching the list. as it is the only thing that doesn't need it. off to kids hockey. On Sat, Feb 10, 2018 at 9:25 AM, Brian L Cartwright blcartwright@users.sourceforge.net wrote: I haven't fixed it yet. Removing the trailing "/" at 3 places...
-
I assume doing what Brian said will fix the issue. But I work 2 jobs at this time of year so it may be a while before I can post a new version. Soon I will be forced to as I will want to run last year's numbers in order defend my title in year 27 of my fantasy baseball league :) If anyone would like to do the update themselves I can give them developer access. On Fri, Feb 9, 2018 at 2:21 PM, Quinn Coldiron qcoldiron@users.sourceforge.net wrote: Anybody found more on this? I was setting up a new machine...
-
wow, if you know the name of the game, the files are still there http://gd2.mlb.com/components/game/mlb/year_2017/month_08/day_25/gid_2017_08_25_pitmlb_cinmlb_1/ so in theory bbos.py -g gid_2017_08_25_pitmlb_cinmlb_1 would still work. On Fri, Jan 19, 2018 at 10:39 AM, Kyle W. Willkomm kyle.w.willkomm@gmail.com wrote: I would concur. we may be at the end of an era? everything is found off of http://gd2.mlb.com/components/game/ but if you click down the tree you eventually get a page of no links where...
-
I would concur. we may be at the end of an era? everything is found off of http://gd2.mlb.com/components/game/ but if you click down the tree you eventually get a page of no links where the games should be... http://gd2.mlb.com/components/game/mlb/year_2017/month_08/day_20/ On Thu, Jan 18, 2018 at 3:11 PM, Lon C. Thomas, Jr. lontjr@users.sf.net wrote: I loaded up the latest bbos version, having used bbos several times in the past. I acquired all of 2017, then went back and did it again in a controlled...
-
the mlb table should always have more information than the gameday one so what field is on the gameday that you need that isn't on the mlb.pitches table? looking at how the mlb.pitches table is built should show you the limitations of linking them. not all gameday.pitches rows have IDs. that is why the mlb table numbers them afterwords using the sequence stuff at the bottom below. ########################### pitches drop table if exists mlb.pitches; create table mlb.pitches select a.atbatID, p.id...
-
Are you actually going to use the retrosheet portion of BBOS? most people do not as far as i know. i have not tested it in a long while but it should still work. I have not heard there are better tools either however. people have written tools in Perl but the ones I had seen all required computer programming know how. If you created a user, did you give it a password? if you did the password will have to be placed in the config file also so it can be used in connecting. for retrosheet the connection...
-
at about 14:10 in video one it show you what to type. the installation videos are a little out of date but they capture the gist of things. On Tue, May 23, 2017 at 2:09 PM, Erin Bristow baseballgal@users.sf.net wrote: I have the command prompt open, I just need to know what to type in. I'm defintitely going to keep working at this, I want to make it work. And yes, it is windows, windows 10. Having trouble with command prompt https://sourceforge.net/p/baseballonastic/discussion/820145/thread/ddf4d78c/?limit=25#15eb...
-
I am trying to warn you that if you don't already know how to query a database using SQL then you may not be able to use the data even if you did get it working. It or a deep knowledge of something like Microsoft Excel would be the only ways to access the data once you load it. It is very difficult to use this software without some programming knowledge or data reporting experience. If you still want to proceed, the place to start the software is under Start->Accessories->Command Prompt. If this...
-
Do you know SQL? On May 23, 2017 3:46 AM, "Erin Bristow" baseballgal@users.sf.net wrote: I'd appreciate any advice anyone can give me on this, I'm completely clueless to computer programming. Having trouble with command prompt https://sourceforge.net/p/baseballonastic/discussion/820145/thread/ddf4d78c/?limit=25#f968 Sent from sourceforge.net because you indicated interest in https://sourceforge.net/p/baseballonastic/discussion/820145/ To unsubscribe from further messages, please visit https://so...
-
did you load 2017 data and that is what you are trying to normalize? I haven't done that yet. i usually load after the season. each time the data adds a new wrinkle we have to account for it. there are spots where it cleans up duplicate data before normalizing. clearly that one isn't cleaned up. if you let me know what year you are doing I will load it and put out a new version when its fixed. since its the game condition table you can just skip that part of the script for now unless you need that...
-
at the top of the normalize script is the section below. The first thing it does is create a new DB and then it proceeds to create tables in it. As the black box is saying the mlb.xxx tables don't exist, I have to think the top of the script also failed to create the database and then tables within the DB. Which makes me think the user you are running BBOS as does not have admin privileges to do so. You could start by taking those first few sql statements of the file that create the DB and the first...
-
take look at (or just run normalizeGamedayToMLB.sql) it does that among many other things to clean up the data. it builds an entirely new schema of tables with primary keys for all the data. ######################## pitch sequence ALTER TABLE mlb.pitches ADD pitchSequence SMALLINT(3), ADD balls SMALLINT(1), ADD strikes SMALLINT(1); create table mlb.tOrderedAtbatPitchSequence select a.gameID, a.atbatID, p.pitchID, p.ball, p.strikeOrFoul from mlb.pitches p, mlb.atbats a where p.atbatID = a.atbatID...
-
yes. you should use the installation video as a guide of the general idea of what...
-
the bin folder was causing too many issues and only worked on Windows and then only...
-
Then i think there is simply a bug and nobody has tried to download those items in...
-
i was able to begin the 2009 download. are you sure you are using a python 2.x edition?...
-
Thank you for explaining why we have what we have. On Mon, May 2, 2016 at 3:31 PM,...
-
That's where it comes from. The feed table is named that because it comes from the...
-
mlb stopped publishing that pregumbo file almost as quickly as they published it,...
-
i don't think you want a space between the -y and 2016. -y2016. if that does not...
-
to be clear, everything is still grabbed from the xml files except the one chunk...
-
Unfortunately he is talking about the feedParser which is unlike all the others....
-
BBOS 6.5
-
added timestamp to feed table
-
BBOS 6.4
-
Initial
-
it does, you'd have to update the syntax of some lines and update some libraries...
-
well, I can tell you why its happening, but it will take a code change to fix it....
-
If you change feedParser.py to add the line at the bottom of this it will work. in...
-
BBOS 6.3
-
deleteBBOSGame.py -h it accepts all the same commands bbos.py does. -y 2015 On Fri,...
-
You deleted the games after re-downloading? If you don't delete them BBOS will skip...
-
I was thinking about seeing how much could be converted to json. But my first worry...
-
no, I didn't archive it unfortunately. the data is still tehre for that first MLB...
-
Its my fault Don, sorry. You probably want to subscribe to the site news of site...
-
bug
-
I can tell you why that is, but not why that is. :) it has been that way since 2008....
-
I think you would go to Discussion->Help Forum->Create Topic. Does that not work?...
-
6.1 fixed some unicode errors in pitch descriptions which would prevent the pitch...
-
bbos 6.2
-
bbos has worked on the limited minor league data for a while now
-
minor league stats
-
Retrosheet
-
Retrosheet
-
retrosheet was added
-
create Help documentation
-
videos and better help text were done
-
the improved delete script mitigates this issue enough. as well as the fact that...
-
better determination for game load status
-
make leageu an paramater
-
this was completed in an earlier release
-
wrapper scripts for player bios
-
player bio script has existed for a while now
-
performance tests
-
what is in the codebase is sufficient
-
year deletion scripts
-
delete script was updated and accepts same parameters as lead script does. deleteBBOSGame.py...
-
I was not seeing those error in particular but I have just released anew BBOS with...
-
bbos 6.1
-
I think his question is getting lost. I don't use the retrosheet data at all so I...
-
you are right on that you have to specify a different unzip tool. You have to write...
-
InstallPythonLibs won't run at all? or it starts and then errors on a particular...
-
when you run that, it should print to the screen exactly what commands it is running...
-
IF your spider puts things into the same directory structure that bbos expects from...
-
I don't think it would break anything. I would think I should make that change to...
1 >
