yup.
Do you have Facebook or anything? Maybe I can try to reach out to you and see what's going on!
I'd have to see if I have it in a virtual machine.. Try one of these though: gfe-1.12.0.tar.xz gfe-1.11.0.tar.xz They are much older, but I mean you never know lol. Try them and play around with it :)
I remember back the last time I used it.. I had to use Practice, and used the publish to get the products to want to generate. Wayyyy back in the day before this GFE, in Practice the GHG monitor worked. If I could code it, I'd love to have the database save on my website to product products.. well at the very least the ZFP, grid images, and maybe the AFD. I remembered how at one time, I edited the files to get rid of the NWS wording haha.
Personal question... You good with forecasting? If so... check out my website... www.usawx.org :) We hire volunteers and would love to have you!!!
The publish is blurred out??? wow!! Might have to write a support ticket on this site for it.
I can't remember what menu it's under... if it's Grids or Products.. It's been ages lol.
PS... I run a weather website. We don't use GFE, but we have an interface we built that we forecast the weather. Check this out.. www.usawx.org
I forgot one step! Gotta publish to official lol. Also make sure you are in practice mode :) Then the products will do a "transmit". Then when you take counties out, it'll show cancelled for and remains valid for.
I'd love GFE to be able transfer grids via ftp to a website, or a product. That would be pretty cool. I'd love to create forecasts in GFE.
You have to click the hazard you want to issue under Hazards, then click the counties you want to include. Save the grids and forecast, then launch the format launcher :)
I'll update GFE, and see what's going on. I even tried to generate a Heat Advisory and it never showed up in GHG, which was weird haha! On Wed, Jul 17, 2019 at 1:45 PM Mike Romberg romberg@users.sourceforge.net wrote: The GHG monitor appears to be working (I'm not an expert in using it). There was a problem withthe VTEC decoder caused by python3 changing the way subpackages import. I fixed that along with the other problem. After those fixes I was able to create a SV.A:1 area in the hazard grid....
I will see if I can take a look into that. What about the GHG Monitor? Products actually tansmit into the active table, but they won't show in GHG. I'd love to also work with the ifp image stuff as more since I'm learning how to create different grid images :) It's amazing how the models come in! I'd love to see the HRRR/RAP/RUC as an option down the pipe for more short term grids :) On Tue, Jul 16, 2019 at 2:38 PM Michael Foland mfoland114@gmail.com wrote: On Tue, Jul 16, 2019 at 2:32 PM Mike Romberg...
On Tue, Jul 16, 2019 at 2:32 PM Mike Romberg romberg@users.sourceforge.net wrote: Try the convective watch again using what is checked into the master branch. I found and fixed a bug that was created when the code was updated for c++14. After fixing it, I was able to run the formatter and generate a convective product. [tickets:#23] https://sourceforge.net/p/gfed/tickets/23/ Make Hazards not working* Status: open Milestone: 1.0 Labels: Hazards Created: Wed Jul 10, 2019 03:35 AM UTC by Michael Foland...
other products work and generate but convective is a no go. also hazards show in the active table but socnot show in GHG monitor.
Make Hazards not working
Any updates to GHG Monitor? In the new version the GHG monitor does not work with showing the products nor counties in said product... Not sure what's going on there.
How to make a script for batch PNG Images and FTPing Images to website
Upon trying to compile several times, I've switched to a older version of Fedora. Will be playing around with it
What if you went here and wrote a support ticket: http://nomads.ncep.noaa.gov:9090/
How do we even get it to injest the RAP or even pull stuff out of a model run like CAPE, etc? I'm not sure how we edit the template file.
Also as far as the vtec table name... should somehow be official or something... since the Practice table works only in Practice mode... I was researching this. When we click Operational I'm assuming that would be the table it relies on as well then? However, GHG does not work in practice either
The BoundedArea worked... Try setting some custom points and for the sake of my script if you use it.. name them FcstPoints and make a WX Grid then go to PNG Images under scripts then type in WX_IFPImage You will see it has the default and custom points.
Also I only want it to show my custom IFC Samples, but it shows the defaults as well.. Not sure how to fix that.
Play with this code: I couldn't get the stuff to show right.. For No Wx it would show Frzng Drzl lol... Starting at Line 62 is and down is what I've been working on. As you can see I only got up to sleet, because there are so many options lol. Things don't show like they should... Severe even shows as just Tstorms when in Pretty Wx I have T+ defined at severe. You can make that a config file in GFE and play around with it :)
When the old version of GFE worked, you could create a Severe or Tornado Watch in either mode with an ETN number... You could only transmit in Practice though. Would be nice for that part to transmit locally and go into the active table. I'd still use these as my own without nws wording maybe for a more personal forecast. I do grid forecasting as this works in official mode. You have to Save the grid and publish to official to make the png image work
I also want to remove the default wx conditions that show up on the map, and only show them where I place my own ISC points. I've looked over both my gfeConfig and my WX_IFPImage scripts. My WX_IFPImage is the custom script I'm making for the WX and it will have all the available conditions! The conditions are also in the PrettyWx label!
IFP Image WX Grid Image Question
ALSO -- I know how to edit the alert templates so they don't say National Weather Service ;) I learned on the much older version of GFE that was located at gfesuite.noaa.gov ;)
GHG Monitor Issues / Issuing Hazards
Please close this. I fixed it. There was something wrong with the prefix in the makefile. I fixed it to my home where I'm installing instead of /usr/var ;)
It should be noted in past the way I'm installing this HAS worked.
Install from git issues
I likely would post the zone forecast on my personal site since I do make forecasts and know how to
I enjoyed it actually saying transmit. try taking the test vtec line out if marked test it should show those. might have todeal with that. the map really should also look at the zones from the product somehow
Why is the transmit only working in PRACTICE? What if we generate our grids in operational or "simulate" transmit to the local ifps... since it won't go out anywhere public? I just noticed you were working on that!
Those are the MND headers. I found another example to show the meanings for you. https://www.weather.gov/media/pah/WeatherEducation/3-wxproducts.pdf
Pulled this from an example: WWUS42 KFFC 051936 WSWFFC Linked here: https://www.weather.gov/ffc/exampleWSWwarning The top lines there even the WSW(OFFICE) are the AFOS lines for the product! Try even a high wind watch or something. In the Product Formatter, that's under Non precipitation :) The 051936 is the issued time in zulu
Pulled this from an example: WWUS42 KFFC 051936 WSWFFC Linked here: https://www.weather.gov/ffc/exampleWSWwarning The top lines there even the WSW(OFFICE) are the AFOS lines for the product! Try even a high wind watch or something. In the Product Formatter, that's under Non precipitation :)
From the get go even in operational mode, I was able to transmit something like that, it's just something in the ghg table not making it show. It said it couldn't find the default config file or something.
For Blizzard Watch which is BZ.A it would be the Winter Message in the Product Formatter :) The GHG table might reference a database.... That might be the key.
"rap.t00z.awip32f01.grib2 " Taking a look there we see rap.t (time) 00z , so using the script I edited, it would generate 00 06 12 15 etc. Not sure what the 32 is for awip.. howerver f01 is the frame number. It appears the rap has 21 frames. I wonder if you can have it look for anything associating for awip* and have it grab the .grib2 extention :)
Adding New Models
The version says: netcdf library version 4.4.1.1 of Aug 4 2017 03:49:07 Also I found where you ingest the models, and I was looking at them to see if I could specify and add the RAP, RTMA, etc :) I think you should make a gui or something for different options :)
It would appear that gfei script is not telling the IFPServer that the data is in. When I restart IFP, it shows just local data... and grids manually created, and does not bring in the models.
GFEI Errors / Importing NAM or GFS into GFE
Importing python config files to GFE
While the ifp.ingest is a nice idea... the script wants to pull in the models and dgribs them... and continues to check... when it completes it shows up in GFE, HOWEVER it does not show in the grids. Is this a GFE issue? I did try the rm -rf to the cd directory as well.
For [71718f] brute force permissions on all installed files. Made the permission problems go away! So glad it worked :)
I had to do a snapshot of the code. Doing git was giving me an error which is above in the ticket On Wed, May 2, 2018, 9:56 PM Mike Romberg romberg@users.sourceforge.net wrote: Sorry. I was not as clear as I should have been. You should change directory to the place where the gfe source code is. The one you cloned with git. That is the directory where you type 'make' and 'make install'. See what 'git config core.filemode' says when in that directory. [tickets:#10] https://sourceforge.net/p/gfed/tickets/10/...
I've tried cd /home/gfe/gfe (where the original files are) and the command.. no response. Tried with gfe/gfeInstall (where sbin bin etc to run gfe is), and no response.
The free models out there are the HRRR, RAP, NAM, and GFS.
I was able to use the documentation to get the grids to actually generate an image... However, I cannot for the life of me get the temperatures to also show as text for points... and not all the cities are showing like they should be. Is there a new city database out there or something? See my attatched image.
I believe on that image it is topo and not maxT. Not sure why it didn't generate the MaxT grid. On Tue, May 1, 2018, 2:57 AM Michael Foland mfoland@users.sourceforge.net wrote: I did a fresh install, and when I go to run ifpImage... I get this after the command runs, when I look in the Process Monitor: PngWriter.py 593 EVENT: ifpIMAGE Starting PngWriter.py 596 EVENT: Build Date: Tue May 1 05:49:48 2018 Built By: gfe Built On: localhost.localdomain (linux) Version: 1.10.0 May/01/2018 Config.C 213...
I did a fresh install, and when I go to run ifpImage... I get this after the command runs, when I look in the Process Monitor: PngWriter.py 593 EVENT: ifpIMAGE Starting PngWriter.py 596 EVENT: Build Date: Tue May 1 05:49:48 2018 Built By: gfe Built On: localhost.localdomain (linux) Version: 1.10.0 May/01/2018 Config.C 213 EVENT: loading module testIFPImage... DBSubsystem.C 190 EVENT: Version: 1.10.0 May/01/2018 Server Host: localhost Port: 8044 Username: SITE PngWriter.py 40 EVENT: Configuration...
I did a fresh install, and when I go to run ifpImage... I get this after the command runs, when I look in the Process Monitor: PngWriter.py 593 EVENT: ifpIMAGE Starting PngWriter.py 596 EVENT: Build Date: Tue May 1 05:49:48 2018 Built By: gfe Built On: localhost.localdomain (linux) Version: 1.10.0 May/01/2018 Config.C 213 EVENT: loading module testIFPImage... DBSubsystem.C 190 EVENT: Version: 1.10.0 May/01/2018 Server Host: localhost Port: 8044 Username: SITE PngWriter.py 40 EVENT: Configuration...
IfpServer Permission Errors
Getting this when I use the git link [gfe@localhost Desktop]$ git clone git://git.code.sf.net/p/gfed/code gfed-code Cloning into 'gfed-code'... remote: Counting objects: 22756, done. fatal: The remote end hung up unexpectedly fatal: early EOF fatal: index-pack failed [gfe@localhost Desktop]$ git clone git://git.code.sf.net/p/gfed/code gfed-code
Over my grids can I also output city names? I'd like to show one weather element at a time... whereas in some of the grids, multiple elements show.
I took a snapshot since the git command would not want to connect to the site for whatever reason. I think it was like connection refused or couldn't get something like that.. before the install my umask was 022. On Mon, Apr 30, 2018, 8:11 PM Mike Romberg romberg@users.sourceforge.net wrote: Hmm... The permissions of FWFTable.py in the git repository are 644 (rw-r--r--). But the one you checked out with git has them at 664 (rw-rw-r--). The install script copies many files straight over to the install...
Only things in warngen are flash flood warning flood warning tornado warn severe tstorm warning. The tornado watch and severe comes in through GFE or allows the office to set a segment number for testing... but that part doesn't work. On Mon, Apr 30, 2018, 8:04 PM Mike Romberg romberg@users.sourceforge.net wrote: I never was an expert on the whole waring generation end of things. But aren't these types the domain of warngen? The configuration of the Hazard weather type is in the ifpServer configuration...
I'd love to see the grids fill like how they do on the nws.. it also looks like ifpImage is going to a test db. Im not sure how to get it set to Fcst and official On Mon, Apr 30, 2018, 8:00 PM Mike Romberg romberg@users.sourceforge.net wrote: As you have discovered, you can't use 'gfeConfig' as a configuration file for the ifp.Image program. I have no idea why it was ever set as the default. I changed the default one to 'testIFPImage' which does work. I've also fixed some of the code which broke...
I think that comes with fixing a database because I can transmit and it saves the product to the product folder. :) On Mon, Apr 30, 2018, 7:49 PM Mike Romberg romberg@users.sourceforge.net wrote: The whole GHG monitor thing (and other bits that use theVTEC active table) may be broken for a while. Much of that code depends upon products being stored in the AWIPS text database. That won't work now for obvoius reasons. There is no way (and won't be) to actually transmit any products. So, the hooks that...
Got the PngImage to work... however after making config edits.. it doesn't want to either save them or something.. It gives me a black background, and doesn't show it like it should on like a white map, with gray counties, and the actual grid stuff with the values. Second problem, I created a WX Grid, and it didn't even send that to PNG. I attatched the image issue that has the MaxT.
When I first ran the script, it said /home/gfe/gfeInstall/var/gfe/bin/gfei didn't exist.. which /home/gfe/gfeInstall does exist. I created the gfe and bin folder respectively, and I copied the gfei file in there. The script WORKED... However it said I had some Png_Params missing, even though I had things defined in the gfeConfig script. See the attached.
In this file: https://sourceforge.net/p/gfed/code/ci/master/tree/data/textFiles/GFECONFIG/gfeConfig.GFECONFIG Change the SITE in the # Product Generation Scripts appear under the product generation menu on the GFE. Scripts = [ "Png Images...:" + "{home}/bin/gfei -m ifp.Image -u SITE -h {host} -p {port} " +\ "-c {entry:ConfigFile:testIFPImage} " +\ "-o {prddir}/IMAGE", "Ascii Grids...: " + "{home}/bin/gfei -m ifp.AG -h {host} -r {port} " +\ "-o {prddir}/AG/{ztime}.ag " +\ "-d {productDB} ", "MakeD2DFile:...
Inside the Make Hazards, when you try to create a Convective Product, whether Tornado or Severe Thunderstorm, it doesn't save the grid. I was looking at the file that was edited for the IfpImage, and found this: Hazards_commonValues = [ \ "Watches|Fire Weather|FW.A", "Watches|Hydrology|FF.A", "Watches|Hydrology|FA.A", "Watches|Coastal Flooding|CF.A", "Watches|Coastal Flooding|LS.A", "Watches|Non-Precipitation|EH.A", "Watches|Non-Precipitation|FZ.A", "Watches|Non-Precipitation|HW.A", "Watches|Non-Precipitation|EC.A",...
The models aren't populating all the way, and we are not getting the full model suite. The GFS is also pulling in things wrong (see attatched photo), and would appear to possibly be corrupted.
GHG Monitor not working
IfpImage Not creating graphics
On FWFTable.py inside /home/gfe/gfeInstall/var/gfe/data/textInstall/TextProduct_BASE I guset -rw-rw-r--. gfe gfe 75465 Again, we got the download using the git not the tarball. Inside the GFE, we are still getting permission errors.
On FWFTable.py inside /home/gfe/gfeInstall/var/gfe/data/textInstall/TextProduct_BASE I guset -rw-rw-r--. gfe gfe 75465 Again, we got the download using the git not the tarball.
When I ran umask it shows "0022" I ended up deleting GFE after I decided to get the updated changes you made today. I'll let you know if we are successful.
We are using Fedora 27 with KDE Desktop. When I get back home I'll try these commands and will reply :) On Sat, Apr 28, 2018, 2:55 PM Mike Romberg romberg@users.sourceforge.net wrote: OK. I'm 99% sure that the gfe build/install process is makeing the assumption that a users umask is set to 022. And I think the distro of linux you are using sets the users umask to 002. Normally 022 disables the write bit for world and group and 002 disables the write bit for just world. Normally you don't want anyone...
I should also note we downloaded it from the git. On Sat, Apr 28, 2018, 3:04 PM Michael Foland mfoland114@gmail.com wrote: We are using Fedora 27 with KDE Desktop. When I get back home I'll try these commands and will reply :) On Sat, Apr 28, 2018, 2:55 PM Mike Romberg romberg@users.sourceforge.net wrote: OK. I'm 99% sure that the gfe build/install process is makeing the assumption that a users umask is set to 022. And I think the distro of linux you are using sets the users umask to 002. Normally...
Yep I will separate these this evening On Sat, Apr 28, 2018, 3:10 PM Mike Romberg romberg@users.sourceforge.net wrote: Thanks for pointing out those bugs! Like I mentioned, I've never really been all that competant in setting up and running the text formatters. So, it is mostly the ZFP which I run and test. I'm sure there are issues with the others. I've just checked in a fix which broke the NOW and HWO formatters. They now ran for me and produced something. If it would not be too much bother, could...
Update on the gfei.. Getting some errors concerning NetCDF close: /scratch/data/cdf/gfs/230/20180428_0000 Traceback (most recent call last): File "libs/pylib/tasks/threadpool.py", line 21, in run File "libs/pylib/tasks/threadpool.py", line 15, in runTask File "libs/pylib/tasks/pipeline.py", line 135, in processStage File "libs/pylib/ifp/ingest/nomads.py", line 283, in put File "libs/pylib/ifp/ingest/nomads.py", line 312, in storeTopo File "netCDF4/_netCDF4.pyx", line 2293, in netCDF4._netCDF4.Dataset.createVariable...
NOW and HWO under Hazards in the Product Formatter do not work.. Wondering if this is something in Python? You can select the counties you want included, and that works... but when you click run formatter (the gear)it's a no go.
When loading the gfei script, it goes to dgrib and sometimes it will show up in GFE, and has pulled up data into the grids in the past. Now running the script, whether it be the NAM or the GFS... it will not pull into the GFE grids. Not sure what's going on here.
Here is the error GHG Monitor puts out in terminal when I am doing a tail of it. GHGMonitor.py 1580 EVENT: ghgMonitor Starting GHGMonitor.py 1583 EVENT: Build Date: Sat Apr 28 03:45:51 2018 Built By: gfe Built On: localhost.localdomain (linux) Version: 1.10.0 April/27/2018 ['-h', 'localhost', '-p', '8044', '-t', 'active', '-u', 'gfe'] Exception in Tkinter callback Traceback (most recent call last): File "/usr/lib/python3.6/tkinter/init.py", line 1702, in call return self.func(*args) File "gfe/ui/GHGMonitor.py",...
Doing product testing.. Convective doesn't work.. Still playing around with different products.
A - PNG Images (IfpImage): I went to create a grid as simple as issuing a Winter Storm Watch as a test... and I went into Png Images, and it doesn't define the site... it just says SITE in {home}/bin/gfei -m ifp.Image -u SITE -h localhost -p 8044 -c gfeConfig -o {prddir}/IMAGE and says no such file or directory. B - GHG Monitor. The Transmission part of products are working.. I only tried a Winter Storm Watch so far LOL! However, the GHG Monitor under Products is not working. It says "No Saved configuration...
Still getting some errors: Hourly Statistics dump ended IFPDaemon.C 694 PROBLEM: Bad permissions on File [/home/gfe/gfeInstall/var/gfe/data/databases/BASE/TEXT/TextUtility/AFD_FPPAH_FPDefinition.TextUtility] permissions are 664 should be 644 IFPDaemon.C 694 PROBLEM: Bad permissions on File [/home/gfe/gfeInstall/var/gfe/data/databases/BASE/TEXT/TextUtility/CCF_FPCR_FPOverrides.TextUtility] permissions are 664 should be 644 IFPDaemon.C 694 PROBLEM: Bad permissions on File [/home/gfe/gfeInstall/var/gfe/data/databases/BASE/TEXT/TextUtility/ZFP_FPCR_FPOverrides.TextUtility]...
Alot of the products to make lie in the "Make Hazard" tool. The HWO, SPS, Now (Short Term Forecast), etc all lie in the product formatter tool.
Could there be an option for a cron job to fetch at every model run?
Here is what it shows after everything is running in IFPServer: IFPDaemon.C 692 PROBLEM: Bad permissions on File [/scratch/gfe/var/gfe/data/databases/BASE/TEXT/COMBINATIONS/Combinations_FPFWFTable_FPPAH.COMBINATIONS] permissions are 664 should be 644 IFPDaemon.C 692 PROBLEM: Bad permissions on File [/scratch/gfe/var/gfe/data/databases/BASE/TEXT/COMBINATIONS/Combinations_FPZFP_FPPAH.COMBINATIONS] permissions are 664 should be 644 IFPDaemon.C 692 PROBLEM: Bad permissions on File [/scratch/gfe/var/gfe/data/databases/BASE/TEXT/COMBINATIONS/EditAreas_FPPublicMarine_FPPAH.COMBINATIONS]...
The errors are still popping up in GFE, even after I try a manual command in shell to change the permissions to the required permissions. I went to do a tail of the ifpServer by running sh /scratch/gfe/sbin/fipServer -t and I get the following when it's running after starting up: IFPDaemon.C 74 EVENT: ==== IFP Data Server Starting ==== IFPDaemon.C 75 EVENT: Version: Version: 1.10.0 April/26/2018 Build date: Thu Apr 26 19:51:33 2018, by: gfe, on: localhost.localdomain (linux) IFPDaemon.C 366 EVENT:...
The errors are still popping up in GFE, even after I try a manual command in shell to change the permissions to the required permissions. I went to do a tail of the ifpServer by running sh /scratch/gfe/sbin/fipServer -t and I get the following when it's running after starting up: IFPDaemon.C 74 EVENT: ==== IFP Data Server Starting ==== IFPDaemon.C 75 EVENT: Version: Version: 1.10.0 April/26/2018 Build date: Thu Apr 26 19:51:33 2018, by: gfe, on: localhost.localdomain (linux) IFPDaemon.C 366 EVENT:...
Tried to do the SPS and NOW products and the run formatter will not work. Not sure what's wrong with those products either.
Tried the AFD Product in GFE, and got the error that is attatched. I'm assuming it might be the same with the other products. ZFP does work however.
I see the code is being edited, and in the possible options for the make hazards menu it is missing "Make Hazard"
Ran the make links > make install -j 4 > umask 022 > make install /scratch/gfe and still getting the permissions within textProduct, etc.. Not sure what all is going on and why still getting these errros.
Hey I got this fixed for you. It took some time once the script was running. It fetches the latest model data :) Would be nice to set this to a cron somehow for when the new models do come out.. and have more data like ECMWF and the HRRR
Hey I got this fixed for you. It took some time once the script was running. It fetches the latest model data :)
Make Hazards and IFPImage not working
Permission Erros inside GFE