anuga-user

[Anuga-user] ANUGA, Chennai, clouds and geonodes.

[David K. <dav...@hy...>]

Hi all,


I’m writing to get your opinion on a particular use-case for ANUGA.


We’re looking at making an open-source flood model available for our users
to run and build upon through our web application at
http://chennaifloodmanagement.org


Over the last couple of months I’ve been working with an NGO (CAG
<http://cag.org.in/>) in Chennai, India, to help them better manage the
analysis work they’ve been doing to manage the flooding and subsequent
social challenges that exist in Chennai.

To this end, we’ve built a web-application where we can effectively
crowd-source data from the numerous knowledge silos and combine it in a
transparent manner on the web. The app is a mixture of Geonode
<http://geonode.org/> and DjangoCMS <http://django-cms.org/>, which manage
the spatial data and reporting, respectively.


We’ve just soft-launched, and very quickly realised that the one
over-arching need for the project is accessible flood modelling and the
resultant mapping. We have teams on the ground ready to survey
infrastructure, validate results and constructively engage with government.
But to make their contribution valuable, we need a pathway & vision to
results. At the moment, this means flood maps.


One option I’m considering is to build an ANUGA model and front-end GUI
that we can run through our web application. This would enable the
government engineers from various (sometimes disconnected) groups to
compare and validate assumptions and results. Currently work done and
presented as a static PDF report is easily discounted or dismissed, and
hard to update.


Before we set off on this journey I thought I’d check in with you guys to
see

1.       If anyone you’re aware of, particularly at ANU or GA were heading
in this direction? I know some have in the past (TsuDAT, VIRHL are two that
come to mind, can anyone update me on these?)
2.       If technically this is a good idea or if there are challenges to
running ANUGA in a cloud-environment that I might be naive to?
3.       If there is anything in the ANUGA licencing or copyrights that may
present problems down the line?
4.    Are there other cities/projects that may be interested in
collaborating on such an endeavor?

Apologies for the long email & I look forward to whatever insights you all
might be able to share.


Regards

Dave

David Kennewell
Water Resources Engineer
Hydrata.com
Skype: davekennewell
+971 55 409 7378
dav...@hy...

Re: [Anuga-user] ANUGA, Chennai, clouds and geonodes.

[Stephen R. <u86...@ud...>]

Hi David,

Sounds like an interesting project. Happy to help.

Regarding your questions:

(1) I think Jane has dealt with that.

(2) There should not be any major problems running ANUGA on the cloud. 
Indeed our continuous integration process runs on travis.ci which is a 
cloud service. In addition a number of us have run ANUGA on the AWS. 
This was just on a single compute node. The one problem has been the 
output file. Recently a user ran a large problem on the AWS and produced 
a 50GB sww file. So the main problem was getting this file back to a 
local machine. The size of this file could be reduced markedly by only 
storing centroid values (not currently implemented for sww files, but 
could be done easily, by either adding this as an option on storing an 
sww file, or coming up with another format which only stores centroid 
values.). An alternative would be to process the output file on the cloud.

(3) The licence for ANUGA is GPL. Which might be a problem for 
commercial projects. It might be possible to provide a version with a 
different licence. Would have to talk to the GA people about this.

(4) One of our users has just had a project with the ACT government. 
Might be some interest there. We have a project looking at flooding in 
Jakarta. So there might be interest there too.  The people who are 
developing crayfish (on qgis) might be interested.

Cheers
Steve



On 26/06/16 18:15, David Kennewell wrote:
>
> Hi all,
>
>
> I’m writing to get your opinion on a particular use-case for ANUGA.
>
>
> We’re looking at making an open-source flood model available for our 
> users to run and build upon through our web application at 
> http://chennaifloodmanagement.org
>
>
> Over the last couple of months I’ve been working with an NGO (CAG 
> <http://cag.org.in/>) in Chennai, India, to help them better manage 
> the analysis work they’ve been doing to manage the flooding and 
> subsequent social challenges that exist in Chennai.
>
> To this end, we’ve built a web-application where we can effectively 
> crowd-source data from the numerous knowledge silos and combine it in 
> a transparent manner on the web. The app is a mixture of Geonode 
> <http://geonode.org/> and DjangoCMS <http://django-cms.org/>, which 
> manage the spatial data and reporting, respectively.
>
>
> We’ve just soft-launched, and very quickly realised that the one 
> over-arching need for the project is accessible flood modelling and 
> the resultant mapping. We have teams on the ground ready to survey 
> infrastructure, validate results and constructively engage with 
> government. But to make their contribution valuable, we need a pathway 
> & vision to results. At the moment, this means flood maps.
>
>
> One option I’m considering is to build an ANUGA model and front-end 
> GUI that we can run through our web application. This would enable the 
> government engineers from various (sometimes disconnected) groups to 
> compare and validate assumptions and results. Currently work done and 
> presented as a static PDF report is easily discounted or dismissed, 
> and hard to update.
>
>
> Before we set off on this journey I thought I’d check in with you guys 
> to see
>
> 1.If anyone you’re aware of, particularly at ANU or GA were heading in 
> this direction? I know some have in the past (TsuDAT, VIRHL are two 
> that come to mind, can anyone update me on these?)
> 2.If technically this is a good idea or if there are challenges to 
> running ANUGA in a cloud-environment that I might be naive to?
> 3.If there is anything in the ANUGA licencing or copyrights that may 
> present problems down the line?
> 4.    Are there other cities/projects that may be interested in 
> collaborating on such an endeavor?
>
> Apologies for the long email & I look forward to whatever insights you 
> all might be able to share.
>
>
> Regards
>
> Dave
>
>
> David Kennewell
> Water Resources Engineer
> Hydrata.com <http://Hydrata.com>
> Skype: davekennewell
> +971 55 409 7378
> dav...@hy... <mailto:dav...@hy...>
>
>
> ------------------------------------------------------------------------------
> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> present their vision of the future. This family event has something for
> everyone, including kids. Get more information and register today.
> http://sdm.link/attshape
>
>
> _______________________________________________
> Anuga-user mailing list
> Anu...@li...
> https://lists.sourceforge.net/lists/listinfo/anuga-user

-- 
======================================
Stephen Roberts
Undergraduate Convenor
Mathematical Sciences Institute
Room 2005 P.A.P. Moran Building #26B
The Australian National University
Canberra, ACT 2601
AUSTRALIA
Ph: +61 2 61254445
CRICOS: 00120C

Re: [Anuga-user] ANUGA, Chennai, clouds and geonodes.

[David K. <dav...@hy...>]

Thanks Jane & Stephen for the useful replies. I appreciate it.

Firstly, Jane - I'll setup the Skype call you suggested. If anyone else is
interested, let me know & I'll try and accommodate.

Stephen - regarding (2) - yes, an important point about the filesize.
Particularly when distributing data to areas where bandwidth is expensive
or limited. To make this exercise work I'd be looking to process the
results in the cloud and get them into geoserver where we can share them as
WMS or WFS layers. A couple of reasons for this - it preserves the "chain
of custody" and metadata that is so important any results we produce.
Without being able to clearly bind the input assumptions to the outputs, we
risk making pretty maps that are useless, or worse, misused. So I do need
to solve this one.

I know we can serve NetCDF from geoserver, but I haven't had much
experience with SWW, aside from using the wonderful crayfish plugin that
abstracted away my need to learn! :)  I'll keep the list up-to-date with
anything we develop.

Finally (4) - I'll let these teams reach out as they wish, but hint hint, I
do have my eyes on the InaSafe work when it comes to understanding impact &
mitigation.

cheers
Dave


David Kennewell
Water Resources Engineer
Hydrata.com
+971 55 409 7378
dav...@hy...


On Mon, Jun 27, 2016 at 4:33 AM, Stephen Roberts <u86...@ud...>
wrote:

>
>
> Hi David,
>
> Sounds like an interesting project. Happy to help.
>
> Regarding your questions:
>
> (1) I think Jane has dealt with that.
>
> (2) There should not be any major problems running ANUGA on the cloud.
> Indeed our continuous integration process runs on travis.ci which is a
> cloud service. In addition a number of us have run ANUGA on the AWS. This
> was just on a single compute node. The one problem has been the output
> file. Recently a user ran a large problem on the AWS and produced a 50GB
> sww file. So the main problem was getting this file back to a local
> machine. The size of this file could be reduced markedly by only storing
> centroid values (not currently implemented for sww files, but could be done
> easily, by either adding this as an option on storing an sww file, or
> coming up with another format which only stores centroid values.). An
> alternative would be to process the output file on the cloud.
>
> (3) The licence for ANUGA is GPL. Which might be a problem for commercial
> projects. It might be possible to provide a version with a different
> licence. Would have to talk to the GA people about this.
>
> (4) One of our users has just had a project with the ACT government. Might
> be some interest there. We have a project looking at flooding in Jakarta.
> So there might be interest there too.  The people who are developing
> crayfish (on qgis) might be interested.
>
> Cheers
> Steve
>
>
>
>
> On 26/06/16 18:15, David Kennewell wrote:
>
> Hi all,
>
>
> I’m writing to get your opinion on a particular use-case for ANUGA.
>
>
> We’re looking at making an open-source flood model available for our users
> to run and build upon through our web application at
> http://chennaifloodmanagement.org
>
>
> Over the last couple of months I’ve been working with an NGO (CAG
> <http://cag.org.in/>) in Chennai, India, to help them better manage the
> analysis work they’ve been doing to manage the flooding and subsequent
> social challenges that exist in Chennai.
>
> To this end, we’ve built a web-application where we can effectively
> crowd-source data from the numerous knowledge silos and combine it in a
> transparent manner on the web. The app is a mixture of Geonode
> <http://geonode.org/> and DjangoCMS <http://django-cms.org/>, which
> manage the spatial data and reporting, respectively.
>
>
> We’ve just soft-launched, and very quickly realised that the one
> over-arching need for the project is accessible flood modelling and the
> resultant mapping. We have teams on the ground ready to survey
> infrastructure, validate results and constructively engage with government.
> But to make their contribution valuable, we need a pathway & vision to
> results. At the moment, this means flood maps.
>
>
> One option I’m considering is to build an ANUGA model and front-end GUI
> that we can run through our web application. This would enable the
> government engineers from various (sometimes disconnected) groups to
> compare and validate assumptions and results. Currently work done and
> presented as a static PDF report is easily discounted or dismissed, and
> hard to update.
>
>
> Before we set off on this journey I thought I’d check in with you guys to
> see
>
> 1.       If anyone you’re aware of, particularly at ANU or GA were
> heading in this direction? I know some have in the past (TsuDAT, VIRHL are
> two that come to mind, can anyone update me on these?)
> 2.       If technically this is a good idea or if there are challenges to
> running ANUGA in a cloud-environment that I might be naive to?
> 3.       If there is anything in the ANUGA licencing or copyrights that
> may present problems down the line?
> 4.    Are there other cities/projects that may be interested in
> collaborating on such an endeavor?
>
> Apologies for the long email & I look forward to whatever insights you all
> might be able to share.
>
>
> Regards
>
> Dave
>
> David Kennewell
> Water Resources Engineer
> Hydrata.com
> Skype: davekennewell
> +971 55 409 7378
> dav...@hy...
>
>
>
> ------------------------------------------------------------------------------
> Attend Shape: An AT&T Tech Expo July 15-16. Meet us at AT&T Park in San
> Francisco, CA to explore cutting-edge tech and listen to tech luminaries
> present their vision of the future. This family event has something for
> everyone, including kids. Get more information and register today.http://sdm.link/attshape
>
>
>
> _______________________________________________
> Anuga-user mailing lis...@li...https://lists.sourceforge.net/lists/listinfo/anuga-user
>
>
> --
> ======================================
> Stephen Roberts
> Undergraduate Convenor
> Mathematical Sciences Institute
> Room 2005 P.A.P. Moran Building #26B
> The Australian National University
> Canberra, ACT 2601
> AUSTRALIA
> Ph: +61 2 61254445
> CRICOS: 00120C
>
>