It sounds good: the brand new series of gUSE is started. The first version of this series, the version 126.96.36.199 contains three significant improvements:
First change is the introduction of Liferay 6.2 as new framework system to WS-PGRADE portal. This change involves some improvements in the Liferay-based portlet administration of WS-PGRADE and a minor change in appearance of the WS-PGRADE portal. Therefore, the WS-PGRADE portal is nicer and easier to administrate as earlier.
Second, there is a change in the Data Avenue-specific job configuration of WS-PGRADE: you can add robot certificate to your input file definition when you select the input by the help of Data Avenue. Additionally, you can use the Data Avenue not only in input definition but in executable settings of WS-PGRADE.
Third main improvement: Apache Tomcat 7, a.k.a the latest Tomcat version became the new application server of gUSE.
• in Chap. III, IV, and VII in Admin Manual
• in Chap 20 and 21 in User Manual.
A new manual was developed by the WS-PGRADE/gUSE Team to help the cloud-specific administration of gUSE cloud access. This document summarizes the essential of gUSE concepts to cloud resource access and the necessary administration tasks. The Cloud-Specific Administration Guide is available in every release documentation from version 3.6.8 in gUSE SourceForge site (guse.sf.net)
The greatest thing in the new gUSE version is the job submission support to clouds which have EGI Federated Cloud-based endpoints.
As you probably know, EGI a.k.a. European Grid Infrastructure provides access to high-throughput computing resources across Europe using grid and cloud computing techniques. The Federated Cloud (FedCloud) infrastructure, developed by EGI, is a seamless grid of academic private clouds and virtualized resources, built around open standards and focusing on the requirements of the scientific community.
Currently, the accessibility of three EGI FedCloud endpoints is tested and guaranteed from gUSE: the LPDS, the BIFI, and the CESNET FedCloud endpoints.
From now, you can easily and quickly create and submit your jobs by gUSE to three different cloud infrastructures: to CloudBroker platform, to Amazon EC2 cloud, and to EGI FedCloud.
We have a great news: from version 3.6.7 the WS-PGRADE/gUSE system supports the well-known XSEDE grid resource. From now you can easily submit jobs to XSEDE resource too.
Another important change in the new gUSE release is the direct integration of Data Avenue tool into the job configuration of WS-PGRADE/gUSE. Thus, you can conveniently use the capabilities of Data Avenue for remote job input and output definitions. (Note: The use of the Data Avenue-based job I/O function is currently guaranteed for the application of three storage protocols (SFTP, GSIFTP, and S3) and for four middleware types (local, gLite, CloudBroker, and EC2). ... read more
The cloud access (the EC2-based cloud access to be exact) is much more comfortable to use than it was in the previous versions. Additionally, you can simultaneously use several different clouds from the same portal. For example, Amazon and a private academic cloud can be used at the same time and the administrators don't need to install additional Euca2ools software to prepare master DCI Bridge.
More details can be found:
- in chapter 18 within Menu-Oriented Online Help of Portal User Manual
- in section 5.19 within DCI Bridge Manual
- in chapter VI within Admin Manual.
The most important change in gUSE 3.6.4 is to support the job submission by the so called SHIWA Submission Service.
The name SHIWA (SHaring Interoperable Workflows for large-scale scientific simulations on Available DCIs) comes from the FP7 SHIWA project that addresses the challenges of the coarse- and fine-grained workflow interoperability. The project created the SHIWA Simulation Platform that enables users to create and run embedded workflows which incorporate workflows of different workflow systems. The platform consists of the SHIWA Science Gateway and the SHIWA VO.
In the new development, the web service based SHIWA Submission Service replaces the old GT4-based GEMLCA Service and enables execution of different workflows from different communities developed in different workflow engines. Therefore you can use various workflows from various communities developed in various engines. All of these workflows are stored in a central workflow repository (called SHIWA Workflow Repository). These stored workflows you can explore by more tools: among others the WS-PGRADE offers for workflow browsing a runtime built-in look up tool, the SHIWA Explorer.
Having the SHIWA Submission Service, you can execute non-native workflows in a more reliable and secure way than with the GEMLCA Service.
- Portal User Manual, chapter 8 within Main part and chapter 23 within the Menu-Oriented Online Help
- Admin Manual, chapter VIII
- DCI Bridge Manual, chapter 2.10
Thanks to the latest release of gUSE/WS-PGRADE, from now you can send your applications to run on cloud resources.
The gUSE/WS-PGRADE v3.6.2 provides you a new solution to directly access the clouds without brokering. You can also run your jobs on cloud resources by only using a valid user name and password to the corresponding cloud service.
Behind the scenes, the direct cloud access solution is based on the job submitter DCI Bridge distribution (the capability of job forwarding from master to slave DCI Bridge): the master DCI Bridge – that directly connected to gUSE – forwards the jobs through the Amazon EC2-based frontend service to the slave DCI Bridge – located in the cloud. Technically, the master DCI Bridge started - by the EC2-based service – a Virtual Machine that was created from an earlier saved image, containing the properly configured slave DCI Bridge. ... read more
Do you want to directly influence and change your workflow’s submission process and result? Well, the recently released gUSE 3.6.1 gives you an appropriate solution.
If you want to interact with your workflows in runtime for tracing and debugging, you can use breakpoints. You can configure breakpoints to jobs in the WS-PGRADE within the main job configuration process and then during in the job submission process you can enable or prohibit the running of job instances at these breakpoints. ... read more
If you have ever wished that you could avoid using a command line tool to connect to your storage and would like to do it through a user-friendly interface or you need to transfer data between remote storages that use different protocols, then you should learn about Data Avenue.
We are glad to inform you that it is already available to try out! Also, in a new gUSE/WS-PGRADE version (v3.6.0) - that will be released shortly, about at the end of September or at the beginning of October - the Data Avenue portlet will be included. The new Data Avenue portlet will be connected to the so-called Data Avenue Blacktop core service that provides unified access to different types of storages. If you update your science gateway to this version, you will be able to use the Data Avenue through your usual user interface.... read more
What kind of information can a user get who meets gUSE at the very first time? Where can you find answer for your essential question: What is this?
The ’gUSE in a Nutshell’ document was written to satisfy this basic user demand. It provides a big picture about gUSE and a quick overview that explains the ultimate gUSE capabilities and shows a basic architectural view. Additionally, this document introduces the workflow concept and the customization modes of gUSE. At the end of the overview you can find some interesting data about gUSE and a glossary for simple explanation of the most important terms. ... read more
The major improvement in version 3.5.8 is not something you would notice at first sight. However, when you start using the system, you will notice the change immediately! The internal system performance optimization for job execution makes everything faster and smoother. This internal reorganization of exchanging information between WS-PGRADE and the various gUSE components significantly increases the performance of WS-PGRADE portal.... read more
The recently released gUSE/WS-PGRADE portal version 3.5.7’s main feature is the optimization of the statistics function to speed up the loading and to relive the database and the portal in overall.
Since version 3.4.1 gUSE/WS-PGRADE portals are capable to provide a very useful functionality for the users: the collection and visualization of usage statistics or shortly the statistics function. This function is responsible for collecting and storing metrics in the database and for the display of these metrics. The statistics function allows viewing metrics in four tabs – portal, DCI, user, and workflow –, on seven levels – portal, user, DCI, resource, concrete workflow, workflow instance and abstract job. This is accomplished by allowing users to navigate to different pages to see the level of statistics they want. This solution is helpful for administrator in resource settings (mainly from portal and DCI statistics) for users in middleware, resource selecting and in job execution time estimation (mainly from user and workflow statistics).... read more
Using workflows is a common point between scientists these days. However many workflow systems exist and communities develop their workflows using one of these workflow engines. Developing, testing and validating these workflows can be a very time consuming process and specific expertise is required. Reusing and sharing workflows can solve this problem.
Workflows developed for one workflow system is normally not compatible with workflows of other workflow systems. If two user communities that has similar research areas but use different workflow systems want to collaborate, they have to create the workflows from scratch to transform them to the desired workflow languages. This situation was resolved by the SHIWA project that developed the SHIWA technology to solve the workflow interoperability issue. Thanks to this new technology, publicly available workflows can be used by different research communities on different workflow systems and on multiple distributed computing infrastructures.... read more
We are glad to announce that a new document is prepared for users, administrators and for developers to guide them among the different documents of gUSE. We received several feedback about our documentation system and decided to act on them. We separated the documents that are prepared for different user types and introduced a new colourful system to easily make them perceptible.
The new guide, called 'Documentation Map' introduces the whole gUSE documentation family organized according to the target audience:
- The green series - Manuals for administrators and operators
- The red series - Manuals for portal developers
- The blue series - Manuals for portal users
- The generic (orange) series - General documents and licences for everyone... read more
We are glad to announce that the version 3.5.6 of gUSE/WS-PGRADE has been released.
The main improvement in this version is the development in WS-PGRADE workflow export/import to/from Remote SHIWA Repository. From this version you can share your workflow to SHIWA project community in WS-PGRADE format and in SHIWA IWIR format as well (the latter solution is useful if you want to use your workflow by other workflow management systems than WS-PGRADE. However, for successful sharing, before in IWIR format export – unlike in WS-PGRADE format - your workflow can fit some rigorous preliminary conditions. For details see chapter 11 in Menu-Oriented Online Help of latest Portal User Manual.). Therefore the shared workflows can be imported from remote repository to WS-PGRADE portal environment in well-known WS-PGRADE implementation format or in IWIR format. (For details see chapter 7 and 11 in Menu-Oriented Online Help of latest Portal User Manual.)... read more
The Summer School on Grid and Cloud Workflows and Gateways will be held in Budapest, 1-6 July 2013 at SZTAKI Laboratory of Parallel and Distributed Systems.
The main goal of Summer School is to give answers about how to exploit grid and cloud infrastructures in Europe, how to port and develop application for these infrastructures and how to extend their user communities. The Summer School offers a good opportunity to promote best practice examples for potential application developers and users of e-science infrastructures.... read more
We are glad to announce that the version 3.5.5 of gUSE/WS-PGRADE has been released.
From this version users with corresponding rights can create robot permission association for every supported resource type in gUSE/WS-PGRADE to identify trusted applications. Therefore, any users can easily submit workflows identified by robot permission without dealing with any authentication data. (For details see Portal_User_Manual_v3.5.5.pdf as well as the Administrator Manual documentation).... read more
Registration is open for the Summer School on Grid and Cloud Workflows and Gateways that will be held at Budapest, 1-6 July 2013. Everyone is welcome to join!
The gUSE/WS-PGRADE team created a questionnaire to know more about the gUSE user satisfaction.
The gUSE team would like to ask users to fill out the following questionnaire to help improve the connection between users and developers and to help improve the gUSE user support in SourceForge.
The questionnaire takes about 3-5 minutes and can be found here: https://docs.google.com/spreadsheet/viewform?formkey=dHRjVEZuYllURV9RUFVRdTdPbWdtamc6MQ#gid=0 ... read more
We are glad to announce that the new version 3.5.2 of gUSE has been released. From this version gUSE/WS-PGRADE supports the workflow export/import to/from SHIWA project Workflow Repository where you can share workflows of different workflow systems. The details and the exact conditions of sharing workflows you can see in the Portal User Manual v3.5.2 (http://sourceforge.net/projects/guse/files/3.5.2/Documentation/Portal_User_Manual_v3.5.2.pdf/download), in the section Portlet-Oriented Online Help, in chapter 7 and chapter 11. (You can find the concerned functions in WS-PGRADE portal under menus Workflow/Import and Workflow/Concrete/Export.)... read more
The gUSE/WS-PGRADE is the most visited workflow system as per statistics of EGI (European Grid Infrastructure) Application Database, that stores information about tailor-made computing tools for scientists.
This popular system of LPDS, MTA SZTAKI is in the seventh place among all (about 450) softwares, which can be used on the European Grid Infrastructure and other European Distributed Computing Infrastructures (DCI).... read more
The Computer and Automation Research Institute, Hungarian Academy of Sciences (MTA SZTAKI), the CloudBroker GmbH, and the SCIentific gateway Based User Support (SCI-BUS) project are happy to announce the first release of the grid User Support Environment (gUSE) providing access to cloud infrastructures by incorporating an interface to the CloudBroker Platform.
The gUSE is the first one that incorporates major results of the collaboration of MTA SZTAKI and CloudBroker GmbH within the SCI-BUS project. The following corresponding features are available in gUSE now:... read more
MTA SZTAKI is happy to announce a new tool that eases the installation of
WS-PGRADE/gUSE: gUSE Installation Wizard
The tool offers the following installation scenarios:
- local: all gUSE and WS-PGRADE (along with Liferay) services are deployed
on one machine,
- distributed: frontend (WS-PGRADE, Liferay) and backend (DCI Bridge, WFI,
WFS, ...) service sets are deployed on two different machines.... read more
SZTAKI is glad to announce the new release of gUSE, version 3.3 that comes together with the Liferay-based WS-PGRADE portal. gUSE is a set of high-level grid services (including workflow manager, storage, broker, grid-submitters for various types of grids, etc. services). It also includes a graphical portal service based on Liferay technology.
Since now gUSE is available on Sourceforge !