fez-developers — Fez Developers mailing list

[Fez-developers] Performance issues in espace

[Aaron B. <a....@li...>]

Hi All,

Recently we found that some xml files in eSpace were getting quite large on the fedora object side and may have been causing performance issues. This was from version controlling datastreams that perhaps didn't need it (PremisEvent)

Our files blew out to 800 meg but a command like the below will find anything over 100 meg.

find /fez/data/fedora_objects -type f -size +100M -exec ls -lh {} \; | awk '{ print $NF ": " $5 }'

We have also experiences issues with Fedora 3.8 and had to upgrade to 3.8.1 due to this issue https://jira.duraspace.org/browse/FCREPO-1298. There are also other small code changes needed should you go down this path https://github.com/uqlibrary/fez/commit/ff8775437f054a4a4bd7776d9b97cf3181c77f94

Thanks

Aaron Brown

Senior Web Developer
Information Systems and Resource Services, Level 2, Biological Sciences Library, St Lucia,The University of Queensland, Australia QLD 4072
a....@li...<mailto:a....@li...> +61 7 334 64341
CRICOS Code 00025B Feel free to print this email. This email (including any attached files) is intended solely for the addressee and may contain confidential information of The University of Queensland. If you are not the addressee, you are notified that any transmission, distribution, printing or photocopying of this email is prohibited. If you have received this email in error, please delete and notify me. Unless explicitly stated, the opinions expressed in this email do not represent the official position of The University of Queensland.

[Fez-developers] Fez and Cross Site Scripting Vulnerability

[Keith <ke...@ke...>]

Hello Fez Developers,
I'm running a modified version of the Fez package that is available on 
SourceForge. Are the developers aware of the potential for cross-site 
scripting attacks in that package and if so has it been patched in any of 
the later SVN versions? 

I tested this logged in as both an admin user and as a normal user. In the 
field for a record title, I wrote a simple alert box and also a piece of 
code to redirect the user to a different site. Both worked successfully. 
There were no tricks in the way I wrote the open script tags. Just plain 
HTML/JScript. 

Kind regards,
Keith

Re: [Fez-developers] Excel and CSV

[Lachlan K. <l....@uq...>]

Hi Dr Keitch,

ŒExport to Excel¹ currently exists in trunk; it has superseded the old
ŒExport to CSV¹ option. I¹d suggest upgrading to trunk.

If you wanted to merge the functionality in manually, the pertinent code
seems to be in revisions 1973, 2109, 2111, 2236, and 3376.

Hope this is of some use.

Regards,
Lachlan
 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lachlan Kuhn
Senior Web Developer
Library Technology Service
The University of Queensland, Australia QLD 4072
Telephone : (+61) (7) 3346 4349
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~


On 21/10/10 10:45 PM, "bkeitch" <bk...@ph...> wrote:

> Dear developers,
> 
> I suspect you don't want to hear this, if like me, you've battled with MS and
> their non-compliance with RFCs. However, we are using FEX at the ETH in Zurich
> http://e-citations.ethbib.ethz.ch/
> 
> Our secretary would like to download the output as CSV so that is can open in
> Excel (!). Not being very computer literate this needs to be as simple as
> possible. However, the returned file is
> 
> export.csv.txt
> 
> with mime
> 
> text/csv
> 
> Now of course, you can associate the MIME with Excel. Sadly however, because
> the ending is not CSV this means that Excel does not run its import script.
> Ideally the ending would be simply CSV. That keeps dumb Excel happy and makes
> non-computer literate people happy too. I am running Mozilla/5.0 (Windows; U;
> Windows NT 6.1; en-US; rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11 which is ETH
> policy. I don't think this is a function of the browser as my HTTP sniffer
> informs me:
> 
> Content-Disposition: attachment; filename=export.csv.txt
> Set-Cookie: *deleted*
> Keep-Alive: timeout=5, max=98
> Connection: Keep-Alive
> Transfer-Encoding: chunked
> Content-Type: text/csv
> 
> 
> Any chance you could change it? Or even add an Excel option, that is CSV but
> with .CSV extension and the Excel MIME type?
> 
>  
> 
> Thanks,
> 
>  
> 
> Dr. Ben Keitch
> 
>  
> 
>  
> 
> --
> 
> Trapped Ion Quantum Information Group
> Quantum Optics and Photonics
> Institute for Quantum Electronics
> ETH Zurich
> Schafmattstrasse 16 / HPF E10
> 8093 Zurich
> Tel. + 41 (0) 44 633 32 58
> Fax. + 41 (0) 44 633 10 56
> 
> 
> ------------------------------------------------------------------------------
> Nokia and AT&T present the 2010 Calling All Innovators-North America contest
> Create new apps & games for the Nokia N8 for consumers in  U.S. and Canada
> $10 million total in prizes - $4M cash, 500 devices, nearly $6M in marketing
> Develop with Nokia Qt SDK, Web Runtime, or Java and Publish to Ovi Store
> http://p.sf.net/sfu/nokia-dev2dev
> 
> _______________________________________________
> Fez-developers mailing list
> Fez...@li...
> https://lists.sourceforge.net/lists/listinfo/fez-developers



~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lachlan Kuhn
Senior Web Developer
Library Technology Service
The University of Queensland, Australia QLD 4072
Telephone : (+61) (7) 3346 4349
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 

[Fez-developers] Excel and CSV

[bkeitch <bk...@ph...>]

Dear developers, 

I suspect you don't want to hear this, if like me,
you've battled with MS and their non-compliance with RFCs. However, we
are using FEX at the ETH in Zurich http://e-citations.ethbib.ethz.ch/


Our secretary would like to download the output as CSV so that is can
open in Excel (!). Not being very computer literate this needs to be as
simple as possible. However, the returned file is 

export.csv.txt


with mime 

text/csv 

Now of course, you can associate the MIME with
Excel. Sadly however, because the ending is not CSV this means that
Excel does not run its import script. Ideally the ending would be simply
CSV. That keeps dumb Excel happy and makes non-computer literate people
happy too. I am running Mozilla/5.0 (Windows; U; Windows NT 6.1; en-US;
rv:1.9.2.11) Gecko/20101012 Firefox/3.6.11 which is ETH policy. I don't
think this is a function of the browser as my HTTP sniffer informs me:


Content-Disposition: attachment; filename=export.csv.txt
Set-Cookie:
*deleted*
Keep-Alive: timeout=5, max=98
Connection:
Keep-Alive
Transfer-Encoding: chunked
Content-Type: text/csv

Any chance
you could change it? Or even add an Excel option, that is CSV but with
.CSV extension and the Excel MIME type? 

Thanks, 

Dr. Ben Keitch 

--


Trapped Ion Quantum Information Group
Quantum Optics and
Photonics
Institute for Quantum Electronics
ETH Zurich
Schafmattstrasse
16 / HPF E10
8093 Zurich
Tel. + 41 (0) 44 633 32 58
Fax. + 41 (0) 44 633
10 56
 

[Fez-developers] Workflow Error and How to reset it

[Scowen G. S. <gre...@li...>]

Hi,

 

Some of our editors are getting the following error when trying to edit
a record:

 

"This workflow has finished and cannot be resumed"

 

How can we get around this and reset the status of the record?

 

 

 

 

Re: [Fez-developers] Bugfix 2

[Lachlan K. <l....@li...>]

Thanks for this, Kai.
 
This fix has now been committed to the repo.
 
Regards,
 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Lachlan Kuhn
Senior Web Developer
Library Technology Service
The University of Queensland, Australia Qld 4072
Telephone : (+61) (7) 3346 3520
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
From: Jauslin Kai [mailto:kai...@li...] 
Sent: Tuesday, 23 February 2010 7:12 PM
To: fez...@li...
Subject: Re: [Fez-developers] Bugfix 2
 
Great. Here's another one: line 1424 in class.xsd_html_match.php: quote
as integer instead of string:
" . $db->quote($_POST["validation_maxlength"], 'INTEGER') . ",
 
Cheers, Kai
 
Von: Christiaan Kortekaas [mailto:c.k...@li...] 
Gesendet: Donnerstag, 11. Februar 2010 07:43
An: fez...@li...
Betreff: Re: [Fez-developers] Bugfix 2
 
Hi Kai

It looks like Lachlan's committed these fixes to trunk now.

My thanks to you and Lachlan!

Christiaan


On 10/02/10 8:50 PM, "Jauslin  Kai" <kai...@li...> wrote:
In File include/class.xsd_html_match.php, function getOptionValue,
around line 1025:
change the typo "$dv" to "$db"
 
-Kai

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
Christiaan Kortekaas 
Software Development Manager
Library Technology Service 
The University of Queensland, Australia QLD 4072 
Telephone : (+61) (7) 3346 4337
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 

Re: [Fez-developers] Bugfix 2

[Jauslin K. <kai...@li...>]

Great. Here's another one: line 1424 in class.xsd_html_match.php: quote
as integer instead of string:

" . $db->quote($_POST["validation_maxlength"], 'INTEGER') . ",

 

Cheers, Kai

 

Von: Christiaan Kortekaas [mailto:c.k...@li...] 
Gesendet: Donnerstag, 11. Februar 2010 07:43
An: fez...@li...
Betreff: Re: [Fez-developers] Bugfix 2

 

Hi Kai

It looks like Lachlan's committed these fixes to trunk now.

My thanks to you and Lachlan!

Christiaan


On 10/02/10 8:50 PM, "Jauslin  Kai" <kai...@li...> wrote:

In File include/class.xsd_html_match.php, function getOptionValue,
around line 1025:
change the typo "$dv" to "$db"
 
-Kai


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 
Christiaan Kortekaas 
Software Development Manager
Library Technology Service 
The University of Queensland, Australia QLD 4072 
Telephone : (+61) (7) 3346 4337
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 

[Fez-developers] Uncaught exception 'Zend_Exception'

[Fernando R. <fer...@du...>]

Hello,

The error message below is being logged when I browse to the "sanity check" page and the "index objects" page (after clicking "Discover new Fedora objects" button) 

PHP Fatal error:  Uncaught exception 'Zend_Exception' with message 'No entry is registered for key 'fedora_db'' in /var/www/fez/include/Zend/Registry.php:147\nStack trace:\n#0 /var/www/fez/include/class.db_api.php(68): Zend_Registry::get('fedora_db')\n#1 /var/www/fez/include/class.sanity_checks.php(520): DB_API::get('fedora_db')\n#2 /var/www/fez/include/class.sanity_checks.php(105): SanityChecks::fedoraDirect()\n#3 /var/www/fez/upgrade/check_sanity.php(34): SanityChecks::runAllChecks()\n#4 {main}\n  thrown in /var/www/fez/include/Zend/Registry.php on line 147, referer: http://130.253.33.121/fez/manage/configuration.php


The code in "init.php" looks okay as far as I can tell.

 $fdb = Zend_Db::factory(FEDORA_DB_TYPE, $fparams);
    $fdb->getConnection();
    Zend_Registry::set('fedora_db', $fdb);

I added "Zend_Db_Table_Abstract::setDefaultAdapter($fdb);"  below "$fdb->Connection();"  but It didn't appear to do anything.  Restarted Apache after this as well.

Do you guys have any thoughts as why the fedora_db value isn't getting set correctly?  

The source code is from the SVN trunk February 12, 2010.  

Thank you,
Fernando Reyes

Re: [Fez-developers] Bugfix 2

[Christiaan K. <c.k...@li...>]

Hi Kai

It looks like Lachlan¹s committed these fixes to trunk now.

My thanks to you and Lachlan!

Christiaan


On 10/02/10 8:50 PM, "Jauslin  Kai" <kai...@li...> wrote:

> In File include/class.xsd_html_match.php, function getOptionValue, around line
> 1025:
> change the typo "$dv" to "$db"
>  
> -Kai
>  

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Christiaan Kortekaas
Software Development Manager
Library Technology Service
The University of Queensland, Australia QLD 4072
Telephone : (+61) (7) 3346 4337
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

[Fez-developers] Bugfix 2

[Jauslin K. <kai...@li...>]

In File include/class.xsd_html_match.php, function getOptionValue, around line 1025:

change the typo "$dv" to "$db"

 

-Kai

 

-- 

ETH Zürich, Kai Jauslin, ETH-Bibliothek, Prozesse und IT, Integration und Entwicklung, Rämistrasse 101, CH-8092 Zürich, Tel +41-44-6324972, Büro HG H29.5, kai...@li..., www.ethbib.ethz.ch

 

[Fez-developers] Very small bugfix

[Jauslin K. <kai...@li...>]

Just encountered an error when creating a new search key. To fix, please add the lines

$log = FezLog::get();

$db = DB_API::get();

 

in class.search_key.php at top of function createSearchKeyDB.

 

Regards, Kai 

 

-- 

ETH Zürich, Kai Jauslin, ETH-Bibliothek, Prozesse und IT, Integration und Entwicklung, Rämistrasse 101, CH-8092 Zürich, Tel +41-44-6324972, Büro HG H29.5, kai...@li..., www.ethbib.ethz.ch

 

[Fez-developers] Support for Fedora 3.x

[Benjamin R. <B....@le...>]

Hi,
  Are there any plans for releasing a Fez version that supports Fedora 3.x?

Regards,
  Ben

[Fez-developers] excluding namespace except dc:

[Lynette R. <el...@cs...>]

I ran into a problem with one of my XSD's that heavily uses namespaces with
elements.  The problem occurred because Misc::strip_element_name() removes
the namespace.  This is called at the beginning of matchFieldsCallback().
So as an example, I have a field dct:accessRights.  In the
xsd_display_matchfields table, the xsdmf_element gets stored as
!dct:accessRights when the field is defined.  In matchFieldsCallback(), the
dct: is stripped causing a search for !accessRights which doesn't exist.

 

In my local code, I fixed this by adding code to strip_element_name to not
strip off my namespaces.  This doesn't seem to have had a negative effect on
other areas of Fez.  But I don't like this hardcoded fix. 

 

What is the purpose of stripping off the namespace before creating the full
element name?  If this really is needed for other parts of Fez to operate
correctly, then it seems like a better fix would be to generate the
xsdmf_element name without namespaces when the field is defined.  Am I
missing something here?

 

Lynette

 

[Fez-developers] FIX: Controlled Vocabulary doesn't start at the selected controlled vocabulary for a field

[Lynette R. <el...@cs...>]

I added a tutorial for how to add a controlled vocabulary field.  As part of
that, I have a section at the end that explains how to make the controlled
vocabulary selector start with the controlled vocabulary setup when the
controlled vocabulary selector field was defined.  I didn't push the fix,
because I wasn't sure if you intentionally removed this code. 

 

http://fez.library.uq.edu.au/wiki/Add_a_controlled_vocabulary_selector_field#
FIX:_Controlled_Vocabulary_doesn.27t_start_at_the_selected_controlled_vocabul
ary_for_a_field

 

 

BTW, the tutorial contains a step requiring direct manipulation of database
tables to connect the attribute loop field to the subloop element.  If there
is a way to accomplish this through the interface, that would be excellent
information to have.

 

Lynette

 

 

 

[Fez-developers] broken link on wiki

[Lynette R. <el...@cs...>]

FYI, the screencast link for Custom Controlled Vocabularies gets a 404...

 

http://dev-repo.library.uq.edu.au/screencast/Controlled%20Vocabulary.htm

 

Lynette

[Fez-developers] Regarding login problem in fez

[Abhishek S. <ak...@as...>]

Dear Developers,
           We are using fedora and fez to maintain an e-library for the
schools of Nepal. As a part of my work, I have to customize fez to
support the local language as well as to make other modifications as per
our requirement. In this regard, to start with, I installed fedora (ver
2.2.1) along with the recent version of fez. Fedora is configured and
running well. I setup fez and it starts up good. But whenever I try to
login, it does not work. Whenever I try to login with a credential that
is not registered with the system, it gives me an error. But when I
tried logging in with the default credential of "admin/admin", it does
not give me any error, rather it redirects me to the home page. I also
tried accessing the mysql table and adding one user for myself setting
that user as both usr_administrator and usr_super_administrator. Then I
tried logging with the new user's credential, and the same problem
repeated. What I found that the login count was incremented every
attempt I did for login. I was suggested the following change:

Comment out this block in init.php:

   $sess = new Fez_Session_Manager();

   Zend_Session::setOptions(array(

       'gc_probability' => 1,

       'gc_divisor' => 5000

       ));

   Zend_Session::setSaveHandler($sess);


And add this line:

   $sess = new SessionManager();


But this also didn't solve the problem. Is it a bug? I tried with the
recent svn checkout version and as well as with the recent stable
release, but all in vain. I could not find a place to report the bug,
that's why I'm mailing. I hope to get a solution soon.

Thank You.

-- 
Abhishek Singh
http://www.asingh.com.np

Re: [Fez-developers] Workflow templates

[Andrew M. <a.m...@li...>]

Hi Kai,

Well spotted! I've updated the function to include the necessary call to get
the DB adapter from the registry. Thanks!

Just a quick note about the bugfix to class.record_general.php (line
1413-1429). With the fix in place we were experiencing an issue when
creating a record - rek_title in the record_search_key table would always be
'Array'. To replicate the issue:

- Navigate to a collection, and select create a new Journal Article.
- Complete the required fields for the Journal Article.
- Publish the new Journal Article.

On the view page (/view/<PID>) the title of the new Journal Article will be
'Array'. At this stage we're not too sure if this is something only we are
experiencing, but for the time being I've temporarily commented out the
bugfix in trunk until we've had a chance to test further.

Thanks again Kai for your help!

Thanks,
Andrew


-- 
Andrew Martlew 
Senior Web Developer
Library Technology Service
The University of Queensland, Australia QLD 4072
Telephone : (+61) (7) 3346 4337




On 22/09/09 8:39 PM, "Jauslin  Kai" <kai...@li...> wrote:

> Hello to all,
> 
> I had a problem with the workflow definitions in the trunk
> (upgrade/workflows.xml). When using "Update Record - Generic", it did not save
> any of the changed data. However, reverting to an old version of this workflow
> (pre-April 2009) solved the problem. Could there be a problem with the current
> workflows.xml?
> 
> In the function "importWorkflow" (file class.workflow.php), the line "$db =
> DB_API::get();" is missing at the beginning. Otherwise ($db->quote will throw
> an error).
> 
> 
> Cheers, Kai
> 

[Fez-developers] Workflow templates

[Jauslin K. <kai...@li...>]

Hello to all,

I had a problem with the workflow definitions in the trunk (upgrade/workflows.xml). When using "Update Record - Generic", it did not save any of the changed data. However, reverting to an old version of this workflow (pre-April 2009) solved the problem. Could there be a problem with the current workflows.xml?

In the function "importWorkflow" (file class.workflow.php), the line "$db = DB_API::get();" is missing at the beginning. Otherwise ($db->quote will throw an error).


Cheers, Kai


-- 
ETH Zürich, Kai Jauslin, ETH-Bibliothek, Prozesse und IT, Integration und Entwicklung, Rämistrasse 101, CH-8092 Zürich, Tel +41-44-6324972, Büro HG H29.5, kai...@li..., www.ethbib.ethz.ch

Re: [Fez-developers] Bugfixes

[Christiaan K. <c.k...@li...>]

Hi Kai

Thanks for these - much appreciated. Lachlan is currently cleaning up the
trunk for a new proper release (probably with Fedora 3.2 support). So we'll
get these in for that release.

Cheers,
Christiaan


On 21/09/09 11:46 PM, "Jauslin  Kai" <kai...@li...> wrote:

> Hello, here come some bugs I identified when merging with the Fez trunk r2669
> (today).
> 
> 1. In some cases, PHP (Windows, 5.2.10) may throw an "exception without
> stackframe". Reason: the table definition for fez_sessions does not seem
> up-to-date (fields created,updated (datetime) are missing in the SQL updates).
> Fixing the table solves this issue.
> 
> 2. We have here two XSDMF of type controlled vocabulary, using the same search
> key (subject). In this case, only the content of the first fields are written
> to the search key. I suggest fixing this in the core by adding line 1413-1429
> in the attached class.record_general.php. This could also apply to other cases
> where one search key is used for multiple fields (e.g. title - subtitle).
> 
> 
> Cheers, Kai
> 

-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Christiaan Kortekaas
Senior Library Open Sorcerer
Library Technology Service
The University of Queensland, Australia QLD 4072
Telephone : (+61) (7) 3346 4337
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

[Fez-developers] Bugfixes

[Jauslin K. <kai...@li...>]

Hello, here come some bugs I identified when merging with the Fez trunk r2669 (today).

1. In some cases, PHP (Windows, 5.2.10) may throw an "exception without stackframe". Reason: the table definition for fez_sessions does not seem up-to-date (fields created,updated (datetime) are missing in the SQL updates). Fixing the table solves this issue.

2. We have here two XSDMF of type controlled vocabulary, using the same search key (subject). In this case, only the content of the first fields are written to the search key. I suggest fixing this in the core by adding line 1413-1429 in the attached class.record_general.php. This could also apply to other cases where one search key is used for multiple fields (e.g. title - subtitle).


Cheers, Kai


-- 
ETH Zürich, Kai Jauslin, ETH-Bibliothek, Prozesse und IT, Integration und Entwicklung, Rämistrasse 101, CH-8092 Zürich, Tel +41-44-6324972, Büro HG H29.5, kai...@li..., www.ethbib.ethz.ch

[Fez-developers] Default Security Level On Datastreams

[Keith Ó D. <ke...@ke...>]

Hi All, 
Is there any quick way to set the default security levels for
file-attachment datastreams? 

At the moment I've the code changed so that when user's create new records
and upload files then the datastreams can only be viewed by people in the
"Level 5" group. However, if I edit the record and then upload more files,
those new files don't default to "Level 5" viewing only. 

Any suggestions? 

Thanks alot, 
Keith
-- 
View this message in context: http://n2.nabble.com/Default-Security-Level-On-Datastreams-tp3625782p3625782.html
Sent from the Fez Developers mailing list archive at Nabble.com.

[Fez-developers] Default Security Level On Datastreams

[Keith Ó D. <ke...@ke...>]

Hi All,
Is there any quick way to set the default security levels for datastreams?

At the moment I've the code changed so that when user's create new records
and upload files then the datastreams can only be viewed by people in the
"Level 5" group. However, if I edit the record and then upload more files,
those new files don't default to "Level 5" viewing only.

Any suggestions?

Thanks alot,
Keith
-- 
View this message in context: http://n2.nabble.com/Default-Security-Level-On-Datastreams-tp3625083p3625083.html
Sent from the Fez Developers mailing list archive at Nabble.com.

Re: [Fez-developers] Regular reports from fez-fedora

[Jauslin K. <kai...@li...>]

Hi Joe,

 

there are several levels where you could integrate Birt with Fez for reporting.

 

a)      Develop a fez add-on which serves as a data-source in birt. The add-on does all the communication with MySQL, Solr and Fedora (you'd probably only need MySQL and Fedora). This is also where the data is aggregated (e.g. user information combined with foxml). This requires substantial knowledge of PHP and MySQL, although you can use Fez classes to do the actual querying.

b)      Use Fez MySQL as a birt datasource - this will not give you the full change history because it is in Fedora (but do you really need this?)

c)       Use raw Fedora XML (Foxml) as datasource in Birt. Fedora saves all metadata as XML objects in the filesystem (objects directory). You could try to access these directly. Although this will not give you information about individual users.

 

If you look at these options, you see that a) gives you the nicest and most complete integration (reporting on everything), but is also the most expensive (I'd estimate 3-4 programmer's weeks for a skilled programmer). 

 

Option b) is for sure worth a try - you could without programming, see http://dev.mysql.com/tech-resources/articles/using-birt/ as an example.

 

Option c) gives you access to some data otherwise not accessible, but misses the aspects of individual users.

 

I'd first try option b) - configure a new birt report on the Fez database and see how far you can get (without any programming). Later on, it might still be possible to configure an additional birt SOAP datasource and access Fedora directly (ah, this is actually option c2).

 

Good luck - keep me updated...

 

Cheers, Kai

PS. I post this reply also to the mailing list as it may be of interest to other users. Please check out also Christiaan's response... 

 

-- 

ETH Zürich, Kai Jauslin, ETH-Bibliothek, Prozesse und IT, Integration und Entwicklung, Rämistrasse 101, CH-8092 Zürich, Tel +41-44-6324972, Büro HG H29.5, kai...@li..., www.ethbib.ethz.ch

 

Von: Joseph Heaphey [mailto:jos...@de...] 
Gesendet: Freitag, 14. August 2009 06:29
An: Jauslin Kai
Betreff: RE: Regular reports from fez-fedora

 

Hi Kai,

 

Thanks so much for your response.  BIRT sounds like a possibility, but I don't know enough about it yet to know if I should pursue it further.  You mentioned that if I integrate BIRT with Fez/Fedora/Solr, I would have to develop a Fez add-on.  Could you give me a few hints as to what this would involve?  Thanks again for your help.

 

Kind regards,

Joe

 

 

From: Kai Jauslin [mailto:kai...@li...] 
Sent: Thursday, 13 August 2009 7:02 PM
To: Joseph Heaphey
Cc: Giuliani Germano
Subject: Re: Regular reports from fez-fedora

 

Hi Joe,

we don't need to do internal reporting because our data comes from external sources and no external users are working directly in Fez. I don't know of anybody currently working on this for Fez.

What we are currently developing internally is a SOAP webservice layer as an interface for external reporting. This layer accesses directly the Solr index (very fast querying!) or the Fez MySQL database. However, only data in the MySQL database (=Fez cache) or the Solr index (=search keys). For some of your queries you would need to access the change history, which you can only get from Fedora.

I know of other products using BIRT (http://www.eclipse.org/birt/phoenix/) as an end-user reporting frontend and could imagine, that it is possible to integrate this with Fez/Fedora/Solr on different layers. Although this would mean you'd have to develop a Fez add-on. If you are interested in going this way, I might be able to give you some hints on the best way of integration.


Best regards,
Kai


Joseph Heaphey schrieb: 

Dear Kai,

 

I've been asked to look into preparing regular reports from fez (whether using fez or other tools) and I would be interested to know how you or anyone else in the Fez community is doing this. 

 

Here are some examples of reports that we are interested in: 

report of security set on objects (e.g. whether it inherits security from parent, who can see it, edit it, etc.)

list of work added or amended by a specific user between specific dates

count and list of objects added between specific dates

report of broken urls.  

 

So far we have just done ad hoc reporting (using various combinations of SQL, perl, xslt, and php), at times using the fez database and at other times having to pull data from fedora.  Ideally, we would like a way for at least some of these reports to be run by non-technical staff.  Do you have any ideas about this or know of anyone who has done this already?

 

Many thanks,

Joe Heaphey

 

 

Joseph Heaphey, Digitisation Services Analyst, Library
Deakin University Geelong Victoria 3217 Australia.
Phone: 03 5227 8236 International: +61 3 5227 8236
Fax: 03 5227 8000 International: +61 3 5227 8000
ICQ: 229654280
Email: jos...@de...
Website: http://www.deakin.edu.au
<http://www.deakin.edu.au/> Deakin University CRICOS Provider Code 00113B (Vic)

Important Notice: The contents of this email are intended solely for the named addressee and are confidential; any unauthorised use, reproduction or storage of the contents is expressly prohibited. If you have received this email in error, please delete it and any attachments immediately and advise the sender by return email or telephone.
Deakin University does not warrant that this email and any attachments are error or virus free

 

 

Re: [Fez-developers] Regular reports from Fez/Fedora

[Joseph H. <jos...@de...>]

Hi Matt,

Thanks for this.  It's something I hadn't thought much about but it's obviously important.  I'll look into it.

Joe


From: Matt Painter [mailto:ma...@de...]
Sent: Friday, 7 August 2009 11:53 AM
To: fez...@li...
Subject: Re: [Fez-developers] Regular reports from Fez/Fedora

Hi Joe,

I haven't worked in the Fez space for a while now, but I wrote an extension and stand-alone Java application to produce checksum reports from Fedora back in August 2008. Details and patches (which are no doubt now woefully out-of-date) are here:

http://dev-repo.library.uq.edu.au/wiki/index.php/Fedora_Integrity_Checker_Application

M

2009/8/5 Joseph Heaphey <jos...@de...<mailto:jos...@de...>>

Hi all,



(I initially sent this to the Fez user's list, but I'm also interested in hearing from developers.)



Has anyone done any work on regular reports for fez/fedora (whether as part of fez or using other tools)?  Here are some examples:

*         report of security set on objects (e.g. whether it inherits security from parent, who can see it, edit it, etc.)

*         list of work added or amended by a specific user between specific dates

*         count and list of objects added between specific dates

*         report of broken urls.



So far we have just done ad hoc reporting (using various combinations of SQL, perl, xslt, and php), at times using the fez database and at other times having to pull data from fedora.  Ideally, we would like a way for at least some of these reports to be run by non-technical staff.  Does anyone have any experience with this or ideas about it?



Regards,

Joe





Joseph Heaphey, Digitisation Services Analyst, Library
Deakin University Geelong Victoria 3217 Australia.
Phone: 03 5227 8236 International: +61 3 5227 8236
Fax: 03 5227 8000 International: +61 3 5227 8000
ICQ: 229654280
Email: jos...@de...<mailto:jos...@de...>
Website: http://www.deakin.edu.au
<http://www.deakin.edu.au/>Deakin University CRICOS Provider Code 00113B (Vic)

Important Notice: The contents of this email are intended solely for the named addressee and are confidential; any unauthorised use, reproduction or storage of the contents is expressly prohibited. If you have received this email in error, please delete it and any attachments immediately and advise the sender by return email or telephone.
Deakin University does not warrant that this email and any attachments are error or virus free



------------------------------------------------------------------------------
Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
trial. Simplify your report design, integration and deployment - and focus on
what you do best, core application coding. Discover what's new with
Crystal Reports now.  http://p.sf.net/sfu/bobj-july
_______________________________________________
Fez-developers mailing list
Fez...@li...<mailto:Fez...@li...>
https://lists.sourceforge.net/lists/listinfo/fez-developers



--

Matt Painter
http://deity.co.nz
ma...@de...<mailto:ma...@de...>
+64 21 115 9378

Re: [Fez-developers] Regular reports from Fez/Fedora

[Matt P. <ma...@de...>]

Hi Joe,

I haven't worked in the Fez space for a while now, but I wrote an extension
and stand-alone Java application to produce checksum reports from Fedora
back in August 2008. Details and patches (which are no doubt now woefully
out-of-date) are here:

http://dev-repo.library.uq.edu.au/wiki/index.php/Fedora_Integrity_Checker_Application

M


2009/8/5 Joseph Heaphey <jos...@de...>

>  Hi all,
>
>
>
> (I initially sent this to the Fez user’s list, but I’m also interested in
> hearing from developers.)
>
>
>
> Has anyone done any work on regular reports for fez/fedora (whether as part
> of fez or using other tools)?  Here are some examples:
>
> ·         report of security set on objects (e.g. whether it inherits
> security from parent, who can see it, edit it, etc.)
>
> ·         list of work added or amended by a specific user between
> specific dates
>
> ·         count and list of objects added between specific dates
>
> ·         report of broken urls.
>
>
>
> So far we have just done ad hoc reporting (using various combinations of
> SQL, perl, xslt, and php), at times using the fez database and at other
> times having to pull data from fedora.  Ideally, we would like a way for at
> least some of these reports to be run by non-technical staff.  Does anyone
> have any experience with this or ideas about it?
>
>
>
> Regards,
>
> Joe
>
>
>
>
>
> Joseph Heaphey, Digitisation Services Analyst, Library
> Deakin University Geelong Victoria 3217 Australia.
> Phone: 03 5227 8236 International: +61 3 5227 8236
> Fax: 03 5227 8000 International: +61 3 5227 8000
> ICQ: 229654280
> Email: jos...@de...
> Website: http://www.deakin.edu.au
> Deakin University CRICOS Provider Code 00113B (Vic)
>
> *Important Notice: **The contents of this email are intended solely for
> the named addressee and are confidential; any unauthorised use, reproduction
> or storage of the contents is expressly prohibited. If you have received
> this email in error, please delete it and any attachments immediately and
> advise the sender by return email or telephone.
> Deakin University does not warrant that this email and any attachments are
> error or virus free*
>
>
>
>
> ------------------------------------------------------------------------------
> Let Crystal Reports handle the reporting - Free Crystal Reports 2008 30-Day
> trial. Simplify your report design, integration and deployment - and focus
> on
> what you do best, core application coding. Discover what's new with
> Crystal Reports now.  http://p.sf.net/sfu/bobj-july
> _______________________________________________
> Fez-developers mailing list
> Fez...@li...
> https://lists.sourceforge.net/lists/listinfo/fez-developers
>
>


-- 

Matt Painter
http://deity.co.nz
ma...@de...
+64 21 115 9378