Re: [VuFind-Tech] Solr Alphanumeric browsing

[Demian Katz <demian.katz@vi...>]

Do you have an example of exactly where/how this was going wrong?  I don't see why any version of Solr should be incapable of alphanumeric ranged searches - I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge...  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke


--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru

[VuFind-Tech] Solr Alphanumeric browsing

[Osullivan L. <L.Osullivan@sw...>]

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke

--
Luke O'Sullivan
Systems Developer
Web Team
Swansea University, Singleton Park, Swansea SA2 8PP, UK
l.osullivan@...<mailto:l.osullivan@...>
01792 602772
@l_os_cymru

Re: [VuFind-Tech] Solr Alphanumeric browsing

[Demian Katz <demian.katz@vi...>]

Do you have an example of exactly where/how this was going wrong?  I don't see why any version of Solr should be incapable of alphanumeric ranged searches - I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge...  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke


--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru

Re: [VuFind-Tech] Solr Alphanumeric browsing

[Osullivan L. <L.Osullivan@sw...>]

Hi Demian,

It's related to the patch I submitted a while back. http://vufind.org/jira/browse/VUFIND-598

The normalisation worked fine, as did the sorting but the ranged searches produced inconsistent results. I tried using the solr mailing lists but (I think) they confirmed that solr wasn't capable of doing that at the time.

Cheers,

Luke

On 02/19/2013 04:33 PM, Demian Katz wrote:
Do you have an example of exactly where/how this was going wrong?  I don’t see why any version of Solr should be incapable of alphanumeric ranged searches – I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge…  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...<mailto:vufind-tech@...>
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke


--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru


--
Luke O'Sullivan
Systems Developer
Web Team
Swansea University, Singleton Park, Swansea SA2 8PP, UK
l.osullivan@...<mailto:l.osullivan@...>
01792 602772
@l_os_cymru

Re: [VuFind-Tech] Solr Alphanumeric browsing

[Demian Katz <demian.katz@vi...>]

Is the issue here that, because the call numbers in the index are getting normalized, they don't match up with range queries that are non-normalized?  i.e. the problem is that Solr does not apply normalization to the content of range queries?  If that's it, I'm not sure if there's a solution or not - I think there are some more flexible features available now, but I haven't looked into it in any detail yet.  Perhaps when I get around to working on VUFIND-172, that will reveal some relevant tools.

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Wednesday, February 20, 2013 5:42 AM
To: Demian Katz
Cc: vufind-tech@...; Brown A.T.
Subject: Re: Solr Alphanumeric browsing

Hi Demian,

It's related to the patch I submitted a while back. http://vufind.org/jira/browse/VUFIND-598

The normalisation worked fine, as did the sorting but the ranged searches produced inconsistent results. I tried using the solr mailing lists but (I think) they confirmed that solr wasn't capable of doing that at the time.

Cheers,

Luke
On 02/19/2013 04:33 PM, Demian Katz wrote:
Do you have an example of exactly where/how this was going wrong?  I don't see why any version of Solr should be incapable of alphanumeric ranged searches - I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge...  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...<mailto:vufind-tech@...>
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke



--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru



--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru

Re: [VuFind-Tech] Solr Alphanumeric browsing

[Osullivan L. <L.Osullivan@sw...>]

Hi Demian,

I created a solr filter which basically turned a callnumber search into a normalized callnumber search. I believe the inputed term was normalised as expected but the range search still didn't work.

Cheers,

Luke

On 02/20/2013 02:17 PM, Demian Katz wrote:
Is the issue here that, because the call numbers in the index are getting normalized, they don’t match up with range queries that are non-normalized?  i.e. the problem is that Solr does not apply normalization to the content of range queries?  If that’s it, I’m not sure if there’s a solution or not – I think there are some more flexible features available now, but I haven’t looked into it in any detail yet.  Perhaps when I get around to working on VUFIND-172, that will reveal some relevant tools.

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Wednesday, February 20, 2013 5:42 AM
To: Demian Katz
Cc: vufind-tech@...<mailto:vufind-tech@...>; Brown A.T.
Subject: Re: Solr Alphanumeric browsing

Hi Demian,

It's related to the patch I submitted a while back. http://vufind.org/jira/browse/VUFIND-598

The normalisation worked fine, as did the sorting but the ranged searches produced inconsistent results. I tried using the solr mailing lists but (I think) they confirmed that solr wasn't capable of doing that at the time.

Cheers,

Luke
On 02/19/2013 04:33 PM, Demian Katz wrote:
Do you have an example of exactly where/how this was going wrong?  I don’t see why any version of Solr should be incapable of alphanumeric ranged searches – I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge…  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...<mailto:vufind-tech@...>
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke



--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru



--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru


--
Luke O'Sullivan
Systems Developer
Web Team
Swansea University, Singleton Park, Swansea SA2 8PP, UK
l.osullivan@...<mailto:l.osullivan@...>
01792 602772
@l_os_cymru

Re: [VuFind-Tech] Solr Alphanumeric browsing

[Demian Katz <demian.katz@vi...>]

It sounds like this situation improves with Solr 3.6+:

http://wiki.apache.org/solr/MultitermQueryAnalysis

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Monday, February 25, 2013 6:23 AM
To: Demian Katz
Cc: vufind-tech@...; Brown A.T.
Subject: Re: Solr Alphanumeric browsing

Hi Demian,

I created a solr filter which basically turned a callnumber search into a normalized callnumber search. I believe the inputed term was normalised as expected but the range search still didn't work.

Cheers,

Luke
On 02/20/2013 02:17 PM, Demian Katz wrote:
Is the issue here that, because the call numbers in the index are getting normalized, they don't match up with range queries that are non-normalized?  i.e. the problem is that Solr does not apply normalization to the content of range queries?  If that's it, I'm not sure if there's a solution or not - I think there are some more flexible features available now, but I haven't looked into it in any detail yet.  Perhaps when I get around to working on VUFIND-172, that will reveal some relevant tools.

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Wednesday, February 20, 2013 5:42 AM
To: Demian Katz
Cc: vufind-tech@...<mailto:vufind-tech@...>; Brown A.T.
Subject: Re: Solr Alphanumeric browsing

Hi Demian,

It's related to the patch I submitted a while back. http://vufind.org/jira/browse/VUFIND-598

The normalisation worked fine, as did the sorting but the ranged searches produced inconsistent results. I tried using the solr mailing lists but (I think) they confirmed that solr wasn't capable of doing that at the time.

Cheers,

Luke
On 02/19/2013 04:33 PM, Demian Katz wrote:
Do you have an example of exactly where/how this was going wrong?  I don't see why any version of Solr should be incapable of alphanumeric ranged searches - I thought a range query could take any string as each end and would return everything alphabetically between them.  If it need to sort things numerically rather than alphabetically, I can see how that could be a challenge...  but otherwise it seems like it should work as-is.  Do you have an example of what you expect and what you actually get?

- Demian

From: Osullivan L. [mailto:L.Osullivan@...]
Sent: Tuesday, February 19, 2013 10:33 AM
To: vufind-tech@...<mailto:vufind-tech@...>
Cc: Brown A.T.
Subject: [VuFind-Tech] Solr Alphanumeric browsing

Hi Folks,

A while back I look into ranged callnumber searches (normalised callnumbers) with solr. While sorting by the normalised callnumber works fine, I came to the conclusion that the callnumber ranged searches didn't quite work. Does anyone know if the new releases of solr are capable of alphanumeric ranged searches?

Cheers,

Luke




--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru




--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru



--

Luke O'Sullivan

Systems Developer

Web Team

Swansea University, Singleton Park, Swansea SA2 8PP, UK

l.osullivan@...<mailto:l.osullivan@...>

01792 602772

@l_os_cymru