[DL-Learner SVN] SF.net SVN: dl-learner:[4165] trunk/components-core/src/main/java/org/ dllearner/algorithms/isle/StopWordFilter.java

[<lor...@us...>]

Revision: 4165
          http://sourceforge.net/p/dl-learner/code/4165
Author:   lorenz_b
Date:     2013-11-21 13:39:34 +0000 (Thu, 21 Nov 2013)
Log Message:
-----------
Refactored context extractors.

Modified Paths:
--------------
    trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java

Modified: trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java
===================================================================
--- trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-11-21 13:38:03 UTC (rev 4164)
+++ trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-11-21 13:39:34 UTC (rev 4165)
@@ -45,8 +45,7 @@
 	public void removeStopWordAnnotations(Set<Annotation> annotations) {
 		for (Iterator<Annotation> iter = annotations.iterator(); iter.hasNext();) {
 			Annotation annotation = iter.next();
-			String content = annotation.getReferencedDocument().getContent();
-			String token = content.substring(annotation.getOffset(), annotation.getOffset()+annotation.getLength());
+			String token = annotation.getTokens().get(0).getRawForm();
 			if(stopWords.contains(token)){
 				iter.remove();
 			}

This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.