dl-learner-svn

[DL-Learner SVN] SF.net SVN: dl-learner:[4106] trunk/components-core/src/main/java/org/ dllearner/algorithms/isle/StopWordFilter.java

[<and...@us...>]

Revision: 4106
          http://sourceforge.net/p/dl-learner/code/4106
Author:   andremelo
Date:     2013-09-10 15:49:18 +0000 (Tue, 10 Sep 2013)
Log Message:
-----------
Adding isStopWord method

Modified Paths:
--------------
    trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java

Modified: trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java
===================================================================
--- trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-09-10 10:23:36 UTC (rev 4105)
+++ trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-09-10 15:49:18 UTC (rev 4106)
@@ -52,5 +52,9 @@
 			}
 		}
 	}
+	
+	public boolean isStopWord(String token) {
+		return stopWords.contains(token);
+	}
 
 }

This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.

[DL-Learner SVN] SF.net SVN: dl-learner:[4165] trunk/components-core/src/main/java/org/ dllearner/algorithms/isle/StopWordFilter.java

[<lor...@us...>]

Revision: 4165
          http://sourceforge.net/p/dl-learner/code/4165
Author:   lorenz_b
Date:     2013-11-21 13:39:34 +0000 (Thu, 21 Nov 2013)
Log Message:
-----------
Refactored context extractors.

Modified Paths:
--------------
    trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java

Modified: trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java
===================================================================
--- trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-11-21 13:38:03 UTC (rev 4164)
+++ trunk/components-core/src/main/java/org/dllearner/algorithms/isle/StopWordFilter.java	2013-11-21 13:39:34 UTC (rev 4165)
@@ -45,8 +45,7 @@
 	public void removeStopWordAnnotations(Set<Annotation> annotations) {
 		for (Iterator<Annotation> iter = annotations.iterator(); iter.hasNext();) {
 			Annotation annotation = iter.next();
-			String content = annotation.getReferencedDocument().getContent();
-			String token = content.substring(annotation.getOffset(), annotation.getOffset()+annotation.getLength());
+			String token = annotation.getTokens().get(0).getRawForm();
 			if(stopWords.contains(token)){
 				iter.remove();
 			}

This was sent by the SourceForge.net collaborative development platform, the world's largest Open Source development site.