Unique Words "Infinite" Counter for Java (UWICJ) does not need to know the size of the input stream before hand, the stream can be very large and it is not limited by the maximum file length or main memory size.
UWICJ uses a constant size (in the number of words) of the main memory that makes it O(1) bytes in an average case and lets it work with extremely long streams.
UWICJ processing consists of looking up the words in the dictionary and modifying the dictionary. The search part is done concurrently by several threads that allows UWICJ to scale with the number of CPU's. Modification part is done in bulks by a single thread when the limit on the bulk is reached.
UWICJ benefits from the fact that some words are more frequent and it processes such words faster than the others.UWICJ automatically adjusts itself to the changing frequencies of the words so that it preserves its performance benefits.
Please, send your comments and questions to uwicj at yahoo dot com

Project Activity

See All Activity >

Categories

Follow Unique Words "Infinite" Counter for Java

Unique Words "Infinite" Counter for Java Web Site

Other Useful Business Software

An Easy to Use, Open Source, Big Data Solution. Icon
An Easy to Use, Open Source, Big Data Solution. Icon

End to end big data that enables you to spend less time formatting data and more time analyzing it.

Discover HPCC Systems - the truly open source big data solution that allows you to quickly process, analyze and understand large data sets, even data stored in massive, mixed-schema data lakes. Designed by data scientists, HPCC systems is a complete integrated solution from data ingestion and data processing to data delivery. The free online introductory courses and a robust developer community allow you to get started quickly.

Rate This Project

Login To Rate This Project

User Reviews

Be the first to post a review of Unique Words "Infinite" Counter for Java!

Additional Project Details

Registered

2012-04-15