This list is closed, nobody may subscribe to it.
2007 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(2) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
---|---|---|---|---|---|---|---|---|---|---|---|---|
2009 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
(2) |
Sep
|
Oct
(4) |
Nov
|
Dec
|
2010 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
(1) |
Aug
(3) |
Sep
|
Oct
|
Nov
|
Dec
|
2011 |
Jan
|
Feb
(2) |
Mar
|
Apr
(5) |
May
(2) |
Jun
(7) |
Jul
(4) |
Aug
(5) |
Sep
(4) |
Oct
(3) |
Nov
(8) |
Dec
(4) |
2012 |
Jan
(6) |
Feb
(11) |
Mar
(10) |
Apr
(1) |
May
(2) |
Jun
(4) |
Jul
(7) |
Aug
(4) |
Sep
(4) |
Oct
(2) |
Nov
|
Dec
(10) |
2013 |
Jan
(4) |
Feb
(8) |
Mar
(3) |
Apr
(9) |
May
(8) |
Jun
(2) |
Jul
(3) |
Aug
(2) |
Sep
(8) |
Oct
(2) |
Nov
(3) |
Dec
(3) |
2014 |
Jan
(6) |
Feb
(2) |
Mar
(15) |
Apr
(1) |
May
(8) |
Jun
(6) |
Jul
(1) |
Aug
|
Sep
(13) |
Oct
(2) |
Nov
(3) |
Dec
(2) |
2015 |
Jan
(2) |
Feb
|
Mar
(1) |
Apr
(4) |
May
|
Jun
|
Jul
|
Aug
(9) |
Sep
|
Oct
(2) |
Nov
(6) |
Dec
|
2016 |
Jan
(3) |
Feb
(6) |
Mar
(1) |
Apr
(1) |
May
|
Jun
(6) |
Jul
(3) |
Aug
(4) |
Sep
(4) |
Oct
(13) |
Nov
(1) |
Dec
|
2017 |
Jan
(1) |
Feb
(2) |
Mar
(2) |
Apr
(1) |
May
(4) |
Jun
(7) |
Jul
|
Aug
(1) |
Sep
|
Oct
(1) |
Nov
(2) |
Dec
|
2018 |
Jan
(1) |
Feb
(1) |
Mar
|
Apr
|
May
(2) |
Jun
(2) |
Jul
(2) |
Aug
(1) |
Sep
(4) |
Oct
(4) |
Nov
(2) |
Dec
(1) |
2019 |
Jan
(7) |
Feb
(2) |
Mar
(3) |
Apr
|
May
(5) |
Jun
(3) |
Jul
(4) |
Aug
(4) |
Sep
(1) |
Oct
|
Nov
|
Dec
|
2020 |
Jan
(1) |
Feb
(1) |
Mar
|
Apr
|
May
(1) |
Jun
|
Jul
(1) |
Aug
(4) |
Sep
(1) |
Oct
(4) |
Nov
|
Dec
(4) |
2021 |
Jan
(1) |
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2022 |
Jan
|
Feb
|
Mar
(1) |
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
2023 |
Jan
(2) |
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
From: Tim M. <ti...@ti...> - 2017-06-28 13:39:16
|
This is all really great work. I have personally used the new parsoid option and it worked really well. Look forward to more name spaces, especially categories. Thanks, Tim On Wed, Jun 28, 2017 at 8:14 AM, < kiw...@li...> wrote: > Send Kiwix-developer mailing list submissions to > kiw...@li... > > To subscribe or unsubscribe via the World Wide Web, visit > https://lists.sourceforge.net/lists/listinfo/kiwix-developer > or, via email, send a message with subject or body 'help' to > kiw...@li... > > You can reach the person managing the list at > kiw...@li... > > When replying, please edit your Subject line so it is more specific > than "Re: Contents of Kiwix-developer digest..." > > > Today's Topics: > > 1. [INFO] Few good news about mwoffliner (Emmanuel Engelhart) > > > ---------------------------------------------------------------------- > > Message: 1 > Date: Tue, 27 Jun 2017 22:26:23 +0200 > From: Emmanuel Engelhart <ke...@ki...> > To: Using Wikimedia projects and MediaWiki offline > <off...@li...> > Cc: "kiw...@li..." > <kiw...@li...> > Subject: [Kiwix-developer] [INFO] Few good news about mwoffliner > Message-ID: <8b1...@ki...> > Content-Type: text/plain; charset="utf-8" > > Hi > > We rarely write here specifically about mwoffliner, even if this tool is > time to time named by-the-way in threads. But these last months we have > done many interesting improvements to this important tool and I thought > it might be valuable to report quickly about them. > > As a reminder, mwoffliner is a script which is thought to build a ZIM > file from any (recent) online Mediawiki. It scraps a snapshot of the > online wiki (HTML/JS/pictures/...) on your local disk. > > Here is the list of recent improvements: > > * We have introduce Parsoid as a local dependence, which means that even > if a Mediawiki does not have Parsoid/Visual Editor installed, mwoffliner > should have a chance now to build the ZIM file of it by running Parsoid > locally. > > * We have introduced the Parsoid mobile layout suppport which allows to > build ZIM file with a similar layout as Wikipedia Mobile version. This > is pretty much in beta and we plan first to use it only for Wikipedia.org. > > * We have introduced the support of audio/video which means that now, > like the pictures, they are mirrored too. Our first tests show that for > Wikipedia it tends to multiply the size of the ZIM file by a factor > four. As a consequence we won't use it directly everywhere. That said > the feature is there and we will step-by-step introduce video in the ZIM > files we are generating with mwoffliner. > > * We have published mwoffliner (and mwmatrixoffliner) to the npmjs > repository: https://www.npmjs.com/package/mwoffliner. Now everybody can > install it easily (but you still need to take care about the dependences). > > * We have made the script a bit more modular: you can call it like any > other program but now you can also use it as a library in your own > Javascript/Node.js scripts. > > * We have moved the git repository to the openZIM organization on > Github: https://github.com/openzim/mwoffliner. By moving all our scraper > to the openZIM organization we hope to bring a bit of clarity between > Kiwix and openZIM respective duties. Have a look to all other scrapers > we have migrated to openZIM: https://github.com/openzim > > mwoffliner is not a tool for everybody but it is really important to > continue to improve it to provide quality ZIM files of Wikipedia, > Wiktionary, ... So if you have Javascript skills please come to help us > to prepare the next big steps forward > https://github.com/openzim/mwoffliner/issues > > Regards > Emmanuel > > -- > Kiwix - Wikipedia Offline & more > * Web: http://www.kiwix.org > * Twitter: https://twitter.com/KiwixOffline > * more: http://www.kiwix.org/wiki/Communication > > -------------- next part -------------- > A non-text attachment was scrubbed... > Name: signature.asc > Type: application/pgp-signature > Size: 181 bytes > Desc: OpenPGP digital signature > > ------------------------------ > > ------------------------------------------------------------ > ------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > ------------------------------ > > Subject: Digest Footer > > _______________________________________________ > Kiwix-developer mailing list > Kiw...@li... > https://lists.sourceforge.net/lists/listinfo/kiwix-developer > > > ------------------------------ > > End of Kiwix-developer Digest, Vol 44, Issue 5 > ********************************************** > |
From: Emmanuel E. <ke...@ki...> - 2017-06-27 20:26:34
|
Hi We rarely write here specifically about mwoffliner, even if this tool is time to time named by-the-way in threads. But these last months we have done many interesting improvements to this important tool and I thought it might be valuable to report quickly about them. As a reminder, mwoffliner is a script which is thought to build a ZIM file from any (recent) online Mediawiki. It scraps a snapshot of the online wiki (HTML/JS/pictures/...) on your local disk. Here is the list of recent improvements: * We have introduce Parsoid as a local dependence, which means that even if a Mediawiki does not have Parsoid/Visual Editor installed, mwoffliner should have a chance now to build the ZIM file of it by running Parsoid locally. * We have introduced the Parsoid mobile layout suppport which allows to build ZIM file with a similar layout as Wikipedia Mobile version. This is pretty much in beta and we plan first to use it only for Wikipedia.org. * We have introduced the support of audio/video which means that now, like the pictures, they are mirrored too. Our first tests show that for Wikipedia it tends to multiply the size of the ZIM file by a factor four. As a consequence we won't use it directly everywhere. That said the feature is there and we will step-by-step introduce video in the ZIM files we are generating with mwoffliner. * We have published mwoffliner (and mwmatrixoffliner) to the npmjs repository: https://www.npmjs.com/package/mwoffliner. Now everybody can install it easily (but you still need to take care about the dependences). * We have made the script a bit more modular: you can call it like any other program but now you can also use it as a library in your own Javascript/Node.js scripts. * We have moved the git repository to the openZIM organization on Github: https://github.com/openzim/mwoffliner. By moving all our scraper to the openZIM organization we hope to bring a bit of clarity between Kiwix and openZIM respective duties. Have a look to all other scrapers we have migrated to openZIM: https://github.com/openzim mwoffliner is not a tool for everybody but it is really important to continue to improve it to provide quality ZIM files of Wikipedia, Wiktionary, ... So if you have Javascript skills please come to help us to prepare the next big steps forward https://github.com/openzim/mwoffliner/issues Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Mossroy <mo...@mo...> - 2017-06-17 14:49:46
|
Hi, I'm very glad to read that. Thanks for this positive feedback. Nightly builds are more for testers, as they might be less stable than final releases. If you want to distribute the browser extensions offline, it's probably better to use the released versions, that Emmanuel gathers in http://download.kiwix.org/bin/browsers/ (these are the same binaries as ditributed by Mozilla and Google). Even if they work pretty well with wikipedia ZIMs, you probably noticed that these browser extensions are slower, not compatible with all ZIM files, and have less features than the other Kiwix applications. We hope to improve that in the future. Recently, a few new persons started contributing on it, so hopefully it will help doing that. Regards, Mossroy Le 17/06/2017 à 00:20, Gabriel Thullen a écrit : > Hello Emmanuel, > > Thanks for keeping us up to date on the new developments. > I have tried installing the extensions on a few different machines and > there was no problem at all! I also tried it installing the extensions > from a flash drive, and it worked every time! > > It is great to have nightly builds of the Firefox & Chrome extensions > available, that way one can slip on a USB flash drive and distribute > the extensions even if there is no Internet. Real great, and that is > the whole point of Kiwix: use wikipedia without an Internet connection! > > Best regards > Gabe > > > On Fri, Jun 9, 2017 at 8:00 AM, Emmanuel Engelhart <ke...@ki... > <mailto:ke...@ki...>> wrote: > > Hi > > We just have published version 2.1.0 of our browser extensions: > > Here is the changelog: > * Add more user info on which ZIM files are compatible > * Fix for back/forward buttons in browsing history > * Drop some legacy code (Evopedia file format compatibility, > uncomplete > Cordova/Phonegap port) > * Refactoring of the code to make it more easily readable for > contributors > * Fix for unit tests on Chrome > * Enhancements on nightly builds and automatic generation of packages > for public releases > > You can download them here: > * For Firefox: > https://addons.mozilla.org/fr/firefox/addon/kiwix-offline/ > <https://addons.mozilla.org/fr/firefox/addon/kiwix-offline/> > * For Chrome: > https://chrome.google.com/webstore/detail/kiwix/donaljnlmapmngakoipdmehbfcioahhk > <https://chrome.google.com/webstore/detail/kiwix/donaljnlmapmngakoipdmehbfcioahhk> > > The development continues, so if you have bug reports - or want to > participate to the development - please have a look to > https://github.com/kiwix/kiwix-html5 > <https://github.com/kiwix/kiwix-html5>. > > Regards > Emmanuel > > -- > Kiwix - Wikipedia Offline & more > * Web: http://www.kiwix.org > * Twitter: https://twitter.com/KiwixOffline > <https://twitter.com/KiwixOffline> > * more: http://www.kiwix.org/wiki/Communication > <http://www.kiwix.org/wiki/Communication> > > > > > _______________________________________________ > http://wikimedia.ch Wikimedia CH website > Wikimediach-l mailing list > https://lists.wikimedia.org/mailman/listinfo/wikimediach-l > <https://lists.wikimedia.org/mailman/listinfo/wikimediach-l> > > > > > ------------------------------------------------------------------------------ > Check out the vibrant tech community on one of the world's most > engaging tech sites, Slashdot.org! http://sdm.link/slashdot > > > _______________________________________________ > Kiwix-developer mailing list > Kiw...@li... > https://lists.sourceforge.net/lists/listinfo/kiwix-developer |
From: Gabriel T. <ga...@th...> - 2017-06-16 22:21:00
|
Hello Emmanuel, Thanks for keeping us up to date on the new developments. I have tried installing the extensions on a few different machines and there was no problem at all! I also tried it installing the extensions from a flash drive, and it worked every time! It is great to have nightly builds of the Firefox & Chrome extensions available, that way one can slip on a USB flash drive and distribute the extensions even if there is no Internet. Real great, and that is the whole point of Kiwix: use wikipedia without an Internet connection! Best regards Gabe On Fri, Jun 9, 2017 at 8:00 AM, Emmanuel Engelhart <ke...@ki...> wrote: > Hi > > We just have published version 2.1.0 of our browser extensions: > > Here is the changelog: > * Add more user info on which ZIM files are compatible > * Fix for back/forward buttons in browsing history > * Drop some legacy code (Evopedia file format compatibility, uncomplete > Cordova/Phonegap port) > * Refactoring of the code to make it more easily readable for contributors > * Fix for unit tests on Chrome > * Enhancements on nightly builds and automatic generation of packages > for public releases > > You can download them here: > * For Firefox: https://addons.mozilla.org/fr/firefox/addon/kiwix-offline/ > * For Chrome: > https://chrome.google.com/webstore/detail/kiwix/ > donaljnlmapmngakoipdmehbfcioahhk > > The development continues, so if you have bug reports - or want to > participate to the development - please have a look to > https://github.com/kiwix/kiwix-html5. > > Regards > Emmanuel > > -- > Kiwix - Wikipedia Offline & more > * Web: http://www.kiwix.org > * Twitter: https://twitter.com/KiwixOffline > * more: http://www.kiwix.org/wiki/Communication > > > > > _______________________________________________ > http://wikimedia.ch Wikimedia CH website > Wikimediach-l mailing list > https://lists.wikimedia.org/mailman/listinfo/wikimediach-l > > |
From: Emmanuel E. <ke...@ki...> - 2017-06-15 10:55:58
|
Hi After a year a half of efforts, we are proud to announce that we have done our first delivering of ZIM files of the Stack Exchange web sites. All the ZIM files are freely available to download via the Kiwix software or directly on the Kiwix download server: http://download.kiwix.org/zim/stack_exchange/ Stack Exchange is a network of question-and-answer websites on topics in varied fields, each site covering a specific topic, where questions, answers, and users are subject to a reputation award process. This include famous web sites like Stackoverflow.com, AskUbuntu.com or Superuser.com. More information about Stack Exchange and its more than 100 web sites is available here: https://en.wikipedia.org/wiki/Stack_Exchange. This ZIM files are done thanks to regularly updated archives provided on archives.org and an ad-hoc software our team has specially developed for that purpose. This software is called "Sotoki" and his of course open source. You can have a look to the source code here https://github.com/openzim/sotoki or use it directly using Python pip packager: https://pypi.python.org/pypi/sotoki We plan to release updates of these ZIM files each time new archives will be published. Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-06-09 06:00:59
|
Hi We just have published version 2.1.0 of our browser extensions: Here is the changelog: * Add more user info on which ZIM files are compatible * Fix for back/forward buttons in browsing history * Drop some legacy code (Evopedia file format compatibility, uncomplete Cordova/Phonegap port) * Refactoring of the code to make it more easily readable for contributors * Fix for unit tests on Chrome * Enhancements on nightly builds and automatic generation of packages for public releases You can download them here: * For Firefox: https://addons.mozilla.org/fr/firefox/addon/kiwix-offline/ * For Chrome: https://chrome.google.com/webstore/detail/kiwix/donaljnlmapmngakoipdmehbfcioahhk The development continues, so if you have bug reports - or want to participate to the development - please have a look to https://github.com/kiwix/kiwix-html5. Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-05-28 09:00:45
|
Hi I announced earlier this month that we have prepared a Web ready Kiwix version ; now it has been finally published in the two main browsers app stores: * For Firefox: https://addons.mozilla.org/fr/firefox/addon/kiwix-offline/ * Fro Chrome: https://chrome.google.com/webstore/detail/kiwix/donaljnlmapmngakoipdmehbfcioahhk Even if this is only a first version and it does not provide all the features you might be used too on other versions of Kiwix, this version is a new major step to make is really easy to enjoy offline content. The development continues more active than ever, so if you have bug reports - or want to participate to the development - please have a look to https://github.com/kiwix/kiwix-html5. Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-05-10 10:29:52
|
Hi Denis thank you for your patch, could you please make pull request here: https://github.com/openzim/zimwriterfs That would make the whole handling easier. Kind regards Emmanuel On 10.05.2017 12:10, Denis 'GNUtoo' Carikli wrote: > Without that fix we have: > kiwix-serve.cpp: In function ‘ssize_t callback_reader_from_blob(void*, uint64_t, char*, size_t)’: > kiwix-serve.cpp:244:53: error: no matching function for call to ‘min(size_t&, uint64_t)’ > size_t max_size_to_set = min(max, blob->size()-pos); > > Signed-off-by: Denis 'GNUtoo' Carikli <GN...@no...> > --- > src/server/kiwix-serve.cpp | 2 +- > 1 file changed, 1 insertion(+), 1 deletion(-) > > diff --git a/src/server/kiwix-serve.cpp b/src/server/kiwix-serve.cpp > index a91511fb..874da11e 100644 > --- a/src/server/kiwix-serve.cpp > +++ b/src/server/kiwix-serve.cpp > @@ -241,7 +241,7 @@ ssize_t callback_reader_from_blob(void *cls, > { > zim::Blob* blob = static_cast<zim::Blob*>(cls); > pthread_mutex_lock(&readerLock); > - size_t max_size_to_set = min(max, blob->size()-pos); > + size_t max_size_to_set = min(max, (size_t)(blob->size()-pos)); > > if (max_size_to_set <= 0) > { > -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Denis 'G. C. <GN...@no...> - 2017-05-10 10:11:08
|
Without that fix we have: kiwix-serve.cpp: In function ‘ssize_t callback_reader_from_blob(void*, uint64_t, char*, size_t)’: kiwix-serve.cpp:244:53: error: no matching function for call to ‘min(size_t&, uint64_t)’ size_t max_size_to_set = min(max, blob->size()-pos); Signed-off-by: Denis 'GNUtoo' Carikli <GN...@no...> --- src/server/kiwix-serve.cpp | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/server/kiwix-serve.cpp b/src/server/kiwix-serve.cpp index a91511fb..874da11e 100644 --- a/src/server/kiwix-serve.cpp +++ b/src/server/kiwix-serve.cpp @@ -241,7 +241,7 @@ ssize_t callback_reader_from_blob(void *cls, { zim::Blob* blob = static_cast<zim::Blob*>(cls); pthread_mutex_lock(&readerLock); - size_t max_size_to_set = min(max, blob->size()-pos); + size_t max_size_to_set = min(max, (size_t)(blob->size()-pos)); if (max_size_to_set <= 0) { -- 2.12.2 |
From: Emmanuel E. <ke...@ki...> - 2017-05-07 12:59:33
|
Hi Last month a dozen of Kiwix developers have attend to our Spring 2017 hackathon in Lyon, France. All these developers represent the broad spectrum of Kiwix/openZIM activities, from the scrapping to the mobile apps, through core lib development. During a whole week we all have lived and worked together to help the whole project to make a significant step forward. Here is the essence of what we have achieved to do: *First Chrome extension*: this is a pure Web tech Kiwix reader. Still limited in features but working and already published on the Chrome Store https://chrome.google.com/webstore/detail/kiwix/donaljnlmapmngakoipdmehbfcioahhk. Give it a try and report any problem here: https://github.com/kiwix/kiwix-html5/issues *First Firefox extension*: sharing the same code base as the Chrome extension, it is still in validation but should be publicly available soon. Impatient users might install a "nightly" from here http://download.kiwix.org/nightly/. Both Firefox/Chrome extensions have been initiated by the project Evopedia which has merged with Kiwix last year. *Gutenberg scraper* improved: Developed 3 years ago, the original scrapper has been polished and the (big) list of tickets has been cleared. The code has been published in the Python repository https://pypi.python.org/pypi/gutenberg2zim and a Docker image has been created https://hub.docker.com/r/openzim/gutenberg/. New ZIM files are currently building and will be published soon. *First release of Sotoki*: Sotoki is our StackExchange scrapper, which means that we can now propose ZIM files of all the SE web sites https://stackexchange.com/sites. The most famous of them being StackOverflow. The script has been published in Python https://pypi.python.org/pypi/sotoki and a Docker image created https://hub.docker.com/r/openzim/sotoki/. New ZIM files are currently building and will be published soon. *Youtube scrapper has been improved*: Our Youtube scrapper has been a bit improved and published in Python repository and a Docker image has been created https://hub.docker.com/r/openzim/youtube/. *openedx scraper stub*: First step have been done, we currently search a sponsor to work on this next Summer and release a first version at Fall. *Phet scrapper UI improved*: The UI of the Phet ZIM file has been really improved. You can check it with the last versions of the files http://download.kiwix.org/zim/phet/. A docker image has been created https://hub.docker.com/r/openzim/phet/. Phets Android app will be updated in the next weeks https://play.google.com/store/apps/details?id=org.kiwix.kiwixcustomphet *Android apps*: many improvements have been brought to the apps, the most visible concerning the continuous integration and the testing. But other massive changes have been done to have a better MVC approach and bookmarking system. Many of these improvements should be visible in Kiwix for Android 2.3 to be released in June. *Fist Kiwix Apache module* has been created as an alternative of running kiwix-serve behind a reverse proxy. So far it does not provide as much features as kiwix-serve but is definitely easier to configure and really promising. Have a look to the git repository here https://github.com/kiwix/kiwix-apache *MWoffliner improved*: it benefits now from an option to scrape remote Mediawiki, even if they do not have Parsoid installed. This is an opportunity for creating many new ZIM files - and we will. MWoffliner (as a script and a library) is now also available as a node.js package https://www.npmjs.com/package/mwoffliner and we have created a Docker image https://hub.docker.com/r/openzim/mwoffliner/. We have also created a Docker image for zimwriterfs https://hub.docker.com/r/openzim/zimwriterfs/. *pibox-installer*: our intern, working on our future solution to allow everyone (also non-tech) to build there own customed offline wifi hotspot, was also part of the hackathon. He made a few progresses on his project during that week. Follow his daily work at https://framagit.org/ideascube/pibox-installer *Khan Academy video scrapper almost finished*: This effort had been started in January last year. It has been almost finished during the hackathon. A few commits more and we will be able to generate ZIM files for Khan academy videos. Please be a bit patient if you need the ZIM files, here is the git repo https://github.com/openzim/kalite *libzim improvements*: we have moved the Xapian fulltext engine technology from the Kiwix-lib to the libzim (as an option). At this occasion many improvements have been done regarding the search and the whole integration between the libzim, libkiwix and the multiple ports. *First release of zip2zim* which is a small service able to convert a custom ZIP (with HTML/JS/CSS/pictures inside) in the corresponding ZIM file. The code is available here https://github.com/openzim/zip2zim and we have already created a Docker image https://hub.docker.com/r/openzim/zip2zim/. We plan to setup an online service soon. Last but now least, the hackathon has concluded ~ 6 months long effort to reorganize all our git repositories. All the code we have ever produced and still produce is now available on GitHub in two organisations: * openZIM for the low level ZIM related readers and scrappers https://github.com/openzim/ * Kiwix for all the "high-level" Kiwix specific ports and solutions https://github.com/kiwix This was a long list, thank you for reading it to the end, but a dozen of talented and committed developers can really to a lot of work during a whole week. If you want to get a bit more details about the hackathon have a look to that page: wiki.kiwix.org/wiki/Hackathon_Spring_2017 Next one will be this summer @Wikimania in Canada/US, here is the organisation page:http://wiki.kiwix.org/wiki/Hackathon_Wikimania_2017 Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-04-17 17:33:54
|
Hi We just have released a new version of Kiwix for iOS. Here the list of improvements: * NEW: Remember scroll positions * FIX: Clear search & browsing history * FIX: few other bugs The app is available on iTunes at http://ios.kiwix.org. Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-03-07 16:53:00
|
Hi We just have released a new version of Kiwix for iOS. Here the list of improvements: * NEW: Library has a new look * NEW: Support zim files with build in index * NEW: Performance optimization * FIX: Download of big content on WIFI The app is available on iTunes at http://ios.kiwix.org. Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-03-01 16:46:44
|
Hi We just have released a new version of Kiwix for Android. Here the list of improvements: * FIX: Text To Speech issues on earlier Android versions * FIX: SD card detection in a few edge cases * FIX: Sporadic transparent menu * FIX: Download resilience and experience * FIX: Few problems with icon positions * FIX: "Night mode" for pictures * NEW: UI "night mode" * NEW: UI colors * NEW: Autohide app toolbar * NEW: Keep bookmarks over data updates The app is available on Google play at http://android.kiwix.org and the APK can also be download at http://download.kiwix.org/bin/kiwix.apk Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2017-02-16 07:23:11
|
Hi Simon On 16.02.2017 02:22, Simon wrote: > I was experimenting loading an instance of MediaWiki with one of the > Wikipedia's monthly XML dumps in order to generate the best possible > rendering of all the English Wikipedia article pages' HTML without > having to scrape Wikipedia directly. Although I got it working > reasonably I discovered I also needed an instance of Wikibase loaded > with Wikidata's data which doesn't seem to be so easily supported, and I > found your ZIM dumps instead. > > These appear to be faithful to the HTML you see on en.wikipedia.org on > the date they were generated. What MediaWiki system/setup do you use to > generate your dumps (so well)? If this is documented somewhere I > apologize but I couldn't find it. We generate the ZIM file by relying on the online Wikipedia API (mostly Parsoid/VisualEditor part). To do that we maintain a solution called mwoffliner (and also zimwriterfs) which git repo is here: https://github.com/kiwix/mwoffliner Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Simon <s_...@ya...> - 2017-02-16 01:22:45
|
Hello, I was experimenting loading an instance of MediaWiki with one of the Wikipedia's monthly XML dumps in order to generate the best possible rendering of all the English Wikipedia article pages' HTML without having to scrape Wikipedia directly. Although I got it working reasonably I discovered I also needed an instance of Wikibase loaded with Wikidata's data which doesn't seem to be so easily supported, and I found your ZIM dumps instead. These appear to be faithful to the HTML you see on en.wikipedia.org on the date they were generated. What MediaWiki system/setup do you use to generate your dumps (so well)? If this is documented somewhere I apologize but I couldn't find it. Thank you, Simon |
From: Emmanuel E. <ke...@ki...> - 2017-01-01 09:31:59
|
Hi We have released last week a new version of Kiwix for Android. Here the list of improvements: * FIX: Display of storage devices * FIX: External SD cards detection * FIX: ZIM files detection speed * FIX: Core errors handling * FIX: Save images * FIX: ZIM file deletion * FIX: Transparent action menu * FIX: ZIM opening from external file browsers * NEW: Pause/Resume TTS The app is available on Google play at http://android.kiwix.org and the APK can also be download at http://download.kiwix.org/bin/kiwix.apk Happy new year Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Andre K. <akl...@wi...> - 2016-11-07 20:23:58
|
Wikimedia is among the 17 organizations in Google Code-in (GCI) 2016! GCI starts on November 28th. It's a contest for 13-17 year old students working on small tasks and a great opportunity to let new contributors make progress and help with smaller tasks on your To-Do list! What we want you to do: BECOME A MENTOR: 1. Go to https://www.mediawiki.org/wiki/Google_Code-in_2016 and add yourself to the mentor's table. 2. Get an invitation email to register on the contest site. PROVIDE SMALL TASKS: We want your tasks in the following areas: code, outreach/research, documentation/training, quality assurance, user interface/design. Create a KiwiX task (which would take you 2-3h to complete) you'd mentor on the GCI site. Or pick an existing SourceForge task you'd mentor and create its counterpart on the GCI site. Make sure to cover expectations and deliverables in your task. And once the contest starts on Nov 28, be ready to answer and review contributions quickly. Any questions? Just ask, we're happy to help. Thank you for your help broadening our contributor base! andre -- Andre Klapper | Wikimedia Bugwrangler http://blogs.gnome.org/aklapper/ |
From: Emmanuel E. <ke...@ki...> - 2016-10-30 20:37:55
|
On 26.10.2016 02:38, xiw...@9o... wrote: > I downloaded the Wikipedia zip file > (http://download.kiwix.org/portable/wikipedia_en_all.zip > <http://s.bl-1.com/h/6wKt9mQ?url=http://download.kiwix.org/portable/wikipedia_en_all.zip>) > and unzipped it. There is an index folder with a file inside it. When I > load up the wikipedia zim inside my Linux Kiwix, Kiwix still asks me if > I want to index Wikipedia. But why would it do that if I already have > the index file? Can you load the xml file which is in data/library directory? This should fix the problem I think. Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: <xiw...@9o...> - 2016-10-26 00:38:59
|
I downloaded the Wikipedia zip file ( http://download.kiwix.org/portable/wikipedia_en_all.zip <http://s.bl-1.com/h/6wKt9mQ?url=http://download.kiwix.org/portable/wikipedia_en_all.zip>) and unzipped it. There is an index folder with a file inside it. When I load up the wikipedia zim inside my Linux Kiwix, Kiwix still asks me if I want to index Wikipedia. But why would it do that if I already have the index file? |
From: Emmanuel E. <ke...@ki...> - 2016-10-20 16:30:51
|
Hi We have finally released this week a new version of Kiwix for Android. This major release introduces many improvements which have been developed by our developers team during the last 7 months. Here the list of improvements: * NEW: Integrated download manager * NEW: user friendly content manager * NEW: Clean history * NEW: Open new tab in background - settings option * NEW: Kiwix search home screen widget * NEW: Splash Screen and improved Welcome Screen * FIXED: Opening filenames with special characters * FIXED: Useless "w820dp" language * FIXED: Failing he, id, yi locales * FIXED: Non-localised setting language list sorting * FIXED: Multiple search history problems * FIXED: Crashes with 'Twillight' app * FIXED: Full text search with split ZIM files The app is available on Google play at http://android.kiwix.org and the APK can also be download at http://download.kiwix.org/bin/kiwix.apk Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2016-10-20 15:44:28
|
Hi Denis Sorry for the late answer. On 27.09.2016 03:14, Denis 'GNUtoo' Carikli wrote: > I wanted to change kiwix's CSS (the patch to do that was attached), but > changing the source didn't result in the CSS being changed. > > After digging deeper I found that some files (like > src/common/resourceTools.h) contained array of hexes of static > resources like the CSS I wanted to change. > > Looking at the commits changing resourceTools.h didn't give me any > hints. > > Did I miss something? Is there some tools to automatically update the > hexes, or am I supposed to do it manually? > > In the later case I suppose that if I do and send patches to > integrate a tool to generate resourceTools.h, it would be welcome. Have a look to the kiwix/static directory :) Regards Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Emmanuel E. <ke...@ki...> - 2016-10-19 20:22:58
|
On 19.10.2016 21:14, xiw...@9o... wrote: > Does Kiwix store/access "Special" pages > (https://en.wikipedia.org/wiki/Special:SpecialPages > <http://s.bl-1.com/h/6j5l2Vx?url=https://en.wikipedia.org/wiki/Special:SpecialPages>), > such as the following: > > 1. What Links Here > (e.g. https://en.wikipedia.org/wiki/Special:WhatLinksHere/Folly? > <http://s.bl-1.com/h/6j5l7tz?url=https://en.wikipedia.org/wiki/Special:WhatLinksHere/Folly>) > > That "special" page has a list of all the wikipedia pages that link to > the article titled "Folly". > > 2. Categories > https://en.wikipedia.org/wiki/Special:Categories > <http://s.bl-1.com/h/6j5lCH1?url=https://en.wikipedia.org/wiki/Special:Categories> No, because: 1 - content in ZIM file is static (not dynamic) 2 - Store static version for all pages in no really interesting and it has a high cost in term of mass storage usage Emmanuel -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: <xiw...@9o...> - 2016-10-19 20:15:01
|
Does Kiwix store/access "Special" pages (https://en.wikipedia.org/ wiki/Special:SpecialPages <http://s.bl-1.com/h/6j5l2Vx?url=https://en.wikipedia.org/wiki/Special:SpecialPages>), such as the following: 1. What Links Here (e.g. https://en.wikipedia.org/wiki/Special:WhatLinksHere/Folly? <http://s.bl-1.com/h/6j5l7tz?url=https://en.wikipedia.org/wiki/Special:WhatLinksHere/Folly> ) That "special" page has a list of all the wikipedia pages that link to the article titled "Folly". 2. Categories https://en.wikipedia.org/wiki/Special:Categories <http://s.bl-1.com/h/6j5lCH1?url=https://en.wikipedia.org/wiki/Special:Categories> <http://s.bl-1.com/h/6j5lJh3?url=https://en.wikipedia.org/wiki/Special:WhatLinksHere/Folly> |
From: Emmanuel E. <ke...@ki...> - 2016-10-18 12:59:10
|
Hi The new libzim 1.4 is out: http://www.openzim.org/download/zimlib-1.4.tar.gz This new minor release brings a few improvements and bugs fixes: * NEW: speed-up article retrieval a bit * NEW: read cluster content at the last moment to avoid unnecessary I/O access * NEW: primitive cache system for not-compressed clusters (multimedia content) More information about the project openZIM and the ZIM format at: http://www.openzim.org/ Regards Emmanuel Engelhart -- Kiwix - Wikipedia Offline & more * Web: http://www.kiwix.org * Twitter: https://twitter.com/KiwixOffline * more: http://www.kiwix.org/wiki/Communication |
From: Anne G. <ag...@wi...> - 2016-10-18 10:22:25
|
Wow, congratulations to your team! And as Asaf said, thank you for your work in this area, I know it hasn't always been easier. Looking forward to 10 more years! Sent from my iPhone > On Oct 18, 2016, at 11:35 AM, Asaf Bartov <ab...@wi...> wrote: > > Dear Emmanuel, > > special thanks and appreciation to you, for your unwavering dedication to this work, in the face of many setbacks and obstacles. > > Warmly, > > Asaf > >> On Tue, Oct 18, 2016 at 12:24 PM Emmanuel Engelhart <ke...@ki...> wrote: >> Hi >> >> 10 years ago we have launched the Kiwix project to bring Wikipedia to >> people with no or a bad access to Internet. Today, we are really proud >> to see that we have achieved to do that, and even more. >> >> All of this would not have been made possible without a committed team >> of volunteers and the strong support of Wikimedia Switzerland. Thanks to >> them (and a few other ones) we have achieved to: >> * Make Wikipedia readable offline on (almost) all kind of devices >> * Provide monthly updates of all Wikimedia projects >> * Provide an open-source/standardised offline technology re-usable for >> any kind of web content with openZIM >> * Build offline versions of various projects like Gutenberg, TEDs, >> Vikidia, Youtube, ... >> >> With the additional help of dozens of partners, which spread content and >> technology in the field, we can track around 1M of users a year... and >> strongly believe this is the "tip of the iceberg". >> >> Luckily, in the last 10 years, we have done a lot of progresses in the >> Internet access. That said, around half of the world population still >> does not have an access to Internet and censorship is a raising and >> already extremely serious problem. >> >> As a consequence, we will be pretty busy in the next decade and will >> continue to improve our technology and offer always better solutions to >> read and spread free knowledge - offline. >> >> We have made a blog post about our anniversary on Wikimedia blog, please >> share it on the social networks: >> https://blog.wikimedia.org/2016/10/11/kiwix-ten-years/ >> >> Regards >> Emmanuel Engelhart >> >> -- >> Kiwix - Wikipedia Offline & more >> * Web: http://www.kiwix.org >> * Twitter: https://twitter.com/KiwixOffline >> * more: http://www.kiwix.org/wiki/Communication >> >> _______________________________________________ >> Offline-l mailing list >> Off...@li... >> https://lists.wikimedia.org/mailman/listinfo/offline-l > _______________________________________________ > Offline-l mailing list > Off...@li... > https://lists.wikimedia.org/mailman/listinfo/offline-l |