Zingg Files

Lots of goodies in this release - python interface, stop words, new match types

What's Changed

• Extract Stop words by @navinrathore in https://github.com/zinggAI/zingg/pull/186
• CI: Executing maven compile at each commit by @edmondo1984 in https://github.com/zinggAI/zingg/pull/189
• Introduce CodeQL pipeline on each commit by @edmondo1984 in https://github.com/zinggAI/zingg/pull/190
• New InMemoryPipe has been added by @navinrathore in https://github.com/zinggAI/zingg/pull/209
• Changes to support databases that use Jdbc driver by @navinrathore in https://github.com/zinggAI/zingg/pull/214
• Data processing for Stop Words removal by @navinrathore in https://github.com/zinggAI/zingg/pull/191
• MatchType 'DONOT USE' updated in the docs and TC added by @navinrathore in https://github.com/zinggAI/zingg/pull/222
• Added new format 'bigquery' by @navinrathore in https://github.com/zinggAI/zingg/pull/233
• Documentation for BigQuery connector by @navinrathore in https://github.com/zinggAI/zingg/pull/236
• Renamed ZINGG_ARGS_EXTRA to ZINGG_EXTRA_SPARK_CONF and ZINGG_EXTRA to ZINGG_EXTRA_JARS. by @navinrathore in https://github.com/zinggAI/zingg/pull/239
• Setting-Up Zingg Development Environment by @Aditya-R-Chakole in https://github.com/zinggAI/zingg/pull/240
• Documenter refactoring and handling error 'Path does not exist' by @navinrathore in https://github.com/zinggAI/zingg/pull/223
• Bump jackson-databind from 2.10.0 to 2.12.6.1 in client/pom.xml by @navinrathore in https://github.com/zinggAI/zingg/pull/195
• Bump poi-scratchpad from 3.16 to 5.2.1 in /client by @dependabot in https://github.com/zinggAI/zingg/pull/167
• From original data, select fields whose definition is provided in config to be written in output by @navinrathore in https://github.com/zinggAI/zingg/pull/217
• Removed dependencies of snowflake, mysql, cassandra, elastic, apache-poi, log4j from pom by @navinrathore in https://github.com/zinggAI/zingg/pull/248
• Exception handling in PipeUtil::read() by @navinrathore in https://github.com/zinggAI/zingg/pull/229
• Z columns doc to have different template. by @navinrathore in https://github.com/zinggAI/zingg/pull/257
• GenerateDocs becomes independent of Data by @navinrathore in https://github.com/zinggAI/zingg/pull/270
• Working with StopWord file if its header does not include the column 'StopWord' by @navinrathore in https://github.com/zinggAI/zingg/pull/274
• specify path for ZINGG_HOME by @chetan453 in https://github.com/zinggAI/zingg/pull/280
• Updated installation document to install maven using sudo apt by @navinrathore in https://github.com/zinggAI/zingg/pull/282
• blockSize - a new config paramter for max size of the block by @navinrathore in https://github.com/zinggAI/zingg/pull/272
• moved getRecords & setRecords from InMemoryPipe to Pipe by @chetan453 in https://github.com/zinggAI/zingg/pull/286
• Revert "moved getRecords & setRecords from InMemoryPipe to Pipe" by @sonalgoyal in https://github.com/zinggAI/zingg/pull/288
• Revert "Revert "moved getRecords & setRecords from InMemoryPipe to Pipe"" by @sonalgoyal in https://github.com/zinggAI/zingg/pull/294
• resolved errors by @chetan453 in https://github.com/zinggAI/zingg/pull/293
• Match type pin code by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/290
• Removed EMAIL, LICENSE, SPARK_MEM and elastic references from zingg.sh by @navinrathore in https://github.com/zinggAI/zingg/pull/253
• Match type email by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/291
• Documenter testcases by @navinrathore in https://github.com/zinggAI/zingg/pull/281
• More blocking functions by @navinrathore in https://github.com/zinggAI/zingg/pull/292
• Checking if default zinggDir exists else create it by @navinrathore in https://github.com/zinggAI/zingg/pull/297
• moved config files for junits by @chetan453 in https://github.com/zinggAI/zingg/pull/298
• support for python phases in zingg.sh by @navinrathore in https://github.com/zinggAI/zingg/pull/301
• release 0.3.4 by @navinrathore in https://github.com/zinggAI/zingg/pull/305
• Python User script support in zingg.sh by @navinrathore in https://github.com/zinggAI/zingg/pull/311
• python unit at compilation time by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/318
• Updates in Python classes and 'assessModel' python phase by @navinrathore in https://github.com/zinggAI/zingg/pull/313
• env variables can be defined in zingg.conf in addition to spark properties by @navinrathore in https://github.com/zinggAI/zingg/pull/303
• new phase PeekModel by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/319
• added api,python,config dirs into distribution package by @navinrathore in https://github.com/zinggAI/zingg/pull/323
• added csv for testPeekModel by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/324
• new python phase exportModel by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/325
• API chnages issue part 2,4,5 by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/326
• rename matchtype dont use to dont_use by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/328
• modified TestDSUtil by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/331
• Python API - Specialized Pipes for SnowFlake, BigQuery etc. by @navinrathore in https://github.com/zinggAI/zingg/pull/327
• formatting of help message by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/332
• Documenter changes issue [#335] by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/343
• pip package artifects by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/344
• Revert "release 0.3.4" by @sonalgoyal in https://github.com/zinggAI/zingg/pull/345
• zingg pip package artifacts modification by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/356
• Null Pointer check in "Range" hash functions by @navinrathore in https://github.com/zinggAI/zingg/pull/350
• proper handling of case when zingg config file does not exit by @navinrathore in https://github.com/zinggAI/zingg/pull/358
• python api dir deleted and moved FebrlExample.py by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/362
• Removed test involving reading generated file by @navinrathore in https://github.com/zinggAI/zingg/pull/368
• To fix Databrics UserWarning: DataFrame constructor is internal... by @navinrathore in https://github.com/zinggAI/zingg/pull/373
• getUnmarkedRecords() - updated to the version with correct functionality and fixed its name by @navinrathore in https://github.com/zinggAI/zingg/pull/372
• inmemorypipe accepts pandas df by @navinrathore in https://github.com/zinggAI/zingg/pull/376
• fixed the broken link for pipes.md by @shefalika-thapa in https://github.com/zinggAI/zingg/pull/381
• Tests for getAs() for Double, Integer types by @navinrathore in https://github.com/zinggAI/zingg/pull/375
• python examples by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/382
• python api doc by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/385
• Added specific pipes property constants by @navinrathore in https://github.com/zinggAI/zingg/pull/374
• testWriteArgumentObjectToJSONFile class modification by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/387
• Double similarity function - null pointer exception by @navinrathore in https://github.com/zinggAI/zingg/pull/369
• manofest.in changes- only add febrl and amazonGoogle example by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/394
• modification for jar and deps issue [#308] by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/398
• added stopword functionality in zingg FieldDefinition by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/392
• recommender phase issue [#336] by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/399
• TCs for String Similarity Distance function by @navinrathore in https://github.com/zinggAI/zingg/pull/371
• added python script to run all with febrl example python unittest by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/395
• Csvpipe by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/402
• mdification according to pipes changes by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/405
• Pipe by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/406
• testGetAs changes by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/410
• Pipes changes issue [#401] by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/411
• Revert "Pipe" by @sonalgoyal in https://github.com/zinggAI/zingg/pull/412
• setStopword changes by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/413
• Removed Format type by @RavirajBaraiya in https://github.com/zinggAI/zingg/pull/409

New Contributors

• @edmondo1984 made their first contribution in https://github.com/zinggAI/zingg/pull/189
• @Aditya-R-Chakole made their first contribution in https://github.com/zinggAI/zingg/pull/240
• @chetan453 made their first contribution in https://github.com/zinggAI/zingg/pull/280
• @RavirajBaraiya made their first contribution in https://github.com/zinggAI/zingg/pull/290
• @shefalika-thapa made their first contribution in https://github.com/zinggAI/zingg/pull/381

Full Changelog: https://github.com/zinggAI/zingg/compare/v0.3.3...v0.3.4