TransmogrifAI Files

Bug fixes: - Fix flaky ModelInsight tests #407 - Remove logging of tokens of text fields #420, #438, #447, #474 - Add validation prepare call before model selection when no DAG is passed #424, #429 - Fix Days.daysBetween int overflow #471

New features / updates: - Downsample the number of training samples to maxTrainingSample for regression #413 and multi-class classification #414 - Refactor InsightLOCOTest #412 - Enable more loss types for OpLinearRegression #421 - Add property-based tests for regression model selection #427 - Add option to calculate LOCO for dates/texts by leaving out their entire vector #418 - Add Chinese and Korean examples to TextTokenizerTest #442 - Add support for ignoring text that looks like IDs in SmartTextVectorizer #448, #455 - Add a unary estimator for detecting names in text fields and transforming to likely gender #445 - Allow result features to be removed by raw feature filter #458 - Metadata changes for sensitive feature information #457 - Add MinVarianceFilter which checks that computed features have a minimum variance #463, #465 - Allow TextStats length distribution to be token-based and refactor for testability #464 - Use Spark job grouping to distinguish steps of the machine learning flow #467, #468, #470 - Add categorical detection to be coverage based in addition to unique count based #473 - Remove duplicate features using sanity checker feature to feature correlations #476, #479 - Lift the upper bound on number of hash features #477 - Enable Html stripping on text-like features #478

Dependency updates (#402, #466): - Update Apache Spark version to 2.4.5 - Avro is a built-in data source in Spark 2.4, so no longer using the spark-avro package - Avro to 1.8.2 - XGBoost to 0.90 - MLeap to 0.14.0 - json4s to 3.5.3 - JUnit to 4.12 - chill to 0.9.3 - gradle-avro-plugin to 0.16.0

Miscellaneous: - Add ROADMAP.md #394