ParlAI Files

New Releases

• SeeKeR project code and models release (#4447, [#4458], [#4449], [#4453], [#4448])
• User Simulators and Task Oriented Dialogue support (#4437, [#4438], [#4188], [#4187], [#4189], [#4186], [#4185], [#4184], [#4183], [#4249], [#4174], [#4181], [#4182], [#4180], [#4178], [#4233])
• Per Turn evaluation project code release (#4304, [#4323], [#4333], [#4362])
• SaFeRDialogues dataset and model release (#4229, [#4300])
• Am I Me or You project code release (#4239, [#4252], [#4250])
• K2R Project release(#4251)

New Features

• Updating to Mephisto 1.0 (#4426)
• [TGA]
• More flexible token metadata logging (#4169, [#4427])
• Record avg generation length (#4295)
• change tga default to not sort (#4138)
• Add a small example Flask server (#4433)
• Add support for WorldLoggers in training (#4369)
• [T5] Support Distributed Training (#4434)
• [HuggingFace] Add support for any GPT-2 model hosted in Huggingface (#4360), and ranking (#4326)
• [Crowdsourcing]
• [ACUTE-Eval] Add support for knowledgeable question (#4416), interestingness question (#4113)
• [ACUTE-Eval] Record start and end times (#4208)
• [Model chat] allow multiple final ratings (#4276)
• [Model chat] allow spacing out of annotation buckets (#4275)
• Allow Use of external database in crowdsourcing code (#4272)
• Allow specification of blueprints from command line (#4254)
• Unify turn annotation tasks (model chat and turn annotations static tasks) (#4162)
• [ACUTE-Eval] Save worker name in Acute-Eval analysis script (#4126)
• [RAG/FiD/BB2]
• [All] Incremental Decoding (#4088)
• [BB2] Allow hybrid mode (skip search when needed) (#4221)
• [FiD] Add specialized chunking to search engine retrievers (#4227)
• [BB2] Support for gold docs training (#4163)
• [FiD] Gold retrieved documents FiD Agent. (#4123)
• Export memories to the observation output (#4040)
• [Style-Controlled Generation] OSS Second Classifier (#4380)
• [Re-ranker] Support for a classifier re-ranker agent (#4291)
• [TCA] return candidates (#4286)
• Curated response generators (#4197)
• [Chat Services] add option for host specification (#4335)

Bug fixes

• [TCA] Various updates and fixes (#4287, [#4406], [#4270])
• [BlenderBot2] Various updates and fixes (#4379, [#4428], [#4419], [#4331], [#4377], [#4366], [#4289], [#4259], [#4238], [#4212], [#4198], [#4156])
• [TorchAgent] Fix an issue with warmup updates not working properly (introduced after 1.5.1) (#4384, [#4242], [#4196])
• [RAG/FiD] various updates and fixes (#4436, [#4361], [#4389], [#4207], [#4199], [#4146])
• [GPT2] misc. Fixes (#4395)
• [Train Model] Fixes train_model worldlogging for multitask with mutators. (#4414)
• [Crowdsourcing] various updates and fixes (#4413, [#4273], [#4274], [#4089])
• [Re-ranker] Bubble up all batch fields (#4296)
• Fix clobbering issues with WandB & Tensorboard requeueing (#4175, [#4093])
• Fix interactive web (#4140)
• Several misc. fixes (#4459, [#4403], [#4386], [#4439], [#4425], [#4021], [#4218], [#4164])

Datasets & Teachers & Mutators

• Relicense several parlai datasets as commercially friendly (#4269, [#4213], [#4126])
• LLLC, a large chinese dataset (#4325)
• Casino dataset (#4129)
• Upgrade internals of several teachers: WoW (#4284), Empathetic Dialogues (#4405), Natural Questions (#4205)
• WoW and WoI mutators (#4418, [#4204], [#4168], [#4124], [#4125], [#4122], [#4114])
• Speed up the json teachers (#4404)
• XPersona Dataset (#4314)
• ConversationTeacher parent class is now ParlAIDialogTeacher (#4256)
• [WizInt] Additional knowledge-related eval metrics (#4193); turn dicts to Messages (#4144)

Developers

• Various documentation improvements (#4423, [#4352], [#4375], [#4074], [#4172], [#4423], [#4100], [#4385]. [#4349], [#4298], [#4297], [#4217], [#4173], [#4133], [#4120], [#4028], [#4104], [#4102])
• Various test improvements and fixes (#4442, [#4375], [#4311], [#4271], [#4435], [#4343], [#4236], [#4261], [#4223], [#4224], [#4096], [#4315], [#4253], [#4190])
• Various dependency bumps (#4464, [#4463], [#4420], [#4351], [#4348], [#4346], [#4337], [#4317], [#4302], [#4299], [#4301]) Other QOL Improvements (#4095)