What's Changed

• 【开源实习】Speech2Text模型迁移 by @imeet000 in https://github.com/mindspore-lab/mindnlp/pull/1725
• 【开源实习】Unispeech模型迁移 by @liuyifan123123 in https://github.com/mindspore-lab/mindnlp/pull/1722
• Fix typing mistakes in documentation by @Yashbhatt786 in https://github.com/mindspore-lab/mindnlp/pull/1740
• support O2 on OrangePi, tinyllama 450ms -> 160ms by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1744
• fix no_grad state error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1754
• avoid lack of cumsum operator on OrangePi by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1755
• fix enable_grad by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1757
• fix name for nn.Linear by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1758
• fix nll_loss casued backward error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1759
• fix out_channels of Linear by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1760
• add toc in readme.md by @adarsh-jha-dev in https://github.com/mindspore-lab/mindnlp/pull/1746
• safe_load_file use mmap to speedup by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1763
• fix from_numpy caused error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1765
• fix llama embedding by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1774
• upgrade wav2vec by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1776
• update nn.utils.parametrizations by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1777
• fix sew and sew_d by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1782
• fix whisper ut by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1786
• fix llava on Ascend by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1788
• fix mixtral ut by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1790
• fix gamma on CPU and GPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1791
• 【开源之夏】add dpo trainer and support dpo training for mindnlp by @Trace2333 in https://github.com/mindspore-lab/mindnlp/pull/1701
• 【开源实习】GPT-J-6B模型应用开发 by @LuMH1027 in https://github.com/mindspore-lab/mindnlp/pull/1742
• 【开源实习】ImageGPT模型应用开发 by @Helloyouth2022 in https://github.com/mindspore-lab/mindnlp/pull/1700
• 【开源实习】X_CLIP模型应用开发 by @dyedd in https://github.com/mindspore-lab/mindnlp/pull/1694
• 【开源实习】UPerNet模型应用开发 by @Maysixi in https://github.com/mindspore-lab/mindnlp/pull/1717
• update whisper stream by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1796
• 【开源实习】multilayer_perceptron_lora模型微调 by @barryyfli in https://github.com/mindspore-lab/mindnlp/pull/1749
• dino应用开发 by @LuMH1027 in https://github.com/mindspore-lab/mindnlp/pull/1797
• support depth_estimation & doc_qa by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1800
• support fill_mask/image_classification/image_feature_extraction pipelines by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1801
• init mimm & move tests folder by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1804
• fix per_gpu args by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1809
• add mindspore infer function patch by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1810
• fix sync parallel and support low_cpu_mem_usage by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1814
• 【开源实习】dpt模型应用开发 by @yegoling in https://github.com/mindspore-lab/mindnlp/pull/1813
• 【开源实习】LayoutLMv2模型应用开发 by @Helloyouth2022 in https://github.com/mindspore-lab/mindnlp/pull/1805
• 【开源实习】BERT模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1781
• 【开源实习】peft_adalora_seq2seq模型微调 by @liuyifan123123 in https://github.com/mindspore-lab/mindnlp/pull/1747
• 【开源实习】Vision Transformer模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1643
• 【开源实习】SegFormer模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1663
• 【开源实习】BEiT模型应用开发 by @somecatw in https://github.com/mindspore-lab/mindnlp/pull/1680
• 【开源实习】SAM模型应用开发 by @KhunLounZai in https://github.com/mindspore-lab/mindnlp/pull/1688
• Update prompt_direct.txt by @YadlaMani in https://github.com/mindspore-lab/mindnlp/pull/1732
• fix:解决minicpm未注册问题 by @ResDream in https://github.com/mindspore-lab/mindnlp/pull/1821
• Module support H2D move by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1831
• fix low_cpu_mem_usage(contguous) by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1832
• value_and_grad support attacach grads, Parameter support accumulate a… by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1833
• fix update_and_allocate by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1834
• value_and_grad support kwargs by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1835
• 修复blip推理报错 by @confused666 in https://github.com/mindspore-lab/mindnlp/pull/1838
• fix roll on CPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1840
• deprecated mindnlp.transformers.optimization by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1841
• fix optimizer args as same dtype on GPU by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1842
• image_classification_timm_peft_lora模型微调 by @chenxinxi in https://github.com/mindspore-lab/mindnlp/pull/1830
• 【开源实习】 MobileViTV2 模型迁移 by @oucfm in https://github.com/mindspore-lab/mindnlp/pull/1850
• 重做deepseek_v2模型并补注册 by @ShangJingLi in https://github.com/mindspore-lab/mindnlp/pull/1859
• fix: Fix problem using ops.ones in BigBird by @reeered in https://github.com/mindspore-lab/mindnlp/pull/1861

• benchmark: add GLUE-QNLI benchmark, including 10 models inference accuracy comparsion by @xuhangscut in https://github.com/mindspore-lab/mindnlp/pull/1865

• fix benchmark GLUE-QNLI fix read_csv error and predict funciton and modify readme description by @xuhangscut in https://github.com/mindspore-lab/mindnlp/pull/1868

• feat: add data parallel of native mindspore to mindnlp.Trainer.base by @Tridu33 in https://github.com/mindspore-lab/mindnlp/pull/1852
• Revert "image_classification_timm_peft_lora模型微调" by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1871
• add minicpm3 model and dynmaic inference demo by @xing-yiren in https://github.com/mindspore-lab/mindnlp/pull/1870
• fix baichuan finfo error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1872
• fix sbert precision problem on mindnlp.sentence by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1873
• fix cell_ to module_ in mindnlp.peft by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1874
• fix cells to modules in mindnlp.peft by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1875
• fix named_modules by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1877
• fix sbert normalize_embeddings by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1879
• 【开源实习】MindSpore自定义RWKV算子开发（Python接口实现） by @EliwiiKeeya in https://github.com/mindspore-lab/mindnlp/pull/1862
• fix llama and baichuan typo by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1883
• update core.ops with pyboost by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1884
• fix pytest error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1885
• fix mobilebert register by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1890
• feat: add file lock for remote files download to local path when multiple thread environment. by @Tridu33 in https://github.com/mindspore-lab/mindnlp/pull/1887
• fix ia3 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1891
• expose prob as positional argument for bernoulli ops by @qhzhuang in https://github.com/mindspore-lab/mindnlp/pull/1949
• fix model llama for split function in line 852 by @zhuizhuzheming in https://github.com/mindspore-lab/mindnlp/pull/1941
• fix TensorPy for mindspore 2.5 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1961
• fix TensorPy init empty Tensor by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1962
• fix Blip2加载和推理bug [#1902] [#1904] [#1905] by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1958
• 【开源实习】Mask2Former模型应用开发 by @linrx-ctrl in https://github.com/mindspore-lab/mindnlp/pull/1770
• 【开源实习】TAPAS模型应用开发 by @sjtu-weimang in https://github.com/mindspore-lab/mindnlp/pull/1839
• 【开源实习】MaskFormer模型应用开发 by @linrx-ctrl in https://github.com/mindspore-lab/mindnlp/pull/1864
• 【开源实习】YOLOS模型应用开发 by @chenxinxi in https://github.com/mindspore-lab/mindnlp/pull/1867
• 【开源实习】bert_japanese模型微调 by @zhuyuhua1 in https://github.com/mindspore-lab/mindnlp/pull/1892
• 【开源实习】bloom模型微调 by @guyueyuan in https://github.com/mindspore-lab/mindnlp/pull/1907
• 【开源实习】bert_generation模型微调 by @guyueyuan in https://github.com/mindspore-lab/mindnlp/pull/1911
• 【开源实习】bertweet模型微调 by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1964
• 【开源实习】blip_2模型微调 by @Alemax067 in https://github.com/mindspore-lab/mindnlp/pull/1965
• ViTMAE模型应用开发 by @1hb6s7t in https://github.com/mindspore-lab/mindnlp/pull/1956
• fix mindspore2.5-2.6 caused error by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1985
• load safetensor back to numpy by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1986
• support triton self-defined op by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1990
• 开源实习 BEiT 模型微调 by @4everImmortality in https://github.com/mindspore-lab/mindnlp/pull/1975
• 【开源实习】blenderbot模型微调 by @ZhFuGui in https://github.com/mindspore-lab/mindnlp/pull/1978
• 【开源实习】blenderbot_small模型微调 by @outbreak-sen in https://github.com/mindspore-lab/mindnlp/pull/1980
• fix bugs for ms2.5 by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1991
• Fix incorrect import quick_start.md by @XueyanZhang in https://github.com/mindspore-lab/mindnlp/pull/1987
• use new safetensors loader by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1992
• fix ops.max by @lvyufeng in https://github.com/mindspore-lab/mindnlp/pull/1993
• 【开源实习】Bigbird pegasus模型微调 by @outbreak-sen in https://github.com/mindspore-lab/mindnlp/pull/1994

New Contributors

• @imeet000 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1725
• @Yashbhatt786 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1740
• @adarsh-jha-dev made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1746
• @Trace2333 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1701
• @Helloyouth2022 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1700
• @dyedd made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1694
• @yegoling made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1813
• @KhunLounZai made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1781
• @somecatw made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1680
• @YadlaMani made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1732
• @confused666 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1838
• @chenxinxi made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1830
• @oucfm made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1850
• @reeered made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1861
• @xuhangscut made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1865
• @Tridu33 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1852
• @EliwiiKeeya made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1862
• @zhuizhuzheming made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1941
• @Alemax067 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1958
• @sjtu-weimang made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1839
• @zhuyuhua1 made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1892
• @guyueyuan made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1907
• @ZhFuGui made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1978
• @XueyanZhang made their first contribution in https://github.com/mindspore-lab/mindnlp/pull/1987

Full Changelog: https://github.com/mindspore-lab/mindnlp/compare/v0.4.0...v0.4.1