Text2vec Files

Text to Vector, Get Sentence Embeddings

This is an exact mirror of the Text2vec project, hosted at https://github.com/shibing624/text2vec. SourceForge is not affiliated with Text2vec.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
Parent folder
README.md	2023-06-19	3.7 kB	0
v1.2.1 source code.tar.gz	2023-06-19	2.1 MB	0
v1.2.1 source code.zip	2023-06-19	2.2 MB	0
Totals: 3 Items		4.3 MB	0

v1.2.1

更新了中文匹配模型shibing624/text2vec-base-chinese-nli为新版shibing624/text2vec-base-chinese-sentence，针对CoSENT的loss计算对排序敏感特点，人工挑选shibing624/nli-zh-all并整理出高质量的有相关性排序的STS数据集shibing624/nli-zh-all/text2vec-base-chinese-sentence-dataset，在各评估集表现相对之前有提升；
发布了适用于s2p的中文匹配模型shibing624/text2vec-base-chinese-paraphrase

Release Models

本项目release模型的中文匹配评测结果：

Arch	BaseModel	Model	ATEC	BQ	LCQMC	PAWSX	STS-B	SOHU-dd	SOHU-dc	Avg	QPS
Word2Vec	word2vec	w2v-light-tencent-chinese	20.00	31.49	59.46	2.57	55.78	55.04	20.70	35.03	23769
SBERT	xlm-roberta-base	sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2	18.42	38.52	63.96	10.14	78.90	63.01	52.28	46.46	3138
Instructor	hfl/chinese-roberta-wwm-ext	moka-ai/m3e-base	41.27	63.81	74.87	12.20	76.96	75.83	60.55	57.93	2980
CoSENT	hfl/chinese-macbert-base	shibing624/text2vec-base-chinese	31.93	42.67	70.16	17.21	79.30	70.27	50.42	51.61	3008
CoSENT	hfl/chinese-lert-large	GanymedeNil/text2vec-large-chinese	32.61	44.59	69.30	14.51	79.44	73.01	59.04	53.12	2092
CoSENT	nghuyong/ernie-3.0-base-zh	shibing624/text2vec-base-chinese-sentence	43.37	61.43	73.48	38.90	78.25	70.60	53.08	59.87	3089
CoSENT	nghuyong/ernie-3.0-base-zh	shibing624/text2vec-base-chinese-paraphrase	44.89	63.58	74.24	40.90	78.93	76.70	63.30	63.08	3066

为测评模型的鲁棒性，加入了未训练过的SOHU测试集，用于测试模型的泛化能力，SOHU数据集 https://huggingface.co/datasets/shibing624/sts-sohu2021

Full Changelog: https://github.com/shibing624/text2vec/compare/1.2.0...1.2.1

Source: README.md, updated 2023-06-19

Other Useful Business Software

Our Free Plans just got better! | Auth0 Icon

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure Icon

Stop Cyber Threats with VM-Series Next-Gen Firewall on Azure

Native application identity and user-based security for your Azure cloud

Gain integrated visibility across all traffic in a single pass. Deploy Palo Alto Networks VM-Series to determine application identity and content while automating security policy updates via rich APIs.

Get a free trial

Our Free Plans just got better! | Auth0

With up to 25k MAUs and unlimited Okta connections, our Free Plan lets you focus on what you do best—building great apps.

You asked, we delivered! Auth0 is excited to expand our Free and Paid plans to include more options so you can focus on building, deploying, and scaling applications without having to worry about your security. Auth0 now, thank yourself later.

Try free now

Recommended Projects

Universal Sentence Encoder
Encoder of greater-than-word length text trained on a variety of data
FOSS license
FOSS license and sentence token
NLP
Open source NLP guide with models, methods, and real use cases
amrlib
A python library that makes AMR parsing, generation and visualization
Bert-VITS2
VITS2 backbone with multilingual-bert