LexVecAlexandre Salle
|
Step 3.5 FlashStepFun
|
|||||
Related Products
|
||||||
About
LexVec is a word embedding model that achieves state-of-the-art results in multiple natural language processing tasks by factorizing the Positive Pointwise Mutual Information (PPMI) matrix using stochastic gradient descent. This approach assigns heavier penalties for errors on frequent co-occurrences while accounting for negative co-occurrences. Pre-trained vectors are available, including a common crawl dataset with 58 billion tokens and 2 million words in 300 dimensions, and an English Wikipedia 2015 + NewsCrawl dataset with 7 billion tokens and 368,999 words in 300 dimensions. Evaluations demonstrate that LexVec matches or outperforms other models like word2vec in terms of word similarity and analogy tasks. The implementation is open source under the MIT License and is available on GitHub.
|
About
Step 3.5 Flash is an advanced open source foundation language model engineered for frontier reasoning and agentic capabilities with exceptional efficiency, built on a sparse Mixture of Experts (MoE) architecture that selectively activates only about 11 billion of its ~196 billion parameters per token to deliver high-density intelligence and real-time responsiveness. Its 3-way Multi-Token Prediction (MTP-3) enables generation throughput in the hundreds of tokens per second for complex multi-step reasoning chains and task execution, and it supports efficient long contexts with a hybrid sliding window attention approach that reduces computational overhead across large datasets or codebases. It demonstrates robust performance on benchmarks for reasoning, coding, and agentic tasks, rivaling or exceeding many larger proprietary models, and includes a scalable reinforcement learning framework for consistent self-improvement.
|
|||||
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
Platforms Supported
Windows
Mac
Linux
Cloud
On-Premises
iPhone
iPad
Android
Chromebook
|
|||||
Audience
Computational linguists and NLP researchers searching for a tool to improve their semantic analysis and language modeling
|
Audience
Developers, researchers, and AI engineers who want a powerful open source foundational AI model capable of fast, deep reasoning, coding assistance, and agentic task execution
|
|||||
Support
Phone Support
24/7 Live Support
Online
|
Support
Phone Support
24/7 Live Support
Online
|
|||||
API
Offers API
|
API
Offers API
|
|||||
Screenshots and Videos |
Screenshots and Videos |
|||||
Pricing
Free
Free Version
Free Trial
|
Pricing
Free
Free Version
Free Trial
|
|||||
Reviews/
|
Reviews/
|
|||||
Training
Documentation
Webinars
Live Online
In Person
|
Training
Documentation
Webinars
Live Online
In Person
|
|||||
Company InformationAlexandre Salle
Brazil
github.com/alexandres/lexvec
|
Company InformationStepFun
Founded: 2023
China
static.stepfun.com/blog/step-3.5-flash/
|
|||||
Alternatives |
Alternatives |
|||||
|
|
||||||
|
|
|
|||||
|
|
|
|||||
|
|
|
|||||
Categories |
Categories |
|||||
Integrations
GitHub
Hugging Face
ModelScope
arXiv
|
||||||
|
|
|