Unverified50% confidenceBenchmarkExact time
单卡RTX 4090跑4Bit量化的通义千问3-27B约每秒生成49个字
1
Sources
50%
Confidence
Medium-term (~90 days)
Relevance
8/27/2026
First Seen
Valid until: 11/25/2026
Sources
Related Entities
Related Claims
Unverified128K长度的序列所需的注意力计算量是4K长度序列的1024倍72% similarUnverified将1536维向量分解为16个96维子空间、每个子空间使用256个码字，则整个向量仅需16字节表示，压缩比高达384:1，每次距离计算只需16次查表操作70% similarUnverifiedSymbol achieves a performance of an average of 250 milliseconds to index a single repository and only 1.5 milliseconds per query.70% similarUnverifiedWhen running at 1-bit precision on an M2 Max equipped with 96GB of VRAM, generation speed for simple tasks is consistently around 28–30 tokens/second68% similarVerifiedAt a baud rate of 9600, UART can transmit approximately 960 bytes per second (each byte requires 10 bits: 1 start bit + 8 data bits + 1 stop bit).68% similar
Cite This Claim
Stable URI
https://kongchang.com/claim/810112API
curl https://kongchang.com/api/v1/knowledge/claims/810112MCP
get_claim(id=810112)