Bug Issue 882 Kvcache Aiktransformers Github

[Bug] · Issue #882 · kvcache-ai/ktransformers · GitHub
[Bug] · Issue #882 · kvcache-ai/ktransformers · GitHub
[Bug] module 'flashinfer' has no attribute 'mla' · Issue #792 · kvcache ...
[Bug] module 'flashinfer' has no attribute 'mla' · Issue #792 · kvcache ...
[Bug] 模型推理过程出现nan · Issue #885 · kvcache-ai/ktransformers · GitHub
[Bug] 模型推理过程出现nan · Issue #885 · kvcache-ai/ktransformers · GitHub
[Bug] 性能似乎有所下降 · Issue #1021 · kvcache-ai/ktransformers · GitHub
[Bug] 性能似乎有所下降 · Issue #1021 · kvcache-ai/ktransformers · GitHub
[Bug] 模型加载后内存占用极低,运行速度慢 · Issue #1174 · kvcache-ai/ktransformers · GitHub
[Bug] 模型加载后内存占用极低,运行速度慢 · Issue #1174 · kvcache-ai/ktransformers · GitHub
[Bug] Cascade Lake架构不支持AVX512VPOPCNTDQ,0.2.3编译失败 · Issue #829 · kvcache ...
[Bug] Cascade Lake架构不支持AVX512VPOPCNTDQ,0.2.3编译失败 · Issue #829 · kvcache ...
[Bug] 运行 KT 0.3.2 版本时出错,KeyError: 'disk_path' · Issue #1460 · kvcache ...
[Bug] 运行 KT 0.3.2 版本时出错,KeyError: 'disk_path' · Issue #1460 · kvcache ...
[Bug] compile error · Issue #1228 · kvcache-ai/ktransformers · GitHub
[Bug] compile error · Issue #1228 · kvcache-ai/ktransformers · GitHub
[Bug] 海光DCU运行中模型胡言乱语 · Issue #992 · kvcache-ai/ktransformers · GitHub
[Bug] 海光DCU运行中模型胡言乱语 · Issue #992 · kvcache-ai/ktransformers · GitHub
[Bug] v0.2.4post1 runs, but does not open port · Issue #1056 · kvcache ...
[Bug] v0.2.4post1 runs, but does not open port · Issue #1056 · kvcache ...
[Bug] 在Ubuntu下编译失败 · Issue #1192 · kvcache-ai/ktransformers · GitHub
[Bug] 在Ubuntu下编译失败 · Issue #1192 · kvcache-ai/ktransformers · GitHub
[Bug] 在运行ktransformers/server/main.py脚本时报错 · Issue #878 · kvcache-ai ...
[Bug] 在运行ktransformers/server/main.py脚本时报错 · Issue #878 · kvcache-ai ...
[Bug] When I run bash install.sh, this error kept appearing · Issue ...
[Bug] When I run bash install.sh, this error kept appearing · Issue ...
[BUG] Multiple GPUs report errors during conversations · Issue #718 ...
[BUG] Multiple GPUs report errors during conversations · Issue #718 ...
[Bug] met "undefined symbol: _ZN21PageAlignedMemoryPool5debugEv" issue ...
[Bug] met "undefined symbol: _ZN21PageAlignedMemoryPool5debugEv" issue ...
[Bug] KT 0.3.2版本 运行Kimi-K2-Instruct-UD-IQ2_XXS 能加载模型,进入对话框后报错。 · Issue ...
[Bug] KT 0.3.2版本 运行Kimi-K2-Instruct-UD-IQ2_XXS 能加载模型,进入对话框后报错。 · Issue ...
[Bug] 不支持海光DCU K100A (gfx928) · Issue #984 · kvcache-ai/ktransformers ...
[Bug] 不支持海光DCU K100A (gfx928) · Issue #984 · kvcache-ai/ktransformers ...
[Bug] L20->RuntimeError: FlashInfer requires sm75+ · Issue #1082 ...
[Bug] L20->RuntimeError: FlashInfer requires sm75+ · Issue #1082 ...
[Bug] cant rebuild KT0.2.4 · Issue #1018 · kvcache-ai/ktransformers ...
[Bug] cant rebuild KT0.2.4 · Issue #1018 · kvcache-ai/ktransformers ...
[Bug] 缓存未释放导致达到一定推理次数后推理速度降低 · Issue #805 · kvcache-ai/ktransformers ...
[Bug] 缓存未释放导致达到一定推理次数后推理速度降低 · Issue #805 · kvcache-ai/ktransformers ...
[Bug] 2张2080TI 用KLinearTorch 的形式运行,聊天报错 · Issue #1151 · kvcache-ai ...
[Bug] 2张2080TI 用KLinearTorch 的形式运行,聊天报错 · Issue #1151 · kvcache-ai ...
[Bug] 在双路6530+1TB DRAM上启用NUMA支持时发生OOM · Issue #1147 · kvcache-ai ...
[Bug] 在双路6530+1TB DRAM上启用NUMA支持时发生OOM · Issue #1147 · kvcache-ai ...
Network Graph · kvcache-ai/ktransformers · GitHub
Network Graph · kvcache-ai/ktransformers · GitHub
[Bug] ktransformers:v0.2.4post1-AVX2镜像版本,docker运行报错 · Issue #1140 ...
[Bug] ktransformers:v0.2.4post1-AVX2镜像版本,docker运行报错 · Issue #1140 ...
[Bug] ktransformers启动web服务为什么同网络下其他设备无法访问 · Issue #1000 · kvcache-ai ...
[Bug] ktransformers启动web服务为什么同网络下其他设备无法访问 · Issue #1000 · kvcache-ai ...
[Bug] pc== capture_padded_batch_size · Issue #1251 · kvcache-ai ...
[Bug] pc== capture_padded_batch_size · Issue #1251 · kvcache-ai ...
[Bug] Docker Image Ktransformers:v0.2.1 Start Failed · Issue #400 ...
[Bug] Docker Image Ktransformers:v0.2.1 Start Failed · Issue #400 ...
[Bug]subprocess.CalledProcessError · Issue #1053 · kvcache-ai ...
[Bug]subprocess.CalledProcessError · Issue #1053 · kvcache-ai ...
[Bug]: unexpected failure in long sequence · Issue #885 · kvcache-ai ...
[Bug]: unexpected failure in long sequence · Issue #885 · kvcache-ai ...
[BUG] setWarpTransformFourPoints() unexpected behaviour · Issue #882 ...
[BUG] setWarpTransformFourPoints() unexpected behaviour · Issue #882 ...
[BUG] Missing `value` in examples cause `KeyError` · Issue #882 ...
[BUG] Missing `value` in examples cause `KeyError` · Issue #882 ...
Installing ktransformers failed · Issue #340 · kvcache-ai/ktransformers ...
Installing ktransformers failed · Issue #340 · kvcache-ai/ktransformers ...
[Bug] 部署 r1 server 成功后,请求接口,一直无法返回响应 · Issue #850 · kvcache-ai ...
[Bug] 部署 r1 server 成功后,请求接口,一直无法返回响应 · Issue #850 · kvcache-ai ...
[Bug] 0.3.0版本的KT, serve DSV3-0324-Q4_k_m开启AMX后出现断言错误 · Issue #1234 ...
[Bug] 0.3.0版本的KT, serve DSV3-0324-Q4_k_m开启AMX后出现断言错误 · Issue #1234 ...
[Bug] 请哪位大佬帮忙看看,加载模型过程中出现错误。 · Issue #1369 · kvcache-ai/ktransformers ...
[Bug] 请哪位大佬帮忙看看,加载模型过程中出现错误。 · Issue #1369 · kvcache-ai/ktransformers ...
[Bug] v0.2.3 没有报错但模型输出异常,答非所问,输出速度只有0.06token/s~0.9token/s · Issue ...
[Bug] v0.2.3 没有报错但模型输出异常,答非所问,输出速度只有0.06token/s~0.9token/s · Issue ...

Loading image details...

Source
Dimensions