|
|
37cf1f27f2
|
hack 2
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 18:56:08 -04:00 |
|
|
|
45ea3c31a2
|
hack
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 18:35:43 -04:00 |
|
|
|
df866cfebf
|
update
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 18:27:59 -04:00 |
|
|
|
29596317b0
|
barrier
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 18:20:25 -04:00 |
|
|
|
7b86860ff5
|
fix?
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 15:17:07 -04:00 |
|
|
|
f386a9e56c
|
add gpu-ids
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
|
2025-07-10 15:08:47 -04:00 |
|
|
|
efe73d0575
|
[doc] update doc format (#20673)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2025-07-09 08:08:19 -07:00 |
|
|
|
853487bc1b
|
[Docs] Improve docs for RLHF co-location example (#20599)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-07-09 08:06:43 -07:00 |
|
|
|
9ff2af6d2b
|
[Benchmark] Parameterization of streaming loading of multimodal datasets (#20528)
Signed-off-by: wangli <wangli858794774@gmail.com>
|
2025-07-09 13:35:16 +00:00 |
|
|
|
70ca5484f5
|
[Doc] Update notes (#20668)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-07-09 03:46:36 -07:00 |
|
|
|
5358cce5ff
|
[V1] [Doc] Update V1 docs for Mamba models (#20499)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
|
2025-07-09 01:02:41 -07:00 |
|
|
|
2155e95ef1
|
[Bugfix] Fix the issue where reasoning_content is None when Thinkng is enabled and tool_choice is set to 'required'. (#20662)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2025-07-09 07:39:58 +00:00 |
|
|
|
f95570a52d
|
[Docs] fix minimax tool_calling docs error (#20667)
Signed-off-by: qingjun <qingjun@minimaxi.com>
|
2025-07-09 00:37:07 -07:00 |
|
|
|
b6e7e3d58f
|
[Intel GPU] support ray as distributed executor backend for XPU. (#20659)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2025-07-09 00:36:58 -07:00 |
|
|
|
e760fcef22
|
[XPU] Use spawn with XPU multiprocessing (#20649)
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
|
2025-07-09 00:34:28 -07:00 |
|
|
|
6bbf1795b7
|
[Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434)
Signed-off-by: bk-201 <joy25810@foxmail.com>
|
2025-07-08 20:15:44 -07:00 |
|
|
|
9e0ef888f0
|
Fix bullets in incremental_build.md (#20642)
|
2025-07-09 11:03:41 +08:00 |
|
|
|
97abeb1daa
|
[feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640)
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
|
2025-07-09 11:03:35 +08:00 |
|
|
|
34dad19e7b
|
[Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628)
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
|
2025-07-09 11:02:51 +08:00 |
|
|
|
6db31e7a27
|
[Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554)
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Nikhil Gupta <nikhil.gupta2@arm.com>
|
2025-07-08 20:00:41 -07:00 |
|
|
|
977180c912
|
[Docs] Improve documentation for multi-node service helper script (#20600)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-08 19:44:26 -07:00 |
|
|
|
c40784c794
|
[BugFix][Intel GPU] Use refactored API for dist_backend in V1 worker (#20596)
Signed-off-by: ratnampa <ratnam.parikh@intel.com>
|
2025-07-08 19:44:23 -07:00 |
|
|
|
baed180aa0
|
[tech debt] Revisit lora request model checker (#20636)
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
|
2025-07-09 09:42:41 +08:00 |
|
|
|
0b407479ef
|
[misc]refactor Platform.set_device method (#20262)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
|
2025-07-09 01:39:47 +00:00 |
|
|
|
5eaf570050
|
Replace multiply_add with homogeneous_multiply_add to Address Clang Template Parameter Issue (#20142)
Signed-off-by: Lu Fang <lufang@fb.com>
|
2025-07-09 00:30:18 +00:00 |
|
|
|
d8ee5a2ca4
|
[TPU][Bugfix] disable phi-3 test (#20632)
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
|
2025-07-08 23:14:26 +00:00 |
|
|
|
b9fca83256
|
[Bugfix] Fix GLM-4.1-V video prompt update (#20635)
Signed-off-by: Isotr0py <2037008807@qq.com>
|
2025-07-08 23:13:58 +00:00 |
|
|
|
32dffc2772
|
[Core] Rename get_max_tokens_per_item for backward compatibility (#20630)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-07-08 23:11:30 +00:00 |
|
|
|
c438183e99
|
[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166)
Signed-off-by: Ming Yang <yming@meta.com>
|
2025-07-08 23:10:57 +00:00 |
|
|
|
baba0389f7
|
[CI] Increase the threshold of the MTEB RERANK tests (#20615)
Signed-off-by: wang.yuqi <noooop@126.com>
|
2025-07-08 08:10:11 -07:00 |
|
|
|
c6c22f16d3
|
Revert invalid spellchecker fix on deepseek_vl2 (#20618)
|
2025-07-08 15:07:14 +00:00 |
|
|
|
dd382e0fe3
|
[Model] Implement missing get_language_model for Keye-VL (#20631)
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
|
2025-07-08 07:47:46 -07:00 |
|
|
|
849590a2a7
|
Update torch/xla pin to 20250703 (#20589)
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
|
2025-07-08 07:44:02 -07:00 |
|
|
|
a4c23314c0
|
[xpu]feat: support multi-lora on xpu (#20616)
Signed-off-by: yan <yan.ma@intel.com>
|
2025-07-08 22:07:10 +08:00 |
|
|
|
b942c094e3
|
Stop using title frontmatter and fix doc that can only be reached by search (#20623)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-07-08 03:27:40 -07:00 |
|
|
|
b4bab81660
|
Remove unnecessary explicit title anchors and use relative links instead (#20620)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-07-08 02:49:13 -07:00 |
|
|
|
b91cb3fa5c
|
[Docs] Improve documentation for Deepseek R1 on Ray Serve LLM (#20601)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-08 02:09:06 -07:00 |
|
|
|
71d1d75b7a
|
[PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139)
Signed-off-by: NickLucche <nlucches@redhat.com>
|
2025-07-08 08:56:40 +01:00 |
|
|
|
72d14d0eed
|
[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>
|
2025-07-07 22:47:43 -07:00 |
|
|
|
e34d130c16
|
[TPU] Temporary fix vmem oom for long model len by reducing page size (#20278)
Signed-off-by: Chenyaaang <chenyangli@google.com>
|
2025-07-08 05:16:16 +00:00 |
|
|
|
7721ef1786
|
[CI/Build][CPU] Fix CPU CI and remove all CPU V0 files (#20560)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
|
2025-07-07 22:13:44 -07:00 |
|
|
|
8369b7c2a9
|
[Misc] improve error msg (#20604)
Signed-off-by: reidliu41 <reid201711@gmail.com>
|
2025-07-07 21:45:18 -07:00 |
|
|
|
3eb4ad53f3
|
[Docs] Add Anyscale to frameworks (#20590)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-07 20:09:13 -07:00 |
|
|
|
90a2769f20
|
[Docs] Add Ray Serve LLM section to openai compatible server guide (#20595)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-07 20:08:05 -07:00 |
|
|
|
e60d422f19
|
[Docs] Improve docstring for ray data llm example (#20597)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-07 20:06:26 -07:00 |
|
|
|
0d914c81a2
|
[Docs] Rewrite offline inference guide (#20594)
Signed-off-by: Ricardo Decal <rdecal@anyscale.com>
|
2025-07-07 20:06:02 -07:00 |
|
|
|
6e428cdd7a
|
[Doc] Syntax highlight request responses as JSON instead of bash (#20582)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-07-07 20:02:45 -07:00 |
|
|
|
93b9d9f499
|
[Bugfix]: Fix messy code when using logprobs (#19209)
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
2025-07-08 11:02:15 +08:00 |
|
|
|
af107d5a0e
|
Make distinct code and console admonitions so readers are less likely to miss them (#20585)
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
|
2025-07-07 19:55:28 -07:00 |
|
|
|
31c5d0a1b7
|
[Optimize] Don't send token ids when kv connector is not used (#20586)
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
|
2025-07-07 19:04:54 -07:00 |
|
