Skip to content

Commit f6564ef

Browse files
authored
DOC: add release notes doc (xorbitsai#4157)
1 parent 62e80b6 commit f6564ef

File tree

6 files changed

+132
-32
lines changed

6 files changed

+132
-32
lines changed

doc/source/getting_started/index.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -15,3 +15,4 @@ Getting Started
1515
using_kubernetes
1616
troubleshooting
1717
environments
18+
release_notes
Lines changed: 21 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,21 @@
1+
.. _release_ntoes:
2+
3+
Release Notes
4+
=============
5+
6+
This page provides a version-by-version index of Xinference release notes.
7+
For detailed updates, please visit the corresponding links below.
8+
9+
+-----------------+--------------------------------------------------------------------------------+
10+
| Version | Release Notes |
11+
+=================+================================================================================+
12+
| v1.11.0.post1 | `View release notes <https://xinference.io/release_notes/v1.11.0.post1.html>`_ |
13+
+-----------------+--------------------------------------------------------------------------------+
14+
| v1.10.1 | `View release notes <https://xinference.io/release_notes/v1.10.1.html>`_ |
15+
+-----------------+--------------------------------------------------------------------------------+
16+
17+
----
18+
19+
For older versions and source history, see our GitHub releases page:
20+
https://github.com/xorbitsai/inference/releases
21+

doc/source/getting_started/using_xinference.rst

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -326,6 +326,9 @@ The following OpenAI APIs are supported:
326326

327327
- Embeddings: `https://platform.openai.com/docs/api-reference/embeddings <https://platform.openai.com/docs/api-reference/embeddings>`_
328328

329+
Xinference also supports Anthropic API via base url ``http://127.0.0.1:9997/anthropic``, you can use Xinference in Claude Code and so forth.
330+
Refer to :ref:`anthropic client <anthropic_client>` for more details.
331+
329332
Manage Models
330333
-------------
331334

Lines changed: 65 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,65 @@
1+
# SOME DESCRIPTIVE TITLE.
2+
# Copyright (C) 2025, Xorbits Inc.
3+
# This file is distributed under the same license as the Xinference package.
4+
# FIRST AUTHOR <EMAIL@ADDRESS>, 2025.
5+
#
6+
#, fuzzy
7+
msgid ""
8+
msgstr ""
9+
"Project-Id-Version: Xinference \n"
10+
"Report-Msgid-Bugs-To: \n"
11+
"POT-Creation-Date: 2025-10-21 12:57+0800\n"
12+
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
13+
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
14+
"Language: zh_CN\n"
15+
"Language-Team: zh_CN <[email protected]>\n"
16+
"Plural-Forms: nplurals=1; plural=0;\n"
17+
"MIME-Version: 1.0\n"
18+
"Content-Type: text/plain; charset=utf-8\n"
19+
"Content-Transfer-Encoding: 8bit\n"
20+
"Generated-By: Babel 2.14.0\n"
21+
22+
#: ../../source/getting_started/release_notes.rst:4
23+
#: ../../source/getting_started/release_notes.rst:10
24+
msgid "Release Notes"
25+
msgstr "版本发布说明"
26+
27+
#: ../../source/getting_started/release_notes.rst:6
28+
msgid ""
29+
"This page provides a version-by-version index of Xinference release "
30+
"notes. For detailed updates, please visit the corresponding links below."
31+
msgstr ""
32+
"本页面提供 Xinference 各版本的发布说明索引。有关详细更新,请访问对应的链接。"
33+
34+
#: ../../source/getting_started/release_notes.rst:10
35+
msgid "Version"
36+
msgstr "版本"
37+
38+
#: ../../source/getting_started/release_notes.rst:12
39+
msgid "v1.11.0.post1"
40+
msgstr ""
41+
42+
#: ../../source/getting_started/release_notes.rst:12
43+
msgid ""
44+
"`View release notes "
45+
"<https://xinference.io/release_notes/v1.11.0.post1.html>`_"
46+
msgstr ""
47+
"`查看版本说明 "
48+
"<https://xinference.cn/release_notes/v1.11.0.post1.html>`_"
49+
50+
#: ../../source/getting_started/release_notes.rst:14
51+
msgid "v1.10.1"
52+
msgstr ""
53+
54+
#: ../../source/getting_started/release_notes.rst:14
55+
msgid "`View release notes <https://xinference.io/release_notes/v1.10.1.html>`_"
56+
msgstr ""
57+
"`查看版本说明 "
58+
"<https://xinference.cn/release_notes/v1.10.1.html>`_"
59+
60+
#: ../../source/getting_started/release_notes.rst:19
61+
msgid ""
62+
"For older versions and source history, see our GitHub releases page: "
63+
"https://github.com/xorbitsai/inference/releases"
64+
msgstr ""
65+
"更多历史版本及源代码,请访问 GitHub Releases:https://github.com/xorbitsai/inference/releases"

doc/source/locale/zh_CN/LC_MESSAGES/getting_started/using_xinference.po

Lines changed: 41 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ msgid ""
66
msgstr ""
77
"Project-Id-Version: Xinference \n"
88
"Report-Msgid-Bugs-To: \n"
9-
"POT-Creation-Date: 2025-08-04 12:08+0800\n"
9+
"POT-Creation-Date: 2025-10-21 13:27+0800\n"
1010
"PO-Revision-Date: YEAR-MO-DA HO:MI+ZONE\n"
1111
"Last-Translator: FULL NAME <EMAIL@ADDRESS>\n"
1212
"Language: zh_CN\n"
@@ -376,11 +376,21 @@ msgstr ""
376376
"向量生成:`https://platform.openai.com/docs/api-reference/embeddings <"
377377
"https://platform.openai.com/docs/api-reference/embeddings>`_"
378378

379-
#: ../../source/getting_started/using_xinference.rst:330
379+
#: ../../source/getting_started/using_xinference.rst:329
380+
msgid ""
381+
"Xinference also supports Anthropic API via base url "
382+
"``http://127.0.0.1:9997/anthropic``, you can use Xinference in Claude "
383+
"Code and so forth. Refer to :ref:`anthropic client <anthropic_client>` "
384+
"for more details."
385+
msgstr ""
386+
"Xinference 还支持通过基础 URL ``http://127.0.0.1:9997/anthropic`` 调用 Anthropic API,"
387+
"你可以在 Claude Code 等环境中使用 Xinference。更多详情请参阅 :ref:`anthropic client <anthropic_client>`。"
388+
389+
#: ../../source/getting_started/using_xinference.rst:333
380390
msgid "Manage Models"
381391
msgstr "管理模型"
382392

383-
#: ../../source/getting_started/using_xinference.rst:332
393+
#: ../../source/getting_started/using_xinference.rst:335
384394
msgid ""
385395
"In addition to launching models, Xinference offers various ways to manage"
386396
" the entire lifecycle of models. You can manage models in Xinference "
@@ -389,37 +399,37 @@ msgstr ""
389399
"除了启动模型,Xinference 提供了管理模型整个生命周期的能力。同样的,你可以"
390400
"使用命令行、cURL 以及 Python 代码来管理:"
391401

392-
#: ../../source/getting_started/using_xinference.rst:335
402+
#: ../../source/getting_started/using_xinference.rst:338
393403
msgid ""
394404
"You can list all models of a certain type that are available to launch in"
395405
" Xinference:"
396406
msgstr "可以列出所有 Xinference 支持的指定类型的模型:"
397407

398-
#: ../../source/getting_started/using_xinference.rst:353
408+
#: ../../source/getting_started/using_xinference.rst:356
399409
msgid ""
400410
"The following command gives you the currently running models in "
401411
"Xinference:"
402412
msgstr "接下来的命令可以列出所有在运行的模型:"
403413

404-
#: ../../source/getting_started/using_xinference.rst:371
414+
#: ../../source/getting_started/using_xinference.rst:374
405415
msgid ""
406416
"When you no longer need a model that is currently running, you can remove"
407417
" it in the following way to free up the resources it occupies:"
408418
msgstr "当你不需要某个正在运行的模型,可以通过以下的方式来停止它并释放资源:"
409419

410-
#: ../../source/getting_started/using_xinference.rst:392
420+
#: ../../source/getting_started/using_xinference.rst:395
411421
msgid "Deploy Xinference In a Cluster"
412422
msgstr "集群中部署 Xinference"
413423

414-
#: ../../source/getting_started/using_xinference.rst:394
424+
#: ../../source/getting_started/using_xinference.rst:397
415425
msgid ""
416426
"To deploy Xinference in a cluster, you need to start a Xinference "
417427
"supervisor on one server and Xinference workers on the other servers."
418428
msgstr ""
419429
"若要在集群环境中部署 Xinference,需要在一台机器中启动 supervisor 节点,并"
420430
"在当前或者其他节点启动 worker 节点"
421431

422-
#: ../../source/getting_started/using_xinference.rst:397
432+
#: ../../source/getting_started/using_xinference.rst:400
423433
msgid ""
424434
"First, make sure you have already installed Xinference on each of the "
425435
"servers according to the instructions provided :ref:`here "
@@ -428,23 +438,23 @@ msgstr ""
428438
"首先,根据 :ref:`文档 <installation>` 确保所有的服务器上都安装了 "
429439
"Xinference。接下来按照步骤:"
430440

431-
#: ../../source/getting_started/using_xinference.rst:401
441+
#: ../../source/getting_started/using_xinference.rst:404
432442
msgid "Start the Supervisor"
433443
msgstr "启动 Supervisor"
434444

435-
#: ../../source/getting_started/using_xinference.rst:402
445+
#: ../../source/getting_started/using_xinference.rst:405
436446
msgid ""
437447
"On the server where you want to run the Xinference supervisor, run the "
438448
"following command:"
439449
msgstr "在服务器上执行以下命令来启动 Supervisor 节点:"
440450

441-
#: ../../source/getting_started/using_xinference.rst:408
451+
#: ../../source/getting_started/using_xinference.rst:411
442452
msgid ""
443453
"Replace ``${supervisor_host}`` with the actual host of your supervisor "
444454
"server."
445455
msgstr "用当前节点的 IP 来替换 ``${supervisor_host}``。"
446456

447-
#: ../../source/getting_started/using_xinference.rst:411
457+
#: ../../source/getting_started/using_xinference.rst:414
448458
msgid ""
449459
"You can the supervisor's web UI at `http://${supervisor_host}:9997/ui "
450460
"<http://${supervisor_host}:9997/ui>`_ and visit "
@@ -455,23 +465,23 @@ msgstr ""
455465
"/ui>`_ 访问 web UI,在 `http://${supervisor_host}:9997/docs <http://${"
456466
"supervisor_host}:9997/docs>`_ 访问 API 文档。"
457467

458-
#: ../../source/getting_started/using_xinference.rst:415
468+
#: ../../source/getting_started/using_xinference.rst:418
459469
msgid "Start the Workers"
460470
msgstr "启动 Worker"
461471

462-
#: ../../source/getting_started/using_xinference.rst:417
472+
#: ../../source/getting_started/using_xinference.rst:420
463473
msgid ""
464474
"On each of the other servers where you want to run Xinference workers, "
465475
"run the following command:"
466476
msgstr "在需要启动 Xinference worker 的机器上执行以下命令:"
467477

468-
#: ../../source/getting_started/using_xinference.rst:424
478+
#: ../../source/getting_started/using_xinference.rst:427
469479
msgid ""
470480
"Note that you must replace ``${worker_host}`` with the actual host of "
471481
"your worker server."
472482
msgstr "需要注意的是,必须使用当前Worker节点的 IP 来替换 ``${worker_host}``。"
473483

474-
#: ../../source/getting_started/using_xinference.rst:427
484+
#: ../../source/getting_started/using_xinference.rst:430
475485
msgid ""
476486
"Note that if you need to interact with the Xinference in a cluster via "
477487
"the command line, you should include the ``-e`` or ``--endpoint`` flag to"
@@ -480,56 +490,55 @@ msgstr ""
480490
"需要注意的是,如果你需要通过命令行与集群交互,应该通过 ``-e`` 或者 ``--"
481491
"endpoint`` 参数来指定 supervisor 的地址,比如:"
482492

483-
#: ../../source/getting_started/using_xinference.rst:435
493+
#: ../../source/getting_started/using_xinference.rst:438
484494
msgid "Using Xinference With Docker"
485495
msgstr "使用 Docker 部署 Xinference"
486496

487-
#: ../../source/getting_started/using_xinference.rst:437
497+
#: ../../source/getting_started/using_xinference.rst:440
488498
msgid "To start Xinference in a Docker container, run the following command:"
489499
msgstr "用以下命令在容器中运行 Xinference:"
490500

491-
#: ../../source/getting_started/using_xinference.rst:440
501+
#: ../../source/getting_started/using_xinference.rst:443
492502
msgid "Run On Nvidia GPU Host"
493503
msgstr "在拥有英伟达显卡的机器上运行"
494504

495-
#: ../../source/getting_started/using_xinference.rst:442
505+
#: ../../source/getting_started/using_xinference.rst:445
496506
msgid "For cuda 12.4:"
497507
msgstr "对于 cuda 12.4:"
498508

499-
#: ../../source/getting_started/using_xinference.rst:448
509+
#: ../../source/getting_started/using_xinference.rst:451
500510
msgid "For cuda 12.8:"
501511
msgstr "对于 cuda 12.8:"
502512

503-
#: ../../source/getting_started/using_xinference.rst:450
513+
#: ../../source/getting_started/using_xinference.rst:453
504514
msgid ""
505515
"CUDA 12.8 version is experimental, welcome to give us feedbacks to help "
506516
"us to improve."
507-
msgstr ""
508-
"CUDA 12.8 版本是实验性质,欢迎给我们反馈以改进。"
517+
msgstr "CUDA 12.8 版本是实验性质,欢迎给我们反馈以改进。"
509518

510-
#: ../../source/getting_started/using_xinference.rst:458
519+
#: ../../source/getting_started/using_xinference.rst:461
511520
msgid "Run On CPU Only Host"
512521
msgstr "在只有 CPU 的机器上运行"
513522

514-
#: ../../source/getting_started/using_xinference.rst:464
523+
#: ../../source/getting_started/using_xinference.rst:467
515524
msgid ""
516525
"Replace ``<your_version>`` with Xinference versions, e.g. ``v0.10.3``, "
517526
"``latest`` can be used for the latest version."
518527
msgstr ""
519528
"将 ``<your_version>`` 替换为 Xinference 的版本,比如 ``v0.10.3``,可以用 "
520529
"``latest`` 来用于最新版本。"
521530

522-
#: ../../source/getting_started/using_xinference.rst:466
531+
#: ../../source/getting_started/using_xinference.rst:469
523532
msgid ""
524533
"For more docker usage, refer to :ref:`Using Docker Image "
525534
"<using_docker_image>`."
526535
msgstr "更多 docker 使用,请参考 :ref:`使用 docker 镜像 <using_docker_image>`。"
527536

528-
#: ../../source/getting_started/using_xinference.rst:470
537+
#: ../../source/getting_started/using_xinference.rst:473
529538
msgid "What's Next?"
530539
msgstr "更多"
531540

532-
#: ../../source/getting_started/using_xinference.rst:472
541+
#: ../../source/getting_started/using_xinference.rst:475
533542
msgid ""
534543
"Congratulations on getting started with Xinference! To help you navigate "
535544
"and make the most out of this powerful tool, here are some resources and "
@@ -538,12 +547,12 @@ msgstr ""
538547
"恭喜你,已经初步掌握了 Xinference 的用法!为了帮助你更好地使用工具,下面"
539548
"是其他的一些文档和指导资源:"
540549

541-
#: ../../source/getting_started/using_xinference.rst:475
550+
#: ../../source/getting_started/using_xinference.rst:478
542551
msgid ""
543552
":ref:`How to Use Client APIs for Different Types of Models "
544553
"<user_guide_client_api>`"
545554
msgstr ":ref:`如何使用 Python 创建不同类型的模型 <user_guide_client_api>`"
546555

547-
#: ../../source/getting_started/using_xinference.rst:477
556+
#: ../../source/getting_started/using_xinference.rst:480
548557
msgid ":ref:`Choosing the Right Backends for Your Needs <user_guide_backends>`"
549558
msgstr ":ref:`选择正确的推理引擎 <user_guide_backends>` "

doc/source/user_guide/client_api.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -137,6 +137,7 @@ Output:
137137
138138
ChatCompletion(id='chatcmpl-ad2f383f-31c7-47d9-87b7-3abe928e629c', choices=[Choice(finish_reason='tool_calls', index=0, message=ChatCompletionMessage(content="```python\ntool_call(loc=94704, type='plus', time=10)\n```", role='assistant', function_call=None, tool_calls=[ChatCompletionMessageToolCall(id='call_ad2f383f-31c7-47d9-87b7-3abe928e629c', function=Function(arguments='{"loc": 94704, "type": "plus", "time": 10}', name='uber_ride'), type='function')]))], created=1704687803, model='chatglm3', object='chat.completion', system_fingerprint=None, usage=CompletionUsage(completion_tokens=-1, prompt_tokens=-1, total_tokens=-1))
139139
140+
.. _anthropic_client:
140141

141142
Anthropic Client
142143
========================

0 commit comments

Comments
 (0)