Skip to content

Commit 7275e44

Browse files
committed
Update UI text and functionality descriptions for Software Arena w/ placeholders
1 parent 9c51bb4 commit 7275e44

File tree

3 files changed

+65
-61
lines changed

3 files changed

+65
-61
lines changed

fastchat/serve/gradio_block_arena_anony.py

Lines changed: 17 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -538,23 +538,25 @@ def bot_response_multi(
538538

539539
def build_side_by_side_ui_anony(models):
540540
notice_markdown = f"""
541-
# ⚔️ Chatbot Arena (formerly LMSYS): Free AI Chat to Compare & Test Best AI Chatbots
542-
[Blog](https://blog.lmarena.ai/blog/2023/arena/) | [GitHub](https://github.com/lm-sys/FastChat) | [Paper](https://arxiv.org/abs/2403.04132) | [Dataset](https://github.com/lm-sys/FastChat/blob/main/docs/dataset_release.md) | [Twitter](https://twitter.com/lmsysorg) | [Discord](https://discord.gg/6GXcFg3TH8) | [Kaggle Competition](https://www.kaggle.com/competitions/lmsys-chatbot-arena)
543-
544-
{SURVEY_LINK}
545-
546-
## 📣 News
547-
- Chatbot Arena now supports images in beta. Check it out [here](https://lmarena.ai/?vision).
541+
# ⚔️ Software Arena: Free AI Platform to Compare and Vote on LLM-Generated Visual UIs
542+
[GitHub](https://github.com/BigComputer-Project/FastChat-Software-Arena) | [Twitter](https://twitter.com/your-account) | [Discord](https://discord.gg/your-server)
548543
549544
## 📜 How It Works
550-
- **Blind Test**: Ask any question to two anonymous AI chatbots (ChatGPT, Gemini, Claude, Llama, and more).
551-
- **Vote for the Best**: Choose the best response. You can keep chatting until you find a winner.
552-
- **Play Fair**: If AI identity reveals, your vote won't count.
553-
554-
## 🏆 Chatbot Arena LLM [Leaderboard](https://lmarena.ai/leaderboard)
555-
- Backed by over **1,000,000+** community votes, our platform ranks the best LLM and AI chatbots. Explore the top AI models on our LLM [leaderboard](https://lmarena.ai/leaderboard)!
556-
557-
## 👇 Chat now!
545+
- **Blind Test**: Chat with two anonymous AI chatbots and give them a prompt or task (e.g., build a web app, create a game, generate a visualization, etc.).
546+
- **Run & Interact**: The AI chatbots generate programs that run in a secure sandbox. Interact with the programs, explore their functionality, and evaluate the quality of the generated outputs.
547+
- **Vote for the Best**: After interacting with both programs, choose the one that best meets the requirements or offers the best experience.
548+
- **Play Fair**: If an AI reveals its identity, the match will be invalid, and your vote won’t count.
549+
550+
## 💻 What Can You Create and Test?
551+
- Web apps and single-page HTML
552+
- Interactive visualizations and plots
553+
- Scalable Vector Graphics (SVG)
554+
- Tables, diagrams, and flowcharts
555+
- Games
556+
- UI components (e.g., React)
557+
- Programs in Python, Java, and more
558+
559+
## 👇 Start Testing & Voting Now!
558560
"""
559561

560562
states = [gr.State() for _ in range(num_sides)]

fastchat/serve/gradio_block_arena_named.py

Lines changed: 5 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -387,14 +387,13 @@ def flash_buttons():
387387

388388
def build_side_by_side_ui_named(models):
389389
notice_markdown = f"""
390-
# ⚔️ Chatbot Arena (formerly LMSYS): Free AI Chat to Compare & Test Best AI Chatbots
391-
[Blog](https://blog.lmarena.ai/blog/2023/arena/) | [GitHub](https://github.com/lm-sys/FastChat) | [Paper](https://arxiv.org/abs/2403.04132) | [Dataset](https://github.com/lm-sys/FastChat/blob/main/docs/dataset_release.md) | [Twitter](https://twitter.com/lmsysorg) | [Discord](https://discord.gg/6GXcFg3TH8) | [Kaggle Competition](https://www.kaggle.com/competitions/lmsys-chatbot-arena)
392-
393-
{SURVEY_LINK}
390+
# ⚔️ Software Arena: Free AI Platform to Compare and Vote on LLM-Generated Visual UIs
391+
[GitHub](https://github.com/BigComputer-Project/FastChat-Software-Arena) | [Twitter](https://twitter.com/your-account) | [Discord](https://discord.gg/your-server)
394392
395393
## 📜 How It Works
396-
- Ask any question to two chosen models (e.g., ChatGPT, Gemini, Claude, Llama) and vote for the better one!
397-
- You can chat for multiple turns until you identify a winner.
394+
- Interact with two chosen models (e.g., GPT, Gemini, Claude) as they generate programs with visual UIs.
395+
- Test the programs in a sandbox environment, interact with their functionality, and vote for the better one!
396+
- You can chat for multiple turns, explore the UIs, and continue testing until you identify a winner.
398397
399398
## 👇 Choose two models to compare
400399
"""

fastchat/serve/gradio_web_server.py

Lines changed: 43 additions & 40 deletions
Original file line numberDiff line numberDiff line change
@@ -79,21 +79,25 @@
7979
Please do not upload any private information.
8080
The service collects user dialogue data, including both text and images, and reserves the right to distribute it under a Creative Commons Attribution (CC-BY) or a similar license.
8181
82-
#### Please report any bug or issue to our [Discord](https://discord.gg/6GXcFg3TH8)/arena-feedback.
82+
#### Please report any bugs or issues to our [Discord](https://your-discord-link) / [arena-feedback](https://your-feedback-link).
8383
84-
### Acknowledgment
85-
We thank [UC Berkeley SkyLab](https://sky.cs.berkeley.edu/), [Kaggle](https://www.kaggle.com/), [MBZUAI](https://mbzuai.ac.ae/), [a16z](https://www.a16z.com/), [Together AI](https://www.together.ai/), [Hyperbolic](https://hyperbolic.xyz/), [RunPod](https://runpod.io), [Anyscale](https://www.anyscale.com/), [HuggingFace](https://huggingface.co/) for their generous [sponsorship](https://lmsys.org/donations/).
84+
### Acknowledgments
85+
86+
We thank the following organizations for their generous support and sponsorship:
87+
88+
- [Organization 1](https://your-link.com)
89+
- [Organization 2](https://your-link.com)
90+
- [Organization 3](https://your-link.com)
91+
- [Organization 4](https://your-link.com)
92+
- [Organization 5](https://your-link.com)
93+
94+
Special thanks to [Your Sponsor Details Page](https://your-sponsor-link) for their backing.
8695
8796
<div class="sponsor-image-about">
88-
<img src="https://storage.googleapis.com/public-arena-asset/skylab.png" alt="SkyLab">
89-
<img src="https://storage.googleapis.com/public-arena-asset/kaggle.png" alt="Kaggle">
90-
<img src="https://storage.googleapis.com/public-arena-asset/mbzuai.jpeg" alt="MBZUAI">
91-
<img src="https://storage.googleapis.com/public-arena-asset/a16z.jpeg" alt="a16z">
92-
<img src="https://storage.googleapis.com/public-arena-asset/together.png" alt="Together AI">
93-
<img src="https://storage.googleapis.com/public-arena-asset/hyperbolic_logo.png" alt="Hyperbolic">
94-
<img src="https://storage.googleapis.com/public-arena-asset/runpod-logo.jpg" alt="RunPod">
95-
<img src="https://storage.googleapis.com/public-arena-asset/anyscale.png" alt="AnyScale">
96-
<img src="https://storage.googleapis.com/public-arena-asset/huggingface.png" alt="HuggingFace">
97+
<img src="https://your-link.com/sponsor-image-1.png" alt="Sponsor 1">
98+
<img src="https://your-link.com/sponsor-image-2.png" alt="Sponsor 2">
99+
<img src="https://your-link.com/sponsor-image-3.png" alt="Sponsor 3">
100+
<!-- Add more sponsor images as needed -->
97101
</div>
98102
"""
99103

@@ -839,36 +843,37 @@ def get_model_description_md(models):
839843
def build_about():
840844
about_markdown = """
841845
# About Us
842-
Chatbot Arena ([lmarena.ai](https://lmarena.ai)) is an open-source platform for evaluating AI through human preference, developed by researchers at UC Berkeley [SkyLab](https://sky.cs.berkeley.edu/) and [LMSYS](https://lmsys.org). We open-source the [FastChat](https://github.com/lm-sys/FastChat) project at GitHub and release open datasets. We always welcome contributions from the community. If you're interested in getting involved, we'd love to hear from you!
846+
**Software-Arena** ([software-arena.ai](https://software-arena.ai)) is an open-source platform designed for comparing and evaluating AI-generated visual UIs through human preference. Developed by researchers at [Your Research Group](https://your-research-group-link.com), **Software-Arena** provides a space for users to interact with programs generated by large language models (LLMs) and vote on the quality of their user interfaces. We also open-source the underlying code and datasets to encourage community contributions.
843847
844-
## Open-source contributors
845-
- Leads: [Wei-Lin Chiang](https://infwinston.github.io/), [Anastasios Angelopoulos](https://people.eecs.berkeley.edu/~angelopoulos/)
846-
- Contributors: [Lianmin Zheng](https://lmzheng.net/), [Ying Sheng](https://sites.google.com/view/yingsheng/home), [Lisa Dunlap](https://www.lisabdunlap.com/), [Christopher Chou](https://www.linkedin.com/in/chrisychou), [Tianle Li](https://codingwithtim.github.io/), [Evan Frick](https://efrick2002.github.io/), [Dacheng Li](https://dachengli1.github.io/), [Siyuan Zhuang](https://www.linkedin.com/in/siyuanzhuang)
847-
- Advisors: [Ion Stoica](http://people.eecs.berkeley.edu/~istoica/), [Joseph E. Gonzalez](https://people.eecs.berkeley.edu/~jegonzal/), [Hao Zhang](https://cseweb.ucsd.edu/~haozhang/), [Trevor Darrell](https://people.eecs.berkeley.edu/~trevor/)
848+
We invite you to get involved in the project—whether through code contributions, feedback, or partnerships!
848849
849-
## Learn more
850-
- Chatbot Arena [paper](https://arxiv.org/abs/2403.04132), [launch blog](https://blog.lmarena.ai/blog/2023/arena/), [dataset](https://github.com/lm-sys/FastChat/blob/main/docs/dataset_release.md), [policy](https://blog.lmarena.ai/blog/2024/policy/)
851-
- LMSYS-Chat-1M dataset [paper](https://arxiv.org/abs/2309.11998), LLM Judge [paper](https://arxiv.org/abs/2306.05685)
850+
## Open-source Contributors
851+
- **Leads**: [Lead Name 1](https://your-link.com), [Lead Name 2](https://your-link.com)
852+
- **Contributors**: [Contributor Name 1](https://your-link.com), [Contributor Name 2](https://your-link.com), [Contributor Name 3](https://your-link.com)
853+
- **Advisors**: [Advisor Name 1](https://your-link.com), [Advisor Name 2](https://your-link.com)
854+
855+
## Learn More
856+
- **Software-Arena** [Paper](https://your-link.com) | [Blog](https://your-blog-link.com) | [Dataset](https://your-dataset-link.com)
857+
- Related Projects: [Project 1](https://your-link.com) | [Project 2](https://your-link.com)
852858
853859
## Contact Us
854-
- Follow our [X](https://x.com/lmsysorg), [Discord](https://discord.gg/6GXcFg3TH8) or email us at `[email protected]`
855-
- File issues on [GitHub](https://github.com/lm-sys/FastChat)
856-
- Download our datasets and models on [HuggingFace](https://huggingface.co/lmsys)
860+
- Follow us on [Twitter](https://twitter.com/your-account), [Discord](https://discord.gg/your-server) or email us at `[email protected]`
861+
- Report issues on [GitHub](https://github.com/your-repo)
862+
- Download our datasets and models on [HuggingFace](https://huggingface.co/your-account)
863+
864+
## Acknowledgments
865+
We thank the following organizations and teams for their support and contributions:
866+
- [Organization 1](https://your-link.com)
867+
- [Organization 2](https://your-link.com)
868+
- [Organization 3](https://your-link.com)
857869
858-
## Acknowledgment
859-
We thank [SkyPilot](https://github.com/skypilot-org/skypilot) and [Gradio](https://github.com/gradio-app/gradio) team for their system support.
860-
We also thank [UC Berkeley SkyLab](https://sky.cs.berkeley.edu/), [Kaggle](https://www.kaggle.com/), [MBZUAI](https://mbzuai.ac.ae/), [a16z](https://www.a16z.com/), [Together AI](https://www.together.ai/), [Hyperbolic](https://hyperbolic.xyz/), [RunPod](https://runpod.io), [Anyscale](https://www.anyscale.com/), [HuggingFace](https://huggingface.co/) for their generous sponsorship. Learn more about partnership [here](https://lmsys.org/donations/).
870+
Special thanks to our [sponsors](https://your-link.com/sponsors) for their generous backing.
861871
862872
<div class="sponsor-image-about">
863-
<img src="https://storage.googleapis.com/public-arena-asset/skylab.png" alt="SkyLab">
864-
<img src="https://storage.googleapis.com/public-arena-asset/kaggle.png" alt="Kaggle">
865-
<img src="https://storage.googleapis.com/public-arena-asset/mbzuai.jpeg" alt="MBZUAI">
866-
<img src="https://storage.googleapis.com/public-arena-asset/a16z.jpeg" alt="a16z">
867-
<img src="https://storage.googleapis.com/public-arena-asset/together.png" alt="Together AI">
868-
<img src="https://storage.googleapis.com/public-arena-asset/hyperbolic_logo.png" alt="Hyperbolic">
869-
<img src="https://storage.googleapis.com/public-arena-asset/runpod-logo.jpg" alt="RunPod">
870-
<img src="https://storage.googleapis.com/public-arena-asset/anyscale.png" alt="AnyScale">
871-
<img src="https://storage.googleapis.com/public-arena-asset/huggingface.png" alt="HuggingFace">
873+
<img src="https://your-link.com/sponsor-image-1.png" alt="Sponsor 1">
874+
<img src="https://your-link.com/sponsor-image-2.png" alt="Sponsor 2">
875+
<img src="https://your-link.com/sponsor-image-3.png" alt="Sponsor 3">
876+
<!-- Add more sponsor images as necessary -->
872877
</div>
873878
"""
874879
gr.Markdown(about_markdown, elem_id="about_markdown")
@@ -877,18 +882,16 @@ def build_about():
877882
def build_single_model_ui(models, add_promotion_links=False):
878883
promotion = (
879884
f"""
880-
[Blog](https://blog.lmarena.ai/blog/2023/arena/) | [GitHub](https://github.com/lm-sys/FastChat) | [Paper](https://arxiv.org/abs/2403.04132) | [Dataset](https://github.com/lm-sys/FastChat/blob/main/docs/dataset_release.md) | [Twitter](https://twitter.com/lmsysorg) | [Discord](https://discord.gg/6GXcFg3TH8) | [Kaggle Competition](https://www.kaggle.com/competitions/lmsys-chatbot-arena)
881-
882-
{SURVEY_LINK}
885+
[GitHub](https://github.com/BigComputer-Project/FastChat-Software-Arena) | [Twitter](https://twitter.com/your-account) | [Discord](https://discord.gg/your-server)
883886
884-
## 👇 Choose any model to chat
887+
## 👇 Choose any model to compare
885888
"""
886889
if add_promotion_links
887890
else ""
888891
)
889892

890893
notice_markdown = f"""
891-
# 🏔️ Chatbot Arena (formerly LMSYS): Free AI Chat to Compare & Test Best AI Chatbots
894+
# ⚔️ Software Arena: Free AI Platform to Compare and Vote on LLM-Generated Visual UIs
892895
{promotion}
893896
"""
894897

0 commit comments

Comments
 (0)