OpenRouter Integration

[Algorithm5838]

OpenRouter is now compatible with ChatGPT-Next-Web, offering a wide range of models from various providers. With OpenRouter, you can connect to models from:

• OpenAI [GPT-3.5, GPT-4]
• Anthropic [Claude]
• Google [PaLM]
• Meta [Llama]
• As well as many open-source models

To get started, simply configure the following settings:

• BASE_URL or OpenAI Endpoint: Set this to https://openrouter.ai/api.
• OPENAI_API_KEY or OpenAI API Key: Enter your OpenRouter API key here.
• CUSTOM_MODELS or Custom Models: Specify the model name as it is listed within OpenRouter.

Reference: https://openrouter.ai/docs

[CXwudi]

Thanks for providing the guide, works like a charm

[CXwudi]

For anyone who doesn't want to handwrite all OpenRouter models, here is a simple python script to automate this:

import requests

def list_all_model_ids(url: str):
  response = requests.get(url)
  if response.status_code == 200:
    models = response.json()
    return [model['id'] for model in models["data"]]
  else:
    raise Exception(f"Failed to get models. Status code: {response.status_code}")

if __name__ == "__main__":
    model_ids = list_all_model_ids('https://openrouter.ai/api/v1/models')
    print(','.join(model_ids))

It will print something like:

nousresearch/nous-capybara-34b,openrouter/auto,nousresearch/nous-capybara-7b:free,mistralai/mistral-7b-instruct:free,gryphe/mythomist-7b:free,undi95/toppy-m-7b:free,openrouter/cinematika-7b:free,jondurbin/bagel-34b,jebcarter/psyfighter-13b,koboldai/psyfighter-13b-2,neversleep/noromaid-mixtral-8x7b-instruct,nousresearch/nous-hermes-llama2-13b,meta-llama/codellama-34b-instruct,phind/phind-codellama-34b,intel/neural-chat-7b,nousresearch/nous-hermes-2-mixtral-8x7b-dpo,nousresearch/nous-hermes-2-mixtral-8x7b-sft,haotian-liu/llava-13b,nousresearch/nous-hermes-2-vision-7b,meta-llama/llama-2-13b-chat,gryphe/mythomax-l2-13b,nousresearch/nous-hermes-llama2-70b,nousresearch/nous-capybara-7b,codellama/codellama-70b-instruct,teknium/openhermes-2-mistral-7b,teknium/openhermes-2.5-mistral-7b,undi95/remm-slerp-l2-13b,undi95/toppy-m-7b,openrouter/cinematika-7b,01-ai/yi-34b-chat,01-ai/yi-34b,01-ai/yi-6b,togethercomputer/stripedhyena-nous-7b,togethercomputer/stripedhyena-hessian-7b,mistralai/mixtral-8x7b,nousresearch/nous-hermes-yi-34b,open-orca/mistral-7b-openorca,huggingfaceh4/zephyr-7b-beta,openai/gpt-3.5-turbo,openai/gpt-3.5-turbo-0125,openai/gpt-3.5-turbo-1106,openai/gpt-3.5-turbo-0613,openai/gpt-3.5-turbo-0301,openai/gpt-3.5-turbo-16k,openai/gpt-4-turbo-preview,openai/gpt-4-1106-preview,openai/gpt-4,openai/gpt-4-0314,openai/gpt-4-32k,openai/gpt-4-32k-0314,openai/gpt-4-vision-preview,openai/gpt-3.5-turbo-instruct,google/palm-2-chat-bison,google/palm-2-codechat-bison,google/palm-2-chat-bison-32k,google/palm-2-codechat-bison-32k,google/gemini-pro,google/gemini-pro-vision,perplexity/pplx-70b-online,perplexity/pplx-7b-online,perplexity/pplx-7b-chat,perplexity/pplx-70b-chat,meta-llama/llama-2-70b-chat,jondurbin/airoboros-l2-70b,austism/chronos-hermes-13b,migtissera/synthia-70b,mistralai/mistral-7b-instruct,pygmalionai/mythalion-13b,undi95/remm-slerp-l2-13b-6k,xwin-lm/xwin-lm-70b,gryphe/mythomax-l2-13b-8k,openchat/openchat-7b,alpindale/goliath-120b,lizpreciatior/lzlv-70b-fp16-hf,neversleep/noromaid-20b,gryphe/mythomist-7b,mistralai/mixtral-8x7b-instruct,cognitivecomputations/dolphin-mixtral-8x7b,rwkv/rwkv-5-world-3b,recursal/rwkv-5-3b-ai-town,recursal/eagle-7b,anthropic/claude-2,anthropic/claude-2.0,anthropic/claude-instant-v1,anthropic/claude-v1,anthropic/claude-1.2,anthropic/claude-instant-v1-100k,anthropic/claude-v1-100k,anthropic/claude-instant-1.0,huggingfaceh4/zephyr-7b-beta:free,openchat/openchat-7b:free,mancer/weaver,mistralai/mistral-tiny,mistralai/mistral-small,mistralai/mistral-medium

[Lynn3t]

import requests

def list_all_model_ids(url: str):
    response = requests.get(url)
    if response.status_code == 200:
        models = response.json()
        # free
        return [model['id'] for model in models["data"] if 'free' in model['id']]
    else:
        raise Exception(f"Failed to get models. Status code: {response.status_code}")

if __name__ == "__main__":
    model_ids = list_all_model_ids('https://openrouter.ai/api/v1/models')
    # CUSTOM_MODELS
    custom_models = '-all,' + ','.join([f'+{model_id}' for model_id in model_ids])
    print(custom_models)

Use this for free models