|
| 1 | +# Migrating to 0.6.0-alpha |
| 2 | + |
| 3 | +## Summary |
| 4 | +This guide will help you migrate your codebase from 0.5.X to 0.6.0-alpha. |
| 5 | + |
| 6 | +## Installation |
| 7 | +```bash |
| 8 | +pip install --pre guardrails-ai |
| 9 | +``` |
| 10 | + |
| 11 | +## List of backwards incompatible changes |
| 12 | + |
| 13 | +1. All validators will require authentication with a guardrails token. This will also apply to all versions >=0.4.x of the guardrails-ai package. |
| 14 | +1. prompt, msg_history, instructions, reask_messages, reask_instructions, and will be removed from the `Guard.__call__` function and will instead be supported by a single messages argument, and a reask_messages argument for reasks. |
| 15 | +1. Custom callables now need to expect `messages`, as opposed to `prompt` to come in as a keyword argument. |
| 16 | +1. The default on_fail action for validators will change from noop to exception. |
| 17 | +1. In cases where we try and generate structured data, Guardrails will no longer automatically attempt to try and coerce the LLM into giving correctly formatted information. |
| 18 | +1. Guardrails will no longer automatically set a tool selection in the OpenAI callable when initialized using pydantic for initial prompts or reasks |
| 19 | +1. Guard.from_string is being removed in favor of Guard() |
| 20 | +1. Guard.from_pydantic is renamed to Guard.for_pydantic |
| 21 | +1. Guard.from_rail is renamed to Guard.for_rail |
| 22 | +1. Guard.from_rail_string is renamed to guard.for_rail_string |
| 23 | +1. The guardrails server will change from using Flask to FastAPI. We recommend serving uvicorn runners via a gunicorn WSGI. |
| 24 | +1. OpenAI, Cohere and Anthropic **callables are being removed in favor of support through passing no callable and setting the appropriate api key and model argument. |
| 25 | + |
| 26 | + |
| 27 | +## How to migrate |
| 28 | + |
| 29 | +### Messages support for reask and RAILS |
| 30 | +`Guard.__call` and rails now fully support `reask_messages` as an argument. |
| 31 | + |
| 32 | +### For `Guard.__call` |
| 33 | +```py |
| 34 | +response = guard( |
| 35 | + messages=[{ |
| 36 | + "role":"user", |
| 37 | + "content":"tell me a joke" |
| 38 | + }], |
| 39 | + reask_messages=[{ |
| 40 | + "role":"system" |
| 41 | + "content":"your previous joke failed validation can you tell me another joke?" |
| 42 | + }] |
| 43 | +) |
| 44 | +``` |
| 45 | + |
| 46 | +#### For Rail |
| 47 | +``` |
| 48 | +<rail version="0.1"> |
| 49 | +<messages> |
| 50 | + <message role="system"> |
| 51 | + Given the following document, answer the following questions. If the answer doesn't exist in the document, enter 'None'. |
| 52 | + ${document} |
| 53 | + ${gr.xml_prefix_prompt} |
| 54 | + </message> |
| 55 | + <message role="user"> |
| 56 | + ${question} |
| 57 | + </message> |
| 58 | +</messages> |
| 59 | +<reask_messages> |
| 60 | + <message="system"> |
| 61 | + You were asked ${question} and it was not correct can you try again? |
| 62 | + </message> |
| 63 | +</reask_messages> |
| 64 | +</rail> |
| 65 | +``` |
| 66 | + |
| 67 | +## Improvements |
| 68 | + |
| 69 | +### Per message validation and fix support |
| 70 | +Message validation is now more granular and executed on a per message content basis. |
| 71 | +This allows for on_fix behavior to be fully supported. |
| 72 | + |
| 73 | +## Backwards-incompatible changes |
| 74 | +### Validator onFail default behavior is now exception |
| 75 | +Previously the default behavior for validation failure was noop. This meant developers were required to set it on_fail to exception or check validation_failed |
| 76 | +to know if validation failed. This was unintuitive for new users and led to confusion around if validators were working or not. This new behavior will require |
| 77 | +exception handling be added or configurations manually to be set to noop if desired. |
| 78 | + |
| 79 | +### Simplified schema injection behavior |
| 80 | +Previously prompt and instruction suffixes and formatting hints were sometimes automatically injected |
| 81 | +into prompt and instructions if guardrails detected xml or a structured schema being used for output. |
| 82 | +This caused confusion and unexpected behavior when arguments to llms were being mutated without a developer asking for it. |
| 83 | +Developers will now need to intentionally include Guardrails template variables such as `${gr.complete_xml_suffix_v2}` |
| 84 | + |
| 85 | +### Guardrails Server migration from Flask to FastAPI |
| 86 | +In 0.5.X guard.__call and guard.validate async streaming received support for on_fail="fix" merge and parallelized async validation. |
| 87 | +We have updated the server to use FastAPI which is build on ASGI to be able to fully take advantage of these improvements. |
| 88 | +config.py now fully supports the definition of AsyncGuards and streaming=true as a request argument. |
| 89 | +We recommend the combination of `gunicorn` and `uvicorn.workers.UvicornWorker`s |
| 90 | + |
| 91 | +### Streamlined prompt, instructions and msg_history arguments into messages |
| 92 | +`Guard.__call` prompt, instruction, reask_prompt and reask_instruction arguments have been streamlined into messages and reask_messages |
| 93 | +Instructions should be specified with the role system and prompts with the role user. Any of the out of the box supported llms that require only one text prompt will automatically have the messages converted to one unless a custom callable is being used. |
| 94 | +``` |
| 95 | +# version < 0.6.0 |
| 96 | +guard( |
| 97 | + instructions="you are a funny assistant", |
| 98 | + prompt="tell me a joke" |
| 99 | +) |
| 100 | +# version >= 0.6.0 |
| 101 | +guard( |
| 102 | + messages=[ |
| 103 | + {"role":"system", "content":"you are a funny assistant"}, |
| 104 | + {"role":"user", "content":"tell me a joke"} |
| 105 | + ] |
| 106 | +) |
| 107 | +``` |
| 108 | + |
| 109 | +### Removal of guardrails OpenAI, Cohere, Anthropic Callables |
| 110 | +These callables are being removed in favor of support through passing no callable and setting the appropriate api key and model argument. |
| 111 | + |
| 112 | +### Prompt no longer a required positional argument on custom callables |
| 113 | +Custom callables will no longer throw an error if the prompt arg is missing in their declaration and guardrails will no longer pass prompt as the first argument. They need to be updated to the messages kwarg to get text input. If a custom callables underlying llm only accepts a single string a helper exists that can compose messages into one otherwise some code to adapt them will be required. |
| 114 | + |
| 115 | +```py |
| 116 | +from guardrails import messages_to_prompt_string |
| 117 | + |
| 118 | +class CustomCallableCallable(PromptCallableBase): |
| 119 | + def llm_api( |
| 120 | + self, |
| 121 | + *args, |
| 122 | + **kwargs, |
| 123 | + ) -> str: |
| 124 | + messages = kwargs.pop("messages", []) |
| 125 | + prompt = messages_to_prompt_string(messages) |
| 126 | + |
| 127 | + llm_string_output = some_llm_call_requiring_prompt( |
| 128 | + prompt, |
| 129 | + *args, |
| 130 | + **kwargs, |
| 131 | + ) |
| 132 | + return llm_string_output |
| 133 | +``` |
0 commit comments