Skip to content

Intra-vendor model routing support for AI APIs #883

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
Krishanx92 merged 15 commits into from
Feb 14, 2025
Merged

Intra-vendor model routing support for AI APIs #883

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
15 commits
Select commit Hold shift + click to select a range
75018b6
Add admin portal changes for model listing under vendor
ashera96 Jan 26, 2025
d0ba1f7
Add initial changes for multi-endpoint support
ashera96 Feb 3, 2025
0c7d82d
Update endpoints page to support multiple endpoints for AI APIs
ashera96 Feb 4, 2025
92b5f11
Add UI changes for multi-endpoint support
ashera96 Feb 5, 2025
fb94e3e
Update endpoints UI for AI APIs
ashera96 Feb 6, 2025
81a12b3
Add initial changes for round robin policy
ashera96 Feb 6, 2025
60e56af
Add model round robin policy
ashera96 Feb 7, 2025
d0660c3
Add certificate section for AI API endpoints page
ashera96 Feb 7, 2025
a1130c7
Minor modifications
ashera96 Feb 9, 2025
c0bf6ac
Add intra-vendor model routing policies
ashera96 Feb 10, 2025
0a7b037
Fix model list retrieval
ashera96 Feb 11, 2025
878f158
Update round robin and weighted round robin policy configuring logic
ashera96 Feb 11, 2025
dc36cef
Add filtering logic to only show AI policies within AI APIs
ashera96 Feb 12, 2025
412c694
Rename environment as deploymentStage
ashera96 Feb 13, 2025
3776241
Update AI vendor LLM configurations section
ashera96 Feb 13, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions portals/admin/src/main/webapp/.eslintrc.js
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,7 @@ module.exports = {
jsx: true,
modules: true,
},
requireConfigFile: false,
babelOptions: {
presets: ['@babel/preset-react', '@babel/preset-typescript'],
},
Expand Down
51 changes: 43 additions & 8 deletions portals/admin/src/main/webapp/site/public/locales/en.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,33 @@
"AdminPages.KeyManagers.List.empty.content.keymanagers": "It is possible to register an OAuth Provider.",
"AdminPages.KeyManagers.Usages.dialog.close.btn": "Close",
"AdminPages.KeyManagers.Usages.dialog.title": "Key Manager Usages -",
"AdminPages.Labels.AddEdit.form.add.successful": "Label added successfully",
"AdminPages.Labels.AddEdit.form.description": "Description",
"AdminPages.Labels.AddEdit.form.description.helper.text": "Description of the Label",
"AdminPages.Labels.AddEdit.form.edit.successful": "Label edited successfully",
"AdminPages.Labels.AddEdit.form.error.description.too.long": "Label description is too long",
"AdminPages.Labels.AddEdit.form.error.name.empty": "Name is Empty",
"AdminPages.Labels.AddEdit.form.error.name.has.spaces": "Name contains spaces",
"AdminPages.Labels.AddEdit.form.error.name.has.special.chars": "Name field contains special characters",
"AdminPages.Labels.AddEdit.form.error.name.too.long": "Label name is too long",
"AdminPages.Labels.AddEdit.form.name": "Name",
"AdminPages.Labels.AddEdit.form.name.helper.text": "Name of the Label",
"AdminPages.Labels.AddEdit.form.save.btn": "Save",
"AdminPages.Labels.Delete.form.delete.btn": "Delete",
"AdminPages.Labels.Delete.form.delete.content": "Are you sure you want to delete this Label?",
"AdminPages.Labels.Delete.form.delete.successful": "Label deleted successfully",
"AdminPages.Labels.Delete.form.delete.title": "Delete Label?",
"AdminPages.Labels.List.addButtonProps.title": "Add Label",
"AdminPages.Labels.List.addButtonProps.triggerButtonText": "Add Label",
"AdminPages.Labels.List.empty.content.labels": "Labels help you organize and group your artifacts, such as APIs, in a simple and flexible way. You can define labels to tag your artifacts based on usecases, categories, domains, or any criteria you choose.",
"AdminPages.Labels.List.empty.title.labels": "Labels",
"AdminPages.Labels.List.search.default": "Search by Label name",
"AdminPages.Labels.List.title.labels": "Labels",
"AdminPages.Labels.Usages.dialog.close.btn": "Close",
"AdminPages.Labels.Usages.dialog.title": "Labels Usages -",
"AdminPages.Labels.table.header.label.description": "Description",
"AdminPages.Labels.table.header.label.name": "Label Name",
"AdminPages.Labels.table.header.label.usage": "Usage",
"AdminPages.Organization.AddEdit.form.error.description.too.long": "Organization description is too long",
"AdminPages.Organizations.AddEdit.form.add.successful": "Organizations added successfully",
"AdminPages.Organizations.AddEdit.form.description": "Description",
Expand All @@ -183,7 +210,7 @@
"AdminPages.Organizations.Delete.form.delete.title": "Delete Organization?",
"AdminPages.Organizations.List.addButtonProps.title": "Register Organization",
"AdminPages.Organizations.List.addButtonProps.triggerButtonText": "Register Organization",
"AdminPages.Organizations.List.empty.content.organization": "You can register organizations here to map the organizations that are created in an External Identity Provider. You should belong to an organization to access this feature.",
"AdminPages.Organizations.List.empty.content.organization": "Manage your organizations by registering new organizations or updating existing entries.",
"AdminPages.Organizations.List.empty.title.organization": "Organizations",
"AdminPages.Organizations.List.search.default": "Search by Organization Name",
"AdminPages.Organizations.List.title.organizations": "Organizations",
Expand All @@ -206,12 +233,13 @@
"AiVendors.AddEditAiVendor.form.add": "Add",
"AiVendors.AddEditAiVendor.form.cancel": "Cancel",
"AiVendors.AddEditAiVendor.form.connectorType": "Connector Type",
"AiVendors.AddEditAiVendor.form.connectorType.help": "Connector Type for AI/LLM Vendor",
"AiVendors.AddEditAiVendor.form.description": "Description",
"AiVendors.AddEditAiVendor.form.description.help": "Description of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.displayName.help": "API Version of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.has.errors": "One or more fields contain errors.",
"AiVendors.AddEditAiVendor.form.name": "Name",
"AiVendors.AddEditAiVendor.form.name.help": "Connector Type for AI/LLM Vendor",
"AiVendors.AddEditAiVendor.form.name.help": "Name of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.update.btn": "Update",
"AiVendors.AddEditAiVendor.general.details": "General Details",
"AiVendors.AddEditAiVendor.general.details.description": "Provide name and description of the AI/LLM Vendor",
Expand All @@ -220,6 +248,10 @@
"AiVendors.AddEditAiVendor.is.empty.error.attributeIdentifier": "Attribute identifier is required.",
"AiVendors.AddEditAiVendor.is.empty.error.connectorType": "Connector type is required.",
"AiVendors.AddEditAiVendor.is.empty.error.inputSource": "Input source is required.",
"AiVendors.AddEditAiVendor.modelList": "Model List",
"AiVendors.AddEditAiVendor.modelList.description": "List down AI/LLM Vendor supported model list",
"AiVendors.AddEditAiVendor.modelList.help": "Type available models and press enter/return to add them.",
"AiVendors.AddEditAiVendor.modelList.placeholder": "Type Model name and press Enter",
"AiVendors.AddEditAiVendor.title.edit": "AI/LLM Vendor - Edit",
"AiVendors.AddEditAiVendor.title.new": "AI/LLM Vendor - Create new",
"AiVendors.AiAPIDefinition.browse.files.to.upload": "Browse File to Upload",
Expand Down Expand Up @@ -324,8 +356,9 @@
"Base.RouteMenuMapping.keymanagers": "Key Managers",
"Base.RouteMenuMapping.keymanagers.items.Adding": "Add Key Manager",
"Base.RouteMenuMapping.keymanagers.items.Editing": "Edit Key Manager",
"Base.RouteMenuMapping.overview": "Overview",
"Base.RouteMenuMapping.labels": "Labels",
"Base.RouteMenuMapping.organizations": "Organizations",
"Base.RouteMenuMapping.overview": "Overview",
"Base.RouteMenuMapping.role.permissions": "Scope Assignments",
"Base.RouteMenuMapping.ruleset.catalog": "Ruleset Catalog",
"Base.RouteMenuMapping.settings": "Settings",
Expand Down Expand Up @@ -578,11 +611,6 @@
"Governance.Rulesets.AddEdit.general.details.description": "Provide name and description of the ruleset.",
"Governance.Rulesets.AddEdit.title.edit": "Edit Ruleset - {name}",
"Governance.Rulesets.AddEdit.title.new": "Create New Ruleset",
"Governance.Rulesets.Create.genai": "Create with GenAI",
"Governance.Rulesets.Create.genai.desc": "Use AI to help you create a ruleset",
"Governance.Rulesets.Create.options": "Choose Creation Method",
"Governance.Rulesets.Create.scratch": "Create from Scratch",
"Governance.Rulesets.Create.scratch.desc": "Create a ruleset manually",
"Governance.Rulesets.List.add.new.ruleset": "Create Ruleset",
"Governance.Rulesets.List.addRuleset.title": "Create Ruleset",
"Governance.Rulesets.List.addRuleset.triggerButtonText": "Create Ruleset",
Expand Down Expand Up @@ -730,6 +758,13 @@
"Keymanager.Local.Claim": "Local Claim",
"Keymanager.Local.Claim.remove": "Remove",
"Keymanager.Remote.Claim": "Remote Claim",
"Labels.AddEditLabel.api.no.usages": "No API usages for this Label specifically.",
"Labels.AddEditLabel.usages": "Label Usage",
"Labels.ListLabelUsages.API.usages.count.multiple": "{count} APIs are using this label specifically",
"Labels.ListLabelUsages.API.usages.count.one": "1 API is using this Label specifically.",
"Labels.ListLabelUsages.permission.denied.content": "You dont have enough permission to view Label Usages. Please contact the site administrator.",
"Labels.ListLabelUsages.permission.denied.title": "Permission Denied",
"Labels.ListLabelsAPIUsages.error": "Unable to get Label API usage details",
"LoginDenied.logout": "Logout",
"LoginDenied.message": "The server could not verify that you are authorized to access the requested resource.",
"LoginDenied.retry": "Retry",
Expand Down
51 changes: 43 additions & 8 deletions portals/admin/src/main/webapp/site/public/locales/fr.json
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -167,6 +167,33 @@
"AdminPages.KeyManagers.List.empty.content.keymanagers": "It is possible to register an OAuth Provider.",
"AdminPages.KeyManagers.Usages.dialog.close.btn": "Close",
"AdminPages.KeyManagers.Usages.dialog.title": "Key Manager Usages -",
"AdminPages.Labels.AddEdit.form.add.successful": "Label added successfully",
"AdminPages.Labels.AddEdit.form.description": "Description",
"AdminPages.Labels.AddEdit.form.description.helper.text": "Description of the Label",
"AdminPages.Labels.AddEdit.form.edit.successful": "Label edited successfully",
"AdminPages.Labels.AddEdit.form.error.description.too.long": "Label description is too long",
"AdminPages.Labels.AddEdit.form.error.name.empty": "Name is Empty",
"AdminPages.Labels.AddEdit.form.error.name.has.spaces": "Name contains spaces",
"AdminPages.Labels.AddEdit.form.error.name.has.special.chars": "Name field contains special characters",
"AdminPages.Labels.AddEdit.form.error.name.too.long": "Label name is too long",
"AdminPages.Labels.AddEdit.form.name": "Name",
"AdminPages.Labels.AddEdit.form.name.helper.text": "Name of the Label",
"AdminPages.Labels.AddEdit.form.save.btn": "Save",
"AdminPages.Labels.Delete.form.delete.btn": "Delete",
"AdminPages.Labels.Delete.form.delete.content": "Are you sure you want to delete this Label?",
"AdminPages.Labels.Delete.form.delete.successful": "Label deleted successfully",
"AdminPages.Labels.Delete.form.delete.title": "Delete Label?",
"AdminPages.Labels.List.addButtonProps.title": "Add Label",
"AdminPages.Labels.List.addButtonProps.triggerButtonText": "Add Label",
"AdminPages.Labels.List.empty.content.labels": "Labels help you organize and group your artifacts, such as APIs, in a simple and flexible way. You can define labels to tag your artifacts based on usecases, categories, domains, or any criteria you choose.",
"AdminPages.Labels.List.empty.title.labels": "Labels",
"AdminPages.Labels.List.search.default": "Search by Label name",
"AdminPages.Labels.List.title.labels": "Labels",
"AdminPages.Labels.Usages.dialog.close.btn": "Close",
"AdminPages.Labels.Usages.dialog.title": "Labels Usages -",
"AdminPages.Labels.table.header.label.description": "Description",
"AdminPages.Labels.table.header.label.name": "Label Name",
"AdminPages.Labels.table.header.label.usage": "Usage",
"AdminPages.Organization.AddEdit.form.error.description.too.long": "Organization description is too long",
"AdminPages.Organizations.AddEdit.form.add.successful": "Organizations added successfully",
"AdminPages.Organizations.AddEdit.form.description": "Description",
Expand All @@ -183,7 +210,7 @@
"AdminPages.Organizations.Delete.form.delete.title": "Delete Organization?",
"AdminPages.Organizations.List.addButtonProps.title": "Register Organization",
"AdminPages.Organizations.List.addButtonProps.triggerButtonText": "Register Organization",
"AdminPages.Organizations.List.empty.content.organization": "You can register organizations here to map the organizations that are created in an External Identity Provider. You should belong to an organization to access this feature.",
"AdminPages.Organizations.List.empty.content.organization": "Manage your organizations by registering new organizations or updating existing entries.",
"AdminPages.Organizations.List.empty.title.organization": "Organizations",
"AdminPages.Organizations.List.search.default": "Search by Organization Name",
"AdminPages.Organizations.List.title.organizations": "Organizations",
Expand All @@ -206,12 +233,13 @@
"AiVendors.AddEditAiVendor.form.add": "Add",
"AiVendors.AddEditAiVendor.form.cancel": "Cancel",
"AiVendors.AddEditAiVendor.form.connectorType": "Connector Type",
"AiVendors.AddEditAiVendor.form.connectorType.help": "Connector Type for AI/LLM Vendor",
"AiVendors.AddEditAiVendor.form.description": "Description",
"AiVendors.AddEditAiVendor.form.description.help": "Description of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.displayName.help": "API Version of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.has.errors": "One or more fields contain errors.",
"AiVendors.AddEditAiVendor.form.name": "Name",
"AiVendors.AddEditAiVendor.form.name.help": "Connector Type for AI/LLM Vendor",
"AiVendors.AddEditAiVendor.form.name.help": "Name of the AI/LLM Vendor.",
"AiVendors.AddEditAiVendor.form.update.btn": "Update",
"AiVendors.AddEditAiVendor.general.details": "General Details",
"AiVendors.AddEditAiVendor.general.details.description": "Provide name and description of the AI/LLM Vendor",
Expand All @@ -220,6 +248,10 @@
"AiVendors.AddEditAiVendor.is.empty.error.attributeIdentifier": "Attribute identifier is required.",
"AiVendors.AddEditAiVendor.is.empty.error.connectorType": "Connector type is required.",
"AiVendors.AddEditAiVendor.is.empty.error.inputSource": "Input source is required.",
"AiVendors.AddEditAiVendor.modelList": "Model List",
"AiVendors.AddEditAiVendor.modelList.description": "List down AI/LLM Vendor supported model list",
"AiVendors.AddEditAiVendor.modelList.help": "Type available models and press enter/return to add them.",
"AiVendors.AddEditAiVendor.modelList.placeholder": "Type Model name and press Enter",
"AiVendors.AddEditAiVendor.title.edit": "AI/LLM Vendor - Edit",
"AiVendors.AddEditAiVendor.title.new": "AI/LLM Vendor - Create new",
"AiVendors.AiAPIDefinition.browse.files.to.upload": "Browse File to Upload",
Expand Down Expand Up @@ -324,8 +356,9 @@
"Base.RouteMenuMapping.keymanagers": "Key Managers",
"Base.RouteMenuMapping.keymanagers.items.Adding": "Add Key Manager",
"Base.RouteMenuMapping.keymanagers.items.Editing": "Edit Key Manager",
"Base.RouteMenuMapping.overview": "Overview",
"Base.RouteMenuMapping.labels": "Labels",
"Base.RouteMenuMapping.organizations": "Organizations",
"Base.RouteMenuMapping.overview": "Overview",
"Base.RouteMenuMapping.role.permissions": "Scope Assignments",
"Base.RouteMenuMapping.ruleset.catalog": "Ruleset Catalog",
"Base.RouteMenuMapping.settings": "Settings",
Expand Down Expand Up @@ -578,11 +611,6 @@
"Governance.Rulesets.AddEdit.general.details.description": "Provide name and description of the ruleset.",
"Governance.Rulesets.AddEdit.title.edit": "Edit Ruleset - {name}",
"Governance.Rulesets.AddEdit.title.new": "Create New Ruleset",
"Governance.Rulesets.Create.genai": "Create with GenAI",
"Governance.Rulesets.Create.genai.desc": "Use AI to help you create a ruleset",
"Governance.Rulesets.Create.options": "Choose Creation Method",
"Governance.Rulesets.Create.scratch": "Create from Scratch",
"Governance.Rulesets.Create.scratch.desc": "Create a ruleset manually",
"Governance.Rulesets.List.add.new.ruleset": "Create Ruleset",
"Governance.Rulesets.List.addRuleset.title": "Create Ruleset",
"Governance.Rulesets.List.addRuleset.triggerButtonText": "Create Ruleset",
Expand Down Expand Up @@ -730,6 +758,13 @@
"Keymanager.Local.Claim": "Local Claim",
"Keymanager.Local.Claim.remove": "Remove",
"Keymanager.Remote.Claim": "Remote Claim",
"Labels.AddEditLabel.api.no.usages": "No API usages for this Label specifically.",
"Labels.AddEditLabel.usages": "Label Usage",
"Labels.ListLabelUsages.API.usages.count.multiple": "{count} APIs are using this label specifically",
"Labels.ListLabelUsages.API.usages.count.one": "1 API is using this Label specifically.",
"Labels.ListLabelUsages.permission.denied.content": "You dont have enough permission to view Label Usages. Please contact the site administrator.",
"Labels.ListLabelUsages.permission.denied.title": "Permission Denied",
"Labels.ListLabelsAPIUsages.error": "Unable to get Label API usage details",
"LoginDenied.logout": "Logout",
"LoginDenied.message": "The server could not verify that you are authorized to access the requested resource.",
"LoginDenied.retry": "Retry",
Expand Down
Loading
Loading