You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I ran a dry deployment using the cleaned repo on our tenancy. Listed are some of my findings & outstanding questions.
22
+
23
+
- I was able to get the client business app deployed on our tenancy. A few things I noticed -
24
+
- The code expects a llama model, at least for the on demand configuration
25
+
- Would have to be refactored if using e.g. cohere on demand
26
+
- The existing documentation suggests deploying api gateway on private subnet due to lack of authentication.
27
+
- I was able to deploy the api gateway on public subnet with oauth2.0 authentication to idcs server and invoke from oda with token, so not sure why private subnet deployment for api gateway is suggested
28
+
- Possible separate deployment down the line for connecting customer vpn
29
+
- The existing code expects api keys and wallets configured directly on the server, at least for the client business engine
30
+
- Possible future code refactor
31
+
- Redis is required but no instructions given
32
+
- There was no example data given for the vendors table, so I exported the table from the main deployment as a csv and imported to ours
33
+
- Vendors table is for client business db
34
+
- Provided csv in clientApp folder
35
+
- The business app is dependent on the trust db (trust library), i.e. the trusted prompts, which isn't intuitive
36
+
- The code expects the TRUST_LIBRARY table to have at least one entry, otherwise it bombs
37
+
- I provided a sample entry in the sql file
38
+
- The sql for the client business db is outside the clientapp directory
39
+
- There are no instructions given on which db to upload to
40
+
- Execute nl2sql_datamodel_schema on business db
41
+
- sample_setup_ras seems to apply to trust db
42
+
- sample_setup_ras wasn't required to run the business app
43
+
- The business app is exposed on an API Gateway with the main entry /prompt, which maps to <business-app-ip>:8000... this will be used by ODA app.
44
+
45
+
There are a handful of files required and provided within the repo, but no instructions on how/when to use them.
46
+
Examples include :
47
+
1. Within the rest (trust) directory there are docker files... I think we can remove these?
48
+
- Haven't tested full trust deployment yet.
49
+
2. mkdocs... this is documentation we can perhaps repurpose (at least the md files)
50
+
- Repurposed documentation in latest commit
51
+
3. sqlGenApp. Not sure where this is used
52
+
53
+
Below are the various requirements and findings from deploying the infrastructure components on our tenancy -
54
+
55
+
### ODA
56
+
57
+
1. Configure IDCS Server first
58
+
- ODA skill expects a token to execute
59
+
- Configured manually for now. Expects ODA client callback to work
60
+
2. Configured API gateway with nl2sql engine backend - provide api gateway endpoint in skill
61
+
- Configured bearer token with IDCS app
62
+
3. There are two skill zips that don't seem to be used and not referenced in the documentation -
63
+
- oda-skill-EmbeddedCont.changeit.zip
64
+
- oda-skill-ExtOracleFn.changeit.zip
65
+
66
+
### VBCS
67
+
68
+
1. The zipped askdata vbcs app in here looks to be outdated.
69
+
- It's a more simple implementation, which might be best for now
70
+
- The deployment with the extra navigation pane uses new apis on the engine
71
+
- These apis haven't been pushed to main yet
72
+
2. Reference to websocket - to be deprecated? Need to test if working without
73
+
- Tested, seems to be unnecessary
74
+
75
+
### API Gateway
76
+
1. API Gateway is configured with Single Authentication OAuth2.0 which requires a vault.
77
+
2. The existing mkdocs documentation said to deploy the api gateway to private subnet due to lack of authentication... authentication can be added to api gateway on public subnet
78
+
- Can possibly add different implementation later for connecting to customer vpn
79
+
80
+
### Redis
81
+
1. Redis is required but there were no instructions given on configuration
82
+
83
+
### Generative AI
84
+
1. Existing deployment was using dedicated ai cluster/data science. I was able to get it to work with on demand model.
85
+
- Code is hard coded to handle only the llama models. Cohere models would require refactoring.
86
+
- Haven't tested the deployment with dedicated cluster. This would require gpus which we don't have for our tenancy
87
+
- Haven't tested data science deployment
88
+
89
+
### NL2SQL Business Engine
90
+
1. The code is currently expecting the user to upload their own api keys to the server
91
+
2. Database wallets need to be uploaded manually
92
+
3. png files trusted & untrusted.png are required to run the server.
93
+
94
+
### Client Database
95
+
1. The vendors table didn't have any example data. I had to export the table from the existing implementation and import as csv
96
+
- Included csv in repo
97
+
98
+
### Trust Database
99
+
1. Engine code expects at least one entry in Trust library table before execution
100
+
- Provided an example entry with sample embedding
101
+
102
+
### Trust REST Framework
103
+
Haven't gotten this far, but the basic prompt endpoint does use the trust library table.
104
+
105
+
## APEX
106
+
tbd ...
107
+
108
+
### Troubleshooting
109
+
110
+
1. Graph isn't showing in Table Graph VB App
111
+
- Solution: Make sure to assign user role to idcs group in app settings
Copy file name to clipboardExpand all lines: README.md
-109Lines changed: 0 additions & 109 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -39,112 +39,3 @@ Licensed under the Universal Permissive License (UPL), Version 1.0.
39
39
See [LICENSE](LICENSE.txt) for more details.
40
40
41
41
ORACLE AND ITS AFFILIATES DO NOT PROVIDE ANY WARRANTY WHATSOEVER, EXPRESS OR IMPLIED, FOR ANY SOFTWARE, MATERIAL OR CONTENT OF ANY KIND CONTAINED OR PRODUCED WITHIN THIS REPOSITORY, AND IN PARTICULAR SPECIFICALLY DISCLAIM ANY AND ALL IMPLIED WARRANTIES OF TITLE, NON-INFRINGEMENT, MERCHANTABILITY, AND FITNESS FOR A PARTICULAR PURPOSE. FURTHERMORE, ORACLE AND ITS AFFILIATES DO NOT REPRESENT THAT ANY CUSTOMARY SECURITY REVIEW HAS BEEN PERFORMED WITH RESPECT TO ANY SOFTWARE, MATERIAL OR CONTENT CONTAINED OR PRODUCED WITHIN THIS REPOSITORY. IN ADDITION, AND WITHOUT LIMITING THE FOREGOING, THIRD PARTIES MAY HAVE POSTED SOFTWARE, MATERIAL OR CONTENT TO THIS REPOSITORY WITHOUT ANY REVIEW. USE AT YOUR OWN RISK.
42
-
## Deployment Steps
43
-
44
-
1. Deploy Terraform Script
45
-
2. Configure Business App
46
-
- Configure Business DB
47
-
- Configure Trust DB
48
-
3. Configure IDCS App
49
-
4. Configure API Gateway
50
-
5. Configure Trust App
51
-
6. Configure ODA Skills
52
-
7. Configure VB Apps
53
-
54
-
### TBD
55
-
8. Deploy Trust Framework
56
-
9. Deploy APEX
57
-
58
-
## Overview
59
-
60
-
I ran a dry deployment using the cleaned repo on our tenancy. Listed are some of my findings & outstanding questions.
61
-
62
-
- I was able to get the client business app deployed on our tenancy. A few things I noticed -
63
-
- The code expects a llama model, at least for the on demand configuration
64
-
- Would have to be refactored if using e.g. cohere on demand
65
-
- The existing documentation suggests deploying api gateway on private subnet due to lack of authentication.
66
-
- I was able to deploy the api gateway on public subnet with oauth2.0 authentication to idcs server and invoke from oda with token, so not sure why private subnet deployment for api gateway is suggested
67
-
- Possible separate deployment down the line for connecting customer vpn
68
-
- The existing code expects api keys and wallets configured directly on the server, at least for the client business engine
69
-
- Possible future code refactor
70
-
- Redis is required but no instructions given
71
-
- There was no example data given for the vendors table, so I exported the table from the main deployment as a csv and imported to ours
72
-
- Vendors table is for client business db
73
-
- Provided csv in clientApp folder
74
-
- The business app is dependent on the trust db (trust library), i.e. the trusted prompts, which isn't intuitive
75
-
- The code expects the TRUST_LIBRARY table to have at least one entry, otherwise it bombs
76
-
- I provided a sample entry in the sql file
77
-
- The sql for the client business db is outside the clientapp directory
78
-
- There are no instructions given on which db to upload to
79
-
- Execute nl2sql_datamodel_schema on business db
80
-
- sample_setup_ras seems to apply to trust db
81
-
- sample_setup_ras wasn't required to run the business app
82
-
- The business app is exposed on an API Gateway with the main entry /prompt, which maps to <business-app-ip>:8000... this will be used by ODA app.
83
-
84
-
There are a handful of files required and provided within the repo, but no instructions on how/when to use them.
85
-
Examples include :
86
-
1. Within the rest (trust) directory there are docker files... I think we can remove these?
87
-
- Haven't tested full trust deployment yet.
88
-
2. mkdocs... this is documentation we can perhaps repurpose (at least the md files)
89
-
- Repurposed documentation in latest commit
90
-
3. sqlGenApp. Not sure where this is used
91
-
92
-
Below are the various requirements and findings from deploying the infrastructure components on our tenancy -
93
-
94
-
### ODA
95
-
96
-
1. Configure IDCS Server first
97
-
- ODA skill expects a token to execute
98
-
- Configured manually for now. Expects ODA client callback to work
99
-
2. Configured API gateway with nl2sql engine backend - provide api gateway endpoint in skill
100
-
- Configured bearer token with IDCS app
101
-
3. There are two skill zips that don't seem to be used and not referenced in the documentation -
102
-
- oda-skill-EmbeddedCont.changeit.zip
103
-
- oda-skill-ExtOracleFn.changeit.zip
104
-
105
-
### VBCS
106
-
107
-
1. The zipped askdata vbcs app in here looks to be outdated.
108
-
- It's a more simple implementation, which might be best for now
109
-
- The deployment with the extra navigation pane uses new apis on the engine
110
-
- These apis haven't been pushed to main yet
111
-
2. Reference to websocket - to be deprecated? Need to test if working without
112
-
- Tested, seems to be unnecessary
113
-
114
-
### API Gateway
115
-
1. API Gateway is configured with Single Authentication OAuth2.0 which requires a vault.
116
-
2. The existing mkdocs documentation said to deploy the api gateway to private subnet due to lack of authentication... authentication can be added to api gateway on public subnet
117
-
- Can possibly add different implementation later for connecting to customer vpn
118
-
119
-
### Redis
120
-
1. Redis is required but there were no instructions given on configuration
121
-
122
-
### Generative AI
123
-
1. Existing deployment was using dedicated ai cluster/data science. I was able to get it to work with on demand model.
124
-
- Code is hard coded to handle only the llama models. Cohere models would require refactoring.
125
-
- Haven't tested the deployment with dedicated cluster. This would require gpus which we don't have for our tenancy
126
-
- Haven't tested data science deployment
127
-
128
-
### NL2SQL Business Engine
129
-
1. The code is currently expecting the user to upload their own api keys to the server
130
-
2. Database wallets need to be uploaded manually
131
-
3. png files trusted & untrusted.png are required to run the server.
132
-
133
-
### Client Database
134
-
1. The vendors table didn't have any example data. I had to export the table from the existing implementation and import as csv
135
-
- Included csv in repo
136
-
137
-
### Trust Database
138
-
1. Engine code expects at least one entry in Trust library table before execution
139
-
- Provided an example entry with sample embedding
140
-
141
-
### Trust REST Framework
142
-
Haven't gotten this far, but the basic prompt endpoint does use the trust library table.
143
-
144
-
## APEX
145
-
tbd ...
146
-
147
-
### Troubleshooting
148
-
149
-
1. Graph isn't showing in Table Graph VB App
150
-
- Solution: Make sure to assign user role to idcs group in app settings
0 commit comments