-
Notifications
You must be signed in to change notification settings - Fork 1
Packages/aiinfo/authoringassistance #175
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
3 commits
Select commit
Hold shift + click to select a range
File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change | ||||
|---|---|---|---|---|---|---|
|
|
@@ -7,6 +7,12 @@ discussionInsights,2025.10.02,Insights for Discussions,"Discussion Insights uses | |||||
| smartSearch,2025.10.02,Search,Natural language search of course content for students and instructors.,Cohere Embed Multilingual,Cohere models are provided via Amazon Bedrock Foundation Models (FMs).,No,Course,Course content is indexed by the model and then stored in the Canvas database.,Data is not stored or reused by the model. Indexed course content is stored in the Canvas database.,Does not log data,,Global,,Not Exposed,"PII in course content may be indexed, but no PII is intentionally sent to the model.",Yes,Yes,Users are presented with a list of results related to their search query and can act or not act on them.,,Search results may be incorrectly sorted or may not be relevant to the search term.,"Students are able to quickly find answers to questions, and instructors are able to quickly navigate their courses.",Canvas,2 | ||||||
| askyourdata,2025.09.12,Ask Your Data,AI-powered query tool enables users to ask natural language questions and receive textual or visual responses with detailed explanations of the methodology.,Doowii (multiple),"Doowii is a third-party sub-processor for Intelligent Insights. Doowii's tools use OpenAI GPT-4o, GPT-3.5 Turbo, and Claude Sonnet 3.5",No,Other,"Doowii is trained on the Canvas LMS database schema, and receives no data from Canvas. The user's prompt and heuristics (such as summary statistics) are shared with the model to generate a response.",Data is retained through the life of your contract with Instructure.,Logs data,,Global,,Exposed,"Prompt, summary statistics.",Yes,Yes,Ask your data returns a methodology description along with a generated query. Users have the ability to edit the generated SQL directly.,"Questions are scoped to the domain only, highly ambiguous terms ask for clarification.",Incorrect interpretation of the question. Inaccurate SQL may be generated. Suggested questions or methodologies may not be relevant.,Provide accurate data retrieval and analysis through natural language prompting.,Intelligent Insights,2 | ||||||
| canvasDiscussionSummaries,2025.09.12,Summaries for Discussions,"Discussion summaries of key points, questions, and insights.",Haiku 3,Anthropic Claude models are provided via Amazon Bedrock Foundation Models (FMs).,No,Course,Discussion prompt and replies.,Data is not stored or reused by the model.,Logs data,Summaries are logged in the Canvas database for review and reuse.,Global,,Not Exposed,"Pii in discussion replies may be sent to the model, but no PII is intentionally sent to the model.",Yes,Yes,Instructors may regenerate summaries or fine-tune them with additional instructions.,,Summaries may not capture all desired information.,Summaries allow discussion topics to be used in large-format courses and other environments where discussions were previously infeasible.,Canvas,2 | ||||||
| itemAuthoringAssistance,2025.11.18,Question Authoring,"Question Authoring Assistance for Quizzes streamlines quiz creation by generating questions based on your course materials. | ||||||
| ",Haiku 3,Anthropic Claude models are provided via Instructure's in-house AI Platform.,No,Course,"Source material provided by the user (e.g., Custom standards, course content, text input, file input) for question/item generation.",Data is not stored or reused by the model.,Logs data,Usage data is logged to improve the product.,Global,,Not Exposed,"PII in source material may be sent to the model if included by the user, but no PII is intentionally sent to the model.",Yes,Yes,"Instructors can review, edit, regenerate, or provide additional instructions to refine generated items.",,"Generated items may not perfectly capture all desired information, require refinement, or occasionally contain inaccuracies. | ||||||
| ",Improved instructor efficiency and productivity,Canvas,2 | ||||||
| assessmentAuthoringAssistance,2025.11.18,Item Authoring,"Item Authoring for Assessments streamlines assessment creation by generating questions based on your course materials. | ||||||
|
||||||
| assessmentAuthoringAssistance,2025.11.18,Item Authoring,"Item Authoring for Assessments streamlines assessment creation by generating questions based on your course materials. | |
| assessmentauthoringassistance,2025.11.18,Item Authoring,"Item Authoring for Assessments streamlines assessment creation by generating questions based on your course materials. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
214 changes: 214 additions & 0 deletions
214
packages/aiinfo/node/components/assessmentauthoringassistance/index.ts
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,214 @@ | ||
| import type { | ||
| AiInformationProps, | ||
| DataPermissionLevelsProps, | ||
| NutritionFactsProps, | ||
| } from "@instructure/ui-instructure"; | ||
| import type { AiInfoFeatureProps } from "../../types"; | ||
|
|
||
| const FEATURE_NAME = "Item Authoring"; | ||
| const UID = "assessmentauthoringassistance"; | ||
| const DATA_PERMISSION_LEVELS: DataPermissionLevelsProps["data"] = [ | ||
| { | ||
| description: | ||
| "We leverage anonymized aggregate data for detailed analytics to inform model development and product improvements. No AI models are used at this level.", | ||
| highlighted: false, | ||
| level: "LEVEL 1", | ||
| title: "Descriptive Analytics and Research", | ||
| }, | ||
| { | ||
| description: | ||
| "We utilize off-the-shelf AI models and customer data as input to provide AI-powered features. No data is used for training this model.", | ||
| highlighted: true, | ||
| level: "LEVEL 2", | ||
| title: "AI-Powered Features Without Data Training", | ||
| }, | ||
| { | ||
| description: | ||
| "We customize AI solutions tailored to the unique needs and resources of educational institutions. We use customer data to fine-tune data and train AI models that only serve your institution. Your institution's data only serves them through trained models.", | ||
| highlighted: false, | ||
| level: "LEVEL 3", | ||
| title: "AI Customization for Individual Institutions", | ||
| }, | ||
| { | ||
| description: | ||
| "We established a consortium with educational institutions that shares anonymized data, best practices, and research findings. This fosters collaboration and accelerates the responsible development of AI in education. Specialized AI models are created for better outcomes in education, cost savings, and more.", | ||
| highlighted: false, | ||
| level: "LEVEL 4", | ||
| title: "Collaborative AI Consortium", | ||
| }, | ||
| ]; | ||
| const NUTRITION_FACTS_DATA: NutritionFactsProps["data"] = [ | ||
| { | ||
| blockTitle: "Model & Data", | ||
| segmentData: [ | ||
| { | ||
| description: | ||
| "The foundational AI on which further training and customizations are built.", | ||
| segmentTitle: "Base Model", | ||
| value: "Haiku 3", | ||
| valueDescription: | ||
| "Anthropic Claude models are provided via Instructure's in-house AI Platform.", | ||
| }, | ||
| { | ||
| description: | ||
| "Indicates the AI model has been given customer data in order to improve its results.", | ||
| segmentTitle: "Trained with User Data", | ||
| value: "No", | ||
| }, | ||
| { | ||
| description: | ||
| "Indicates which training or operational content was given to the model.", | ||
| segmentTitle: "Data Shared with Model", | ||
| value: | ||
| "Source material provided by the user (e.g., Custom standards, course content, text input, file input) for question/item generation.", | ||
| }, | ||
| ], | ||
| }, | ||
| { | ||
| blockTitle: "Privacy & Compliance", | ||
| segmentData: [ | ||
| { | ||
| description: "How long the model stores customer data.", | ||
| segmentTitle: "Data Retention", | ||
| value: "Data is not stored or reused by the model.", | ||
| }, | ||
| { | ||
| description: | ||
| "Recording the AI's performance for auditing, analysis, and improvement.", | ||
| segmentTitle: "Data Logging", | ||
| value: "Logs data", | ||
| valueDescription: "Usage data is logged to improve the product.", | ||
| }, | ||
| { | ||
| description: | ||
| "The locations where the AI model is officially available and supported.", | ||
| segmentTitle: "Regions Supported", | ||
| value: "Global", | ||
| valueDescription: "", | ||
| }, | ||
| { | ||
| description: | ||
| "Sensitive data that can be used to identify an individual.", | ||
| segmentTitle: "PII", | ||
| value: "Not Exposed", | ||
| valueDescription: | ||
| "PII in source material may be sent to the model if included by the user, but no PII is intentionally sent to the model.", | ||
| }, | ||
| ], | ||
| }, | ||
| { | ||
| blockTitle: "Outputs", | ||
| segmentData: [ | ||
| { | ||
| description: "The ability to turn the AI on or off within the product.", | ||
| segmentTitle: "AI Settings Control", | ||
| value: "Yes", | ||
| }, | ||
| { | ||
| description: | ||
| "Indicates if a human is involved in the AI's process or output.", | ||
| segmentTitle: "Human in the Loop", | ||
| value: "Yes", | ||
| valueDescription: | ||
| "Instructors can review, edit, regenerate, or provide additional instructions to refine generated items.", | ||
| }, | ||
| { | ||
| description: | ||
| "Preventative safety mechanisms or limitations built into the AI model.", | ||
| segmentTitle: "Guardrails", | ||
| value: "", | ||
| }, | ||
| { | ||
| description: "Any risks the model may pose to the user.", | ||
| segmentTitle: "Expected Risks", | ||
| value: | ||
| "Generated items may not perfectly capture all desired information, require refinement, or occasionally contain inaccuracies.\n", | ||
| }, | ||
| { | ||
| description: "The specific results the AI model is meant to achieve.", | ||
| segmentTitle: "Intended Outcomes", | ||
| value: "Improved instructor efficiency and productivity", | ||
| }, | ||
| ], | ||
| }, | ||
| ]; | ||
| const nutritionFacts: NutritionFactsProps = { | ||
| ...{ | ||
| closeButtonText: "Close", | ||
| closeIconButtonScreenReaderLabel: "Close", | ||
| data: undefined, | ||
| featureName: "Item Authoring", | ||
| modalLabel: "This is a modal for AI facts", | ||
| title: "AI Nutrition Facts", | ||
| triggerText: "Nutrition Facts", | ||
| }, | ||
| data: NUTRITION_FACTS_DATA, | ||
| featureName: FEATURE_NAME, | ||
| }; | ||
| const dataPermissionLevels: DataPermissionLevelsProps = { | ||
| ...{ | ||
| closeButtonText: "Close", | ||
| closeIconButtonScreenReaderLabel: "Close dialog", | ||
| currentFeature: "Item Authoring", | ||
| currentFeatureText: "Current Feature:", | ||
| data: undefined, | ||
| modalLabel: "Data Permission Levels modal", | ||
| title: "Data Permission Levels", | ||
| triggerText: "Data Permission Levels", | ||
| }, | ||
| currentFeature: FEATURE_NAME, | ||
| data: DATA_PERMISSION_LEVELS, | ||
| }; | ||
| const aiInformation: AiInformationProps = { | ||
| ...{ | ||
| data: [ | ||
| { | ||
| description: | ||
| "We utilize off-the-shelf AI models and customer data as input to provide AI-powered features. No data is used for training this model.", | ||
| featureName: "Item Authoring", | ||
| modelName: "Haiku 3", | ||
| modelNameText: "Base Model", | ||
| nutritionFactsModalTriggerText: "AI Nutrition Facts", | ||
| permissionLevel: "LEVEL 2", | ||
| permissionLevelsModalTriggerText: "Data Permission Levels", | ||
| permissionLevelText: "Permission Level:", | ||
| }, | ||
| ], | ||
| dataPermissionLevelsCloseButtonText: "Close", | ||
| dataPermissionLevelsCloseIconButtonScreenReaderLabel: "Close dialog", | ||
| dataPermissionLevelsCurrentFeature: "Item Authoring", | ||
| dataPermissionLevelsCurrentFeatureText: "Current Feature:", | ||
| dataPermissionLevelsData: undefined, | ||
| dataPermissionLevelsModalLabel: "Data Permission Levels modal", | ||
| dataPermissionLevelsTitle: "Data Permission Levels", | ||
| nutritionFactsCloseButtonText: "Close", | ||
| nutritionFactsCloseIconButtonScreenReaderLabel: "Close", | ||
| nutritionFactsData: undefined, | ||
| nutritionFactsFeatureName: "Item Authoring", | ||
| nutritionFactsModalLabel: "This is a modal for AI facts", | ||
| nutritionFactsTitle: "AI Nutrition Facts", | ||
| title: "Features", | ||
| trigger: undefined, | ||
| }, | ||
| dataPermissionLevelsData: DATA_PERMISSION_LEVELS, | ||
| nutritionFactsData: NUTRITION_FACTS_DATA, | ||
| trigger: undefined, | ||
| }; | ||
| const assessmentauthoringassistance: AiInfoFeatureProps = { | ||
| aiInformation, | ||
| dataPermissionLevels, | ||
| description: | ||
| "Item Authoring for Assessments streamlines assessment creation by generating questions based on your course materials. \n", | ||
| group: "Mastery", | ||
| name: FEATURE_NAME, | ||
| nutritionFacts, | ||
| revision: "2025.11.18", | ||
| uid: UID, | ||
| }; | ||
| export { | ||
| assessmentauthoringassistance, | ||
| nutritionFacts, | ||
| dataPermissionLevels, | ||
| aiInformation, | ||
| }; | ||
| export default assessmentauthoringassistance; | ||
|
Comment on lines
+1
to
+214
|
||
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Inconsistent naming: The CSV uses "itemAuthoringAssistance" (camelCase) while the actual UID is "itemauthoringassistance" (lowercase). This inconsistency could cause lookup failures or confusion. Ensure CSV keys match the actual UIDs used in the codebase.