-
The AI system in this portal utilizes Google’s Gemini API Studio and it can run within the free tier bounds. To set this up within local development, create Gemini API key through Google, the website’s links and setup process is fairly straightforward, and paste the key into the .env file in the server directory.
-
To quickly test if the API is working, sign in as an admin, navigate to the “Students” tab, press on a student’s name link to view their details, and press the “Generate AI Summarization” button. It should take a second but an AI summarization like below should appear.
-
If the API key is empty or invalid the generated AI summarization should output similar to below.
-
As quickly demonstrated in the API Key setup, admins and coaches have the functionality to generate AI summaries for students based on their current project progress and this response can be edited to factor in a variety of variables. These summarizations are not saved and must be generated manually every time a student’s details are opened up.
-
Sign in as an admin or a coach and navigate to the “Students” tab. If signed in as an admin, student detail links will appear in the “All Students” section and from a coaches perspective there are additional detail links for their overseeing projects.
-
Pressing on a student’s name link will open their details view and here we have access to generating an AI summarization
-
In the example student, there are no peer evaluations and because of such the defaulted prompt with the system generates similar to the image below.
-
Pressing the “Edit Prompt” button will reveal said default prompt and we can edit said prompt to cater to the needs of a specific coach or admin.
-
Please note the prompts themselves are user specific so if we press “Save” to save the prompt, it will only apply to the currently selected user.. Pressing the Reset button will reset the prompt to the above.
-
If we navigate to a user with peer evaluations completed, the default prompt should generate a much more detailed response than one without.
-
With the nature of AI generation it's always a good practice to double check these summarizations and we can quickly do so with the peer evaluation centered prompt by clicking on the reviews within the student details view to see the actual data and compare it with the AI generated summarization.
-
Peer evaluations have the added functionality of AI generated summarizations for coaches to easily copy and paste into feedback boxes for students to see. If this feature is utilized Students will see AI tooltips so they can know when feedback utilized AI and when it didn’t. For this example we will need at least one student to have completed a peer evaluation.
-
If we analyze the results of that peer evaluation by pressing the view action button while signed in as the coach of the respective project, we can see a “Generate AI Summarization” button at the button within the “Coach Summarization + Feedback” Section. Each student will have this feedback section but since only one student submitted this so far, this section will appear at the bottom of the modal.
Note: If the "Edit Prompt" and or the "Generate AI Summarization" buttons are not present, the API key may be missing or invalid. Please refer to the API Key section to set up the API key. If issues persist there may be a problem with the peer evaluation component itself. -
Pressing on the “Generate AI Summarization” will bring up an informational warning just in case the coach miss clicked. For now press “ok”.
-
After a second or two a summarization should appear alongside a “Copy AI Summary” button which we can use to paste the text into the “Coach Summarization + Feedback” field.
-
Pressing submit will submit your response as a coach.
-
Now if we sign in as the original student who had completed the peer evaluation and navigate to the “Students” tab, “Peer Evaluations” and our projects we will see our feedback summary.
-
Expanding the summary will reveal what was pasted in earlier by the coach and we can also see the Google Gemini tag in the top right indicating that AI was in fact used for this feedback
-
Now complete the same peer evaluation from a different student sign in. Signing in as the same coach from earlier should display the updated peer evaluation submissions.
-
In the view action modal we should see two “Coach Summarization + Feedback” fields and again for the first student we can generate an AI summary but this time we will use the prompt editor to generate a less constructive response.
-
Pressing save will save the prompt and unlike AI summary generation for student progress, this prompt is the same for both users. Pressing reset will reset to the default prompt again.
-
For the other student, do not use AI and manually enter some insightful feedback.
-
Press submit to submit the action. Note from a students perspective this will override the old feedback.
-
Sign in as the AI generated feedback student and we should see the Gemini tooltip on the feedback again.
-
Now if we sign in as the other student who did not get AI generated feedback we should see the standard feedback box without the Google Gemini tag.
