Skip to content

Commit 046c253

Browse files
committed
update projects
1 parent 04b8a5c commit 046c253

File tree

14 files changed

+405
-34
lines changed

14 files changed

+405
-34
lines changed

assets/projects/arsls.jpg

236 KB
Loading

assets/projects/cool-cook.png

100 KB
Loading

assets/projects/goosebump.jpg

250 KB
Loading

assets/projects/placeholder.jpg

90.6 KB
Loading

assets/projects/v-gather.jpg

230 KB
Loading

assets/projects/yu.png

49.8 KB
Loading

content/blog/cool-cook/index.en.md

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,6 @@
22
title: "Cool Cook – HKUST COMP4461 Project"
33
date: 2020-11-02T21:11:35+08:00
44
draft: false
5-
lang: en
65
categories:
76
- HCI
87
- coursework

content/blog/cool-cook/index.md

Lines changed: 122 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,122 @@
1+
---
2+
title: "Cool Cook – HKUST COMP4461 Project"
3+
date: 2020-11-02T21:11:35+08:00
4+
draft: false
5+
categories:
6+
- HCI
7+
- coursework
8+
featured_image: coolcook.jpg
9+
summary: "This article is also an assigned self-reflection on HCI course project (COMP4461) at HKUST. A chatbot prototype that guides you through a cooking workflow that makes the most sense."
10+
---
11+
12+
This article is also an assigned self-reflection on HCI course project (COMP4461) at HKUST.
13+
14+
A chatbot prototype that guides you through a cooking workflow that makes the most sense.
15+
16+
{{< figure src="coolcook.jpg" alt="Cool Cook Artwork" >}}
17+
18+
## Project Info
19+
20+
This is the second project of COMP4461: Human-Computer Interaction at the Hong Kong University of Science and Technology. For this project, we were required to prototype a chatbot about "online communication", with comprehensive design thinking process. We worked as a group of six people and proposed this chatbot prototype as a step-by-step cooking tutor that provides timely responds.
21+
22+
## Introduction
23+
24+
"How to cook some dishes?" Searching this question online will give you a huge number of answers in various forms
25+
from words-and-pictures to videos. But are they truly helpful once we pick up the spatula and turn on the fire?
26+
At least for newbies, it is easy to get nervous hearing the buzzing of the oven, and forget about everything.
27+
That's why a more user-friendly form of cooking tutorials is needed. Hence, we have designed Cool Cook,
28+
a chatbot that assist the user in cooking an entire meal from the choosing of dishes to buying the ingredients
29+
and to instruct the user to cook correctly step-by-step. During the instruction, the chatbot will take the time needed
30+
for each step of each dish into account, and help the user cook all the dishes in parallel in an elegant arrangement.
31+
32+
## Emphasis
33+
34+
### Study of existing solutions
35+
36+
#### Cookbooks
37+
38+
A cookbook is the most traditional and reliable collection of recipes. However, it's content is fixed,
39+
and it lacks portability.
40+
41+
#### Videos
42+
43+
A cooking video is easy to find on online video platforms. However, we have noted that most of the videos are intended
44+
for the audience to appreciate the cooking process rather than to learn themselves. These videos are more elaborated in
45+
the shooting techniques and the artistic expressions rather than the comprehensiveness of the information.
46+
47+
Plus, the elderly are less familiar with online video platforms.
48+
49+
### Interviews
50+
51+
To locate the problems the cooking newbies face when following the online tutorials, we have conducted several
52+
interviews. Below are the pain points our interviewees have raised up during the interviews.
53+
54+
1. They find it hard to organize the time when they need to cook several dishes at the same time.
55+
And this is a common case when they need to prepare for an entire meal.
56+
2. Details are more or less omitted in many tutorials, depending on how professional the authors are.
57+
Newbies may struggle when they are instructed to add "a proper amount of" some ingredients.
58+
This situation is especially common when cooking Chinese dishes.
59+
3. It is hard to memorize all the steps at once. And constantly checking the tutorials during cooking is time consuming
60+
and troublesome.
61+
62+
## Interpretation
63+
64+
### POV Model
65+
66+
We have developed two personas for our Point-Of-View model.
67+
68+
{{< figure src="pov.png" alt="POV" >}}
69+
70+
### HTA Framework
71+
72+
We have then constructed an Hierarchical Task Analysis framework that describes the goals and sub-goals required in our solution.
73+
74+
{{< figure src="hta.png" alt="HTA" >}}
75+
76+
## Ideation
77+
78+
We have drafted a mind map during a brainstorm session to gather and analyse our ideas.
79+
80+
{{< figure src="mindmap.png" alt="Mind Map" >}}
81+
82+
## Verification
83+
84+
### Storyboard
85+
86+
We have drawn a storyboard to illustrate our solution and the pain point we want to solve.
87+
88+
Two major functions are shown: the chatbot provides **step-by-step cooking instructions**,
89+
and it can **answer questions during the cooking session** at any step.
90+
91+
{{< figure src="storyboard.png" alt="Storyboard" >}}
92+
93+
## Prototype
94+
95+
### Video Prototype
96+
97+
{{< youtube cl86WZcvbp0 >}}
98+
99+
### Interactive Prototype
100+
101+
The interactive prototype is built using JavaScript and the [BotKit library](https://botkit.ai/).
102+
A complete sample is hosted on Glitch [here](https://comp4461-hvc-cool-cook.glitch.me/).
103+
The source code can be found on GitHub [here](https://github.com/fhfuih/cool-cook).
104+
Below are some screenshots of the interactive prototype.
105+
106+
{{< figure src="prototype1.png" alt="Screenshots of the interactive prototype" >}}
107+
{{< figure src="prototype2.png" alt="Screenshots of the interactive prototype" >}}
108+
109+
### Speed Dating & Follow-ups
110+
111+
We have shown the video prototype to the previous interviewees.
112+
They are satisfied by the QA feature during the instructions,
113+
and how the chatbot smartly help them organize the time and steps.
114+
They have listed more ideas as enhancements of the functionality.
115+
116+
1. Voice input to make the interactions more convenient.
117+
2. A preview of all the steps before starting the actual cooking session to inform the user of the complexity.
118+
3. Smarter recommends of the dishes provided available ingredients at home.
119+
120+
## Personal Reflections
121+
122+
I mainly work on the interactive prototype this time, thanks to my familiarity with the JavaScript programming skills and the [Glitch](https://glitch.com/) platform. Unlike our previous project, this interactive prototype calls for higher fidelity. Therefore, it is important to fix more design details during the previous steps. Whenever a problem is noted during the programming, I need to promptly and iteratively communicate with others to come up with a solution. This project makes me realize the potential gap between an idea and its actual implementation. Thus, it is always beneficial to care about the design details at the beginning.

content/blog/v-gather/index.en.md

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,6 @@
22
title: "V Gather – HKUST COMP4461 Project"
33
date: 2020-11-19T09:18:25+08:00
44
draft: false
5-
lang: en
65
categories:
76
- HCI
87
- coursework
@@ -28,7 +27,7 @@ Looking at the third topic, we end up with V Gather, our Social VR solution for
2827

2928
## Qualitative Analysis
3029

31-
We conducted qualitative analysis to find out the pros and cons of the general functionalities of Mozilla Hubs and its feasibility in different scenarios.
30+
We collected and analyzed qualitative data to find out the pros and cons of the general functionalities of Mozilla Hubs and its feasibility in different scenarios.
3231

3332
### Heuristic Test
3433

content/blog/v-gather/index.md

Lines changed: 137 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,137 @@
1+
---
2+
title: "V Gather – HKUST COMP4461 Project"
3+
date: 2020-11-19T09:18:25+08:00
4+
draft: false
5+
categories:
6+
- HCI
7+
- coursework
8+
featured_image: v-gather.jpg
9+
summary: "This article is also an assigned self-reflection on HCI course project (COMP4461) at HKUST. A social VR product prototype that kindles ice-breaking events with liveliness."
10+
---
11+
12+
This article is also an assigned self-reflection on HCI course project (COMP4461) at HKUST.
13+
14+
A social VR product prototype that kindles ice-breaking events with liveliness.
15+
16+
{{< figure src="v-gather.jpg" alt="V Gather Artwork" >}}
17+
18+
## Project Info
19+
20+
This is the third project of COMP4461: Human-Computer Interaction at the Hong Kong University of Science and Technology. Previously in this course, we are required to [Mozilla Hubs](https://hubs.mozilla.com/) to hold meetings for all of our course projects. And for this project, we are assigned the theme of Social VR. We need to reflect on our experiences with Mozilla Hubs and focus on one of the three topics:
21+
22+
1. Improving Social VR experiences for future group collaborations
23+
2. Designing Social VR experiences for some other future scenario
24+
3. Proposing a better alternative solution to Social VR for a given scenario
25+
26+
Looking at the third topic, we end up with V Gather, our Social VR solution for online ice-breaking and gathering events that maximizes liveliness and minimize awkwardness.
27+
28+
## Qualitative Analysis
29+
30+
We collected and analyzed qualitative data to find out the pros and cons of the general functionalities of Mozilla Hubs and its feasibility in different scenarios.
31+
32+
### Heuristic Test
33+
34+
We have concluded a lot of pros and cons of the functionalities of Mozilla Hubs via heuristic tests. Below is an extract.
35+
36+
* User Interface
37+
* 😄Internal consistency among the icon buttons in the toolbar.
38+
* 😄Intuitive visual implications of the button icons.
39+
* External inconsistency in the screen sharing icon compared to other products.
40+
* 😥No labels for button icons unless the mouse is pointed at them. This introduces difficulty in interpreting the meanings of the icon.
41+
* Features
42+
* 😄The countdown of the camera.
43+
* 😥No assistance in placing objects.
44+
* 😥Cannot batch-edit objects in the room.
45+
* 😥Poor server quality, characters and objects not showing over bad Internet and no messages shown for such errors.
46+
* 😥Poor pen tool experience
47+
* Support
48+
* 😄Documentation to help beginners.
49+
* 😥No FAQ to solve ad-hoc problems.
50+
51+
{{< figure src="heuristic-test.png" alt="Heuristic Test Result" >}}
52+
53+
### Usability Test
54+
55+
We conducted usability tests to see the capability of Mozilla Hubs to support group collaborations and meetings, especially concerning our COMP4461 course projects. The usability follows the design and process below.
56+
57+
Task Design:
58+
- Goal: To discuss and hopefully come up with available ideas for course projects in COMP4461.
59+
- Look for: How well does the brainstorming task flow work?
60+
- Context of use: The users are expected to be under pressure as the timeline is short, non-interrupted as they are having the meeting. They are also expected to be at home with available microphone and speaker to interact in the task.
61+
62+
Evaluation Metrics:
63+
- Realization: What does the users want to do during the brainstorm, and whether the users identify relevant function to satisfy such needs?
64+
- Issue: Identify issue and its severity, if any.
65+
- Self-reported feedback on user experiences
66+
67+
Recording method:
68+
- Video recording
69+
70+
Users:
71+
- Target user profile: Users that expect Mozilla Hub as a place for virtual meeting to discuss issues and conduct brainstorming.
72+
- Who: 5 college students from HKUST, with age from 19 to 22. They would discuss about the course project ideation in the Hub, which is expected to be a match for the target user.
73+
74+
Experiment findings:
75+
- Users encounter severe Internet connection issue during the experiment. The majority of the users spent over 15 minutes simply for entering the room. Some teammates can’t hear other voices with no hardware and software problem in their own devices.
76+
- Users attempted to communicate with each other to start the meeting, but the aforementioned problem hindered meeting from getting started.
77+
- The imitated effect of distance to voice volume interrupted the meeting for several times because members can’t hear each other clearly.
78+
- Users attempted to share notes but found no available effective functions in the Hub. Pen function is impracticable for taking notes.
79+
- Users were not aware of the screen sharing supported in the Hub.
80+
81+
Feedback:
82+
- The overall experience is negative due to Internet issues and poor function realization.
83+
- There are no outstanding and irreplaceable functions found for holding brainstorming session in Mozilla Hub.
84+
- The advantage of imitating real-life interaction is not utilized in this scenario.
85+
86+
87+
### Choice of our topic
88+
89+
We want to design a Social VR product for online informal gatherings such as ice-breaking sessions. We see the huge potential of Social VR in mitigating the awkwardness of "Zoom gatherings" by putting characters in a simulated environment instead of grid view panels. VR rooms also allows for private conversations an richer means of communication, which is perfectly suitable for gatherings events.
90+
91+
## Ideation
92+
93+
### POV Model
94+
95+
We constructed two POV models. The first one is a college freshman who need to familiarize herself with the communities and the campus.
96+
97+
{{< figure src="persona1.jpg" alt="Persona: college freshman.jpg" >}}
98+
99+
The second one is a product manager who need to organize online gatherings and have people socialize and build a strong team spirit.
100+
101+
{{< figure src="persona2.jpg" alt="Persona: product manager.jpg" >}}
102+
103+
### Brainstorming
104+
105+
According to the two POV models and the problems these two personas face, we conducted a brainstorm session to discover the solutions and the features in detail.
106+
107+
{{< figure src="mindmap.png" alt="Brainstorm Mind Map" >}}
108+
109+
### Storyboard
110+
111+
Below is a storyboard we drew, where a team leader succeeded in familiarizing the team members with each other using the product we design.
112+
113+
{{< figure src="storyboard.jpg" alt="Storyboard" >}}
114+
115+
### Finalizing Design
116+
117+
We eventually came up with our design of V Gather to solve the problems in online ice-breaking events. The participants can customize their appearance in the room, and we also empathize on three main features to make it capable.
118+
119+
The first is the *speech feature*. The host can invite participants to a designated room and deliver a speech, e.g. an opening speech. The room consists of a set-up stage and audience seats, and enables real-time interactions.
120+
121+
The second is the *chit-chat feature*. The participants can take a step closer to each other and have private conversations with facial expressions and body languages. The facial expression and body languages will be detected via face recognition cameras and Kinect cameras.
122+
123+
The third feature is *ice-breaking games support*. Participants can join in various ice-breakings games to have a more enjoyable experience.
124+
125+
### Speed Dating
126+
127+
After viewing our design, the interviewees expressed their interest in both the customization of the appearance and our additional features. They believed the imitation of the real world environments greatly attracts them to use the platform for future gatherings.
128+
129+
The interviewees also pointed out something we can improve. A third person's view can be added to have the participants more aware of of their own characters. Voice adjustments are also useful for some participants. The gaming part can be further polished, for different people may want games of different topics and difficulties.
130+
131+
## Video Prototype
132+
133+
{{< youtube 1Vcpl_dP3iU >}}
134+
135+
## Personal Reflections
136+
137+
Personally, I have taken part in the ideation stage and the in-class presentation, including making the slides. It is inspiring to have collected all the parts of the work done by our group mates and sort them out. Since we are required to use Mozilla Hubs to hold group meetings for the entire semester, it is quite easy for us to conduct heuristic studies and propose many ideas at the beginning. (Of course we also swore a lot about the bad experience of the Hubs LOL.) We realized that it is important to analyze the core and irreplaceable features of a product before we target to, or use it in, a specific scenario. Up till today, VR is not the solution to everything, but its huge potential is undeniable. Therefore, we have gone through careful discussions on how the attributes of VR technology can benefit an online gathering event, and such a thinking process is very important in designing a product.

0 commit comments

Comments
 (0)