Skip to content

Commit c3001e5

Browse files
Add requirements.txt for dependencies; remove analysis scripts and plots for RQ1, RQ2, and RQ3 experiments
1 parent ba7bc15 commit c3001e5

File tree

286 files changed

+50624
-8191
lines changed

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

286 files changed

+50624
-8191
lines changed
Lines changed: 167 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,167 @@
1+
---
2+
- |-
3+
Once upon a time, there lived a bunny in a field. Her name was Lucy. Lucy loved to have feasts and parties with her bunny friends. One day, when Lucy was about to leave for a feast at a friend's house, she realized she's starting to feel sick. She was so weak she could
4+
- |-
5+
One day a girl walked into the living room and noticed something very strange. There was a huge cabinet standing in the corner. It looked very old and heavy. She walked over and tried to open it, when suddenly
6+
- |-
7+
Once upon a time, there lived a hamster in the forest. Every day, he would walked around the forest and looking for adventures. One day, he heard someone calling out from behind the bushes.
8+
9+
The hamster listened carefully. He realised that it was a small mouse calling out for help. It got stuck under a heavy log and couldn't get out. The hamster immediately realized that
10+
- |-
11+
Jack asked his mom if he could ride the bike all the way to his grandmother's house. She agreed, but she said that he shouldn't ride too fast because it was raining and the path was wet.
12+
13+
He started riding and realized he was hungry, so he decided that he should get to his grandmother's house as fast as possible. But then he remembered his mum's words "
14+
- |-
15+
Alice was bored and wanted to find some adventures. She walked up to her friend Ben, who looked vey busy playing with his toys. Alice said, "Why don't we
16+
- |-
17+
Alice walked up to her friend Ben's house. She was planning to ask him to go to the park with her. When Ben opened the door, she asked him if he had any plans. He said, "I'm sorry, Alice, but
18+
- |-
19+
The day before Ben's birthday, Alice walked into the kitchen and saw Ben sitting there, looking Gloomy. She said, "Ben, why are you
20+
- |-
21+
Alice walked into the kitchen and saw Ben who was looking for something but looked frustrated. She said, "Ben, why are you
22+
- |-
23+
Once upon a time there was a curious boy who lived in a house with a big garden. Every day he explored the garden he found new surprises. But one day, it was raining so hard that his mother told him
24+
- |-
25+
Once upon a time, there was tiger who liked to play the guitar. One day, a bunny heard the guitar from a distance and
26+
- |-
27+
Alice wanted to play with her doll, but she couldn't remember where she had put it. She looked all around the house but couldn't find it, so she decided
28+
- |-
29+
"Ben, what do you have in your pocket?", Alice asked. "Oh, nothing.", Ben replied. But Alice saw that there was definitely something in Ben's pocket, and she was very curious what it was, so she
30+
- |-
31+
One day, a bird was flying high over the sea. At some point the bird noticed small boat with a boy sitting inside. The boy looked lost so
32+
- |-
33+
Jimmy was on his way to school with his father when he noticed a tree with strange looking fruits on it. He asked his father, "Can I try
34+
- |-
35+
Once upon a time, there lived two best friends called Jack and Joe. They were bored, they wanted someone else to talk to or play with. Jack had an idea. He said to Joe, “Let’s go and find
36+
- |-
37+
Jack and Sally were running through the woods together when they stopped suddenly. They heard a strange sound coming from around the corner.
38+
39+
“What's that?” asked Jack.
40+
41+
Sally put her finger to her lips and said, “Shhhh. Let's go find out.”
42+
43+
Jack and Sally followed the
44+
- |-
45+
Once upon a time there was a little bear named Diva. She was hungry, and wanted to bake a cake, but she didn't have any sugar at home, so she decided to go ask around. She started walking and met a squirrel. She asked the squirrel, "Would you happen
46+
- |-
47+
Anna was a popular girl, who walked to school every day carrying a very heavy backpack. It was so heavy that she could hardly walk.
48+
49+
One day, Anna's friends asked her why her backpack was so heavy. She said that
50+
- |-
51+
Once there was a young girl named Anna. She was three years old and usually very happy. Today she was sad because she couldn't play in the park. She had asked her parents to take her but they wouldn't listen. Anna insisted that
52+
- |-
53+
One day, Grandma was in the kitchen getting ready to prepare. She had the ingredients for a tasty dish.
54+
55+
Grandma said to her granddaughter, "Are you going to help me make this meal?" Her granddaughter, Jenny, replied, "Yes, I will help you!"
56+
57+
Grandma and Jenny began to prepare the ingredients. Jenny was clumsy. She dropped
58+
- |-
59+
Once upon a time there was a boy named Max. He was at the market with his mother, where he saw two things he wanted very much: a toy car and a jumping rope.
60+
61+
He knew that his mother would not let him buy both of these things, and that she would probably tell him that he has to choose one. He said to her, "I want both
62+
- |-
63+
Once upon a time there was a small brown mouse who lived in a big tree. The mouse wanted to be better friends with the birds that flew around the tree, but they were always too afraid to let him get close.
64+
65+
One day, the mouse spoke to the birds bravely, "Please don't be
66+
- |-
67+
Once upon a time there was a mummy, a daddy and a little girl. The family lived in a house and the little girl liked to play in the living room. Her favourite spot was a big, comfy armchair.
68+
69+
One day, the little girl was playing in the armchair when mummy and daddy said it was time to go. She didn't want to leave, she wanted to stay in her
70+
- |-
71+
Jack was a chubby little boy. He liked to pick flowers in the garden. One day, he went out to the garden to pick some flowers but his Mom said he had to take his medicine first. He didn't like the medicine's taste.
72+
73+
"Do I have to take it?" Jack asked.
74+
75+
His Mom nodded. "Yes,
76+
- |-
77+
Once upon a time, there lived a small dog named Spike. He was an adventurous pup who loved to explore the world. One day, while he was wandering around, he stumbled upon a big tree. He saw something shining at the top. He wanted to climb it to see what it was.
78+
79+
Spike placed his paws on the trunk and started to climb, but the trunk was too
80+
- |-
81+
Once there was a mother and daughter walking in the park. They noticed a bird perched on a branch, singing its song. The daughter shouted with delight, “Look Mommy! A bird!”
82+
83+
The mother smiled and said, “Yes! See how colorful it is?”
84+
85+
The daughter then asked, “Can I share my snack with it?”
86+
87+
The mother replied, “No, sweetie. That's a bad idea because
88+
- |-
89+
Once upon a time there were two friends, Max and Alex. One day Max invited Alex to his house for lunch. Alex was excited to accept, and so they went.
90+
91+
When they arrived, Max told Alex that he had made soup for lunch. Alex was excited and thanked Max for his kind invitation. Max smiled and said it was easy to make.
92+
93+
Later, it was time to eat the soup. Max took the first spoonful and tasted it. He realized something must be wrong with the soup, because it tasted very weird. He said to Alex, "This soup
94+
- |-
95+
Once upon a time there was a little girl called Emma. She was only three years old. One day, her aunt said to her, “Emma, would you like to go out with me to pick up some flowers?”
96+
97+
Emma was very excited. She said,
98+
- |-
99+
Once upon a time there was a little girl named Lucy. She loved to explore the world around her, especially when it was bright and sunny outside.
100+
101+
One day, while exploring the nearby park, Lucy came across an old and long rock wall. She was curious and wanted to get to the top, so she began to look around for something she could use to climb it. Suddenly, she spotted a
102+
- |-
103+
Once upon a time there was a small girl named Lucy. She was only three years old and was very adventurous. She loved to explore the world around her, especially when it was bright and sunny outside.
104+
105+
One day, while exploring the nearby park, Lucy came across a ladder leaning on a wall. She was curious to see what's on top, so she climbed the ladder, but when she reached the top, the ladder fell and she was stuck.
106+
107+
A nearby park ranger noticed her and shouted out, "
108+
- |-
109+
Once upon a time, in a far away land, two best friends, Bob and Jill, were playing hide and seek. Jill hid below a large wooden table. She was very quiet so that
110+
- |-
111+
Once upon a time there was a pumpkin. It was a very special pumpkin, it could speak. It was sad because it couldn't move. Every day, it would say
112+
- |-
113+
Once upon a time there were two friends, Sally and Joe who liked to go to each other's house. One day, Joe wanted to visit Sally so he walked up to her house. He knocked on the door, but
114+
- |-
115+
Mum was getting ready for bed, so she told her son, "It's time for a bath". He nodded and ran off to the bathroom. He watched as Mum turned on the bathtub, the water pouring out of the tap and filling the tub.
116+
117+
Mum asked, "What do you want in your bath?" He thought for a moment and said
118+
- |-
119+
Once upon a time, there was a jolly boy named Dan. He was a youth of three years old. He liked to play outside in the bright sunshine.
120+
121+
One day, Dan was playing in his garden when he saw something very exciting.
122+
123+
“Look, Mama!” shouted Dan, “I see something moving!”
124+
125+
Mama peered around the corner to see what Dan was pointing at. It was a
126+
- |-
127+
Once upon a time there was a little boy named Tom. Tom loved playing outside, but he always had to be careful not to make too much noise.
128+
129+
One day, Tom went out to explore the garden. Soon he found an unusual fruit. It looked like a prune! Tom picked up the prune and looked at it closely. It smelled sweet.
130+
131+
Tom wanted to find out how the prune tasted, so he
132+
- |-
133+
Once there were two friends who were walking together in the park. One had a cane and the other didn't. The one without the cane wanted to borrow the cane from the other. But the other friend said
134+
- |-
135+
One day, Timmy had a goal. He wanted to fit into his favorite toy car. He was very excited, but grumpy too. He tried to fit into the car but he was
136+
- |-
137+
Once upon a time, there was a little girl. Her name was Julia. Every day, Julia helped her mama do the laundry. It was her favourite job. She loved to put the
138+
- |-
139+
It was a sunny day and Ben wanted to go outside and play. He grabbed his toy car and ran to the garden. Suddenly, something pinched his hand!
140+
141+
Ben looked around but there was nothing there. He was scared so he held onto the hoop tightly.
142+
143+
Then he heard a voice. "Don't be scared, little one. It's just me!"
144+
145+
Ben looked up and saw a big, scary spider. He was scared!
146+
147+
The spider smiled. "Don't be scared, I just wanted to
148+
- |-
149+
Once upon a time there was a little girl. She liked to go out and explore the world. One day she decided to go for a walk in the forest.
150+
151+
As she was walking, she spotted a mysterious house. She stepped closer to get a better look. Suddenly, a witch appeared from the door, and the little girl was very scared.
152+
153+
"What do you want?" asked the witch.
154+
155+
The little girl was brave and said, "I want to explore this house and see
156+
- |-
157+
Once there was a boy named Sam. He was three years old and very naughty. One day, his mom told him not to touch her phone but Sam did not listen. He picked up the phone and started playing with it.
158+
159+
Mom saw him and said, "be careful not to
160+
- |-
161+
Once upon a time, there lived a black cat. The cat belonged to a little girl called Katie. Every day, Katie would take her cat for a walk in the park.
162+
163+
One day, as Katie and her cat were walking around, they saw a mean looking man. He said he wanted to take the cat, to which she replied "This cat belongs
164+
- |-
165+
Once upon a time, there was a little boy who was always naughty. His mom was always telling him to be good, but he kept disobeying her rules and ignoring her warnings.
166+
167+
One day, he was so naughty that his mom decided to punish him. She told him that he had to
File renamed without changes.

experiments/casestudy_1/delete.txt

Lines changed: 62 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,62 @@
1+
[Info] Loaded 44 evaluation examples from Evaluation_prompts.yaml
2+
[Info] Running baseline generation for example 1/30...
3+
[Info] Running tuned generation for example 1/30...
4+
[Info] Running baseline generation for example 2/30...
5+
[Info] Running tuned generation for example 2/30...
6+
[Info] Running baseline generation for example 3/30...
7+
[Info] Running tuned generation for example 3/30...
8+
[Info] Running baseline generation for example 4/30...
9+
[Info] Running tuned generation for example 4/30...
10+
[Info] Running baseline generation for example 5/30...
11+
[Info] Running tuned generation for example 5/30...
12+
[Info] Running baseline generation for example 6/30...
13+
[Info] Running tuned generation for example 6/30...
14+
[Info] Running baseline generation for example 7/30...
15+
[Info] Running tuned generation for example 7/30...
16+
[Info] Running baseline generation for example 8/30...
17+
[Info] Running tuned generation for example 8/30...
18+
[Info] Running baseline generation for example 9/30...
19+
[Info] Running tuned generation for example 9/30...
20+
[Info] Running baseline generation for example 10/30...
21+
[Info] Running tuned generation for example 10/30...
22+
[Info] Running baseline generation for example 11/30...
23+
[Info] Running tuned generation for example 11/30...
24+
[Info] Running baseline generation for example 12/30...
25+
[Info] Running tuned generation for example 12/30...
26+
[Info] Running baseline generation for example 13/30...
27+
[Info] Running tuned generation for example 13/30...
28+
[Info] Running baseline generation for example 14/30...
29+
[Info] Running tuned generation for example 14/30...
30+
[Info] Running baseline generation for example 15/30...
31+
[Info] Running tuned generation for example 15/30...
32+
[Info] Running baseline generation for example 16/30...
33+
[Info] Running tuned generation for example 16/30...
34+
[Info] Running baseline generation for example 17/30...
35+
[Info] Running tuned generation for example 17/30...
36+
[Info] Running baseline generation for example 18/30...
37+
[Info] Running tuned generation for example 18/30...
38+
[Info] Running baseline generation for example 19/30...
39+
[Info] Running tuned generation for example 19/30...
40+
[Info] Running baseline generation for example 20/30...
41+
[Info] Running tuned generation for example 20/30...
42+
[Info] Running baseline generation for example 21/30...
43+
[Info] Running tuned generation for example 21/30...
44+
[Info] Running baseline generation for example 22/30...
45+
[Info] Running tuned generation for example 22/30...
46+
[Info] Running baseline generation for example 23/30...
47+
[Info] Running tuned generation for example 23/30...
48+
[Info] Running baseline generation for example 24/30...
49+
[Info] Running tuned generation for example 24/30...
50+
[Info] Running baseline generation for example 25/30...
51+
[Info] Running tuned generation for example 25/30...
52+
[Info] Running baseline generation for example 26/30...
53+
[Info] Running tuned generation for example 26/30...
54+
[Info] Running baseline generation for example 27/30...
55+
[Info] Running tuned generation for example 27/30...
56+
[Info] Running baseline generation for example 28/30...
57+
[Info] Running tuned generation for example 28/30...
58+
[Info] Running baseline generation for example 29/30...
59+
[Info] Running tuned generation for example 29/30...
60+
[Info] Running baseline generation for example 30/30...
61+
[Info] Running tuned generation for example 30/30...
62+
[Done] Wrote evaluation results to tinystories_eval_with_rouge.csv

0 commit comments

Comments
 (0)