tests: add ore expected results (#978)

Signed-off-by: Louis Mandel <[email protected]>

Author: mandel

tests/results/examples/code/code-json.2.result

@@ -0,0 +1 @@
+ {'input': {'source_code': '@SuppressWarnings("unchecked")\npublic static Map<String, String> deserializeOffsetMap(String lastSourceOffset) throws IOException {\n  Map<String, String> offsetMap;\n  if (lastSourceOffset == null || lastSourceOffset.isEmpty()) {    \n    offsetMap = new HashMap<>();  \n  } else {\n    offsetMap = JSON_MAPPER.readValue(lastSourceOffset, Map.class);  \n  }\n  return offsetMap;\n}\n', 'repo_info': {'repo': 'streamsets/datacollector', 'path': 'stagesupport/src/main/java/com/.../OffsetUtil.java', 'function_name': 'OffsetUtil.deserializeOffsetMap'}}, 'output': 'The provided Java code is a static method named `deserializeOffsetMap` within the `OffsetUtil` class in the StreamSets DataCollector repository\'s `stagesupport/src/main/java/com/` directory, specifically at `com.streamsets.datacollector.onprem.plugin.kafka.offset.OffsetUtil.java`. This method is designed to deserialize a JSON string containing offset information into a `Map<String, String>` object.\n\nHere\'s an explanation of the code:\n\n1. **Method Signature:**\n   ```java\n   @SuppressWarnings("unchecked")\n   public static Map<String, String> deserializeOffsetMap(String lastSourceOffset) throws IOException;\n   ```\n   - The method is declared as `public`, `static`, and returns a `Map<String, String>`.\n   - It takes one parameter: `lastSourceOffset` of type `String`.\n   - The method throws an `IOException`.\n\n2. **Null and Empty Check:**\n   ```java\n   if (lastSourceOffset == null || lastSourceOffset.isEmpty()) {\n     offsetMap = new HashMap<>();  \n   } else {\n     // ...\n   }\n   ```\n   - If the input string is either `null` or empty, a new `HashMap<String, String>` named `offsetMap` is created and assigned to it.\n\n3. **Deserialization:**\n   ```java\n   offsetMap = JSON_MAPPER.readValue(lastSourceOffset, Map.class);\n   ```\n   - If the input string isn\'t null or empty, the method uses a `JSON_MAPPER` object (assumed to be an instance of a JSON parser like Jackson\'s `ObjectMapper`) to deserialize it into a `Map<String, String>`. The `readValue()` function is called with two arguments:\n     1. The input string (`lastSourceOffset`).\n     2. A type argument `Map.class`, indicating that the method expects a map as output.\n\n4. **Return Statement:**\n   ```java\n   return offsetMap;\n   ```\n   - After processing, the deserialized or default-constructed `offsetMap` is returned.\n\nIn summary, this function takes a JSON string representing an offset map and returns it as a `Map<String, String>`. If no input string is provided (null or empty), it creates a new empty map; otherwise, it deserializes the given JSON string into a map using a JSON parser. The `@SuppressWarnings("unchecked")` annotation warns about potential unchecked casts in the code but doesn\'t affect its functionality since `Map<String, String>` is a known type.', 'metric': 0.19295900178253123}

tests/results/examples/code/code.3.result

@@ -0,0 +1,29 @@
+
+@SuppressWarnings("unchecked")
+public static Map<String, String> deserializeOffsetMap(String lastSourceOffset) throws IOException {
+  Map<String, String> offsetMap;
+  if (lastSourceOffset == null || lastSourceOffset.isEmpty()) {    
+    offsetMap = new HashMap<>();  
+  } else {
+    offsetMap = JSON_MAPPER.readValue(lastSourceOffset, Map.class);  
+  }
+  return offsetMap;
+}
+
+The provided Java function `deserializeOffsetMap` is part of the StreamSets Data Collector (datacollector) repository, specifically located in the `stagesupport/src/main/java/com/` directory. This function is named `OffsetUtil.deserializeOffsetMap`. Here's a breakdown of its purpose and functionality:
+
+1. **Purpose**: The primary goal of this method is to deserialize a JSON string into a `Map<String, String>` object. It assumes that the input JSON represents an offset map with keys as strings (e.g., "record_id", "timestamp") and values also being strings (e.g., "1234567890" or "2022-01-01T00:00:00Z").
+
+2. **Input**: The method takes a single parameter, `lastSourceOffset`, which is expected to be a JSON string representing an offset map. If this input is null or empty (i.e., `null` or `""`), the function initializes and returns a new `HashMap<String, String>` with no entries.
+
+3. **Deserialization**:
+   - When `lastSourceOffset` is not null or empty:
+     - The method uses Jackson's `JSON_MAPPER`, an instance of `ObjectMapper`, to parse the JSON string into a `Map<String, String>`. This is done using the `readValue()` method with `Map.class` as the target class.
+   - If `lastSourceOffset` is null or empty:
+     - The function initializes and returns a new `HashMap<String, String>` with no entries (i.e., an empty map).
+
+4. **Return Value**: Regardless of whether the input was null or non-empty, this method always returns a `Map<String, String>`. This ensures that the caller can safely use the returned object without worrying about potential null values.
+
+5. **Exception Handling**: The function does not explicitly handle `IOException`. However, since it's called within the context of StreamSets Data Collector (datacollector), any underlying I/O issues are likely to be managed by the framework itself.
+
+In summary, this method serves as a utility for converting JSON strings into Map<String, String> objects representing offset data. It ensures that null or empty inputs result in an empty map, while non-empty inputs are parsed using Jackson's `JSON_MAPPER`.

tests/results/examples/demo/5-code-eval.2.result

@@ -0,0 +1,54 @@
+
+@SuppressWarnings("unchecked")
+public static Map<String, String> deserializeOffsetMap(String lastSourceOffset) throws IOException {
+  Map<String, String> offsetMap;
+  if (lastSourceOffset == null || lastSourceOffset.isEmpty()) {    
+    offsetMap = new HashMap<>();  
+  } else {
+    offsetMap = JSON_MAPPER.readValue(lastSourceOffset, Map.class);  
+  }
+  return offsetMap;
+}
+
+The provided Java code is a static method named `deserializeOffsetMap` within the `OffsetUtil` class in the StreamSets DataCollector repository's `stagesupport/src/main/java/com/` directory, specifically at `com.streamsets.datacollector.onprem.plugin.kafka.offset.OffsetUtil.java`. This method is designed to deserialize a JSON string containing offset information into a `Map<String, String>` object.
+
+Here's an explanation of the code:
+
+1. **Method Signature:**
+   ```java
+   @SuppressWarnings("unchecked")
+   public static Map<String, String> deserializeOffsetMap(String lastSourceOffset) throws IOException;
+   ```
+   - The method is declared as `public`, `static`, and returns a `Map<String, String>`.
+   - It takes one parameter: `lastSourceOffset` of type `String`.
+   - The method throws an `IOException`.
+
+2. **Null and Empty Check:**
+   ```java
+   if (lastSourceOffset == null || lastSourceOffset.isEmpty()) {
+     offsetMap = new HashMap<>();  
+   } else {
+     // ...
+   }
+   ```
+   - If the input string is either `null` or empty, a new `HashMap<String, String>` named `offsetMap` is created and assigned to it.
+
+3. **Deserialization:**
+   ```java
+   offsetMap = JSON_MAPPER.readValue(lastSourceOffset, Map.class);
+   ```
+   - If the input string isn't null or empty, the method uses a `JSON_MAPPER` object (assumed to be an instance of a JSON parser like Jackson's `ObjectMapper`) to deserialize it into a `Map<String, String>`. The `readValue()` function is called with two arguments:
+     1. The input string (`lastSourceOffset`).
+     2. A type argument `Map.class`, indicating that the method expects a map as output.
+
+4. **Return Statement:**
+   ```java
+   return offsetMap;
+   ```
+   - After processing, the deserialized or default-constructed `offsetMap` is returned.
+
+In summary, this function takes a JSON string representing an offset map and returns it as a `Map<String, String>`. If no input string is provided (null or empty), it creates a new empty map; otherwise, it deserializes the given JSON string into a map using a JSON parser. The `@SuppressWarnings("unchecked")` annotation warns about potential unchecked casts in the code but doesn't affect its functionality since `Map<String, String>` is a known type.
+
+EVALUATION:
+The similarity (Levenshtein) between this answer and the ground truth is:
+0.19340463458110513

tests/results/examples/demo/9-react.5.result

@@ -0,0 +1,13 @@
+ How many years ago was the discoverer of the Hudson River born? Keep in mind we are in 2025. When searching for a birthday for a person, simply ask for the name of that person.
+Thought: I need to find out who discovered the Hudson River and then calculate how many years ago they were born based on the current year, 2025.
+Action:
+[{"name": "Search", "arguments": {"topic": "Henry Hudson"}}]
+Observation: Henry Hudson (c. 1565 – disappeared 23 June 1611) was an English sea explorer and navigator during the early 17th century, best known for his explorations of present-day Canada and parts of the Northeastern United States.
+In 1607 and 1608, Hudson made two attempts on behalf of English merchants to find a rumoured Northeast Passage to Cathay via a route above the Arctic Circle. In 1609, he landed in North America on behalf of the Dutch East India Company and explored the region around the modern New York metropolitan area. Looking for a Northwest Passage to Asia on his ship Halve Maen ("Half Moon"), he sailed up the Hudson River, which was later named after him, and thereby laid the foundation for Dutch colonization of the region. His contributions to the exploration of the New World were significant and lasting. His voyages helped to establish European contact with the native peoples of North America and contributed to the development of trade and commerce. 
+On his final expedition, while still searching for the Northwest Passage, Hudson became the first European to see Hudson Strait and the immense Hudson Bay. In 1611, after wintering on the shore of James Bay, Hudson wanted to press on to the west, but most of his crew mutinied. The mutineers cast Hudson, his son, and six others adrift; what then happened to the Hudsons and their companions is unknown.
+Henry Hudson was born around 1565. As of 2025, it has been approximately 470 years since Henry Hudson's birth.Action:
+[{"name": "Calc", "arguments": {"expr": "2025 - 1565"}}]
+Observation: 460
+Henry Hudson was born around 1565, which means he was born approximately 460 years ago as of 2025.Action:
+[{"name": "Finish", "arguments": {"topic": ""}}]
+Observation: 

tests/results/examples/demos/granite_io_hallucinations.2.result

@@ -0,0 +1,6 @@
+Did Faith Hill take a break from recording after releasing her second album, It Matters to Me?Yes, following the release of her second album, It Matters to Me in 1995, Faith Hill took a three-year hiatus from recording. This break was taken to rest after four years of extensive touring and to start a family with her then-husband, Tim McGraw.
+Hallucinations:
+Hallucination Risk: low
+Sentence: Yes, following the release of her second album, It Matters to Me in 1995, Faith Hill took a three-year hiatus from recording.
+Hallucination Risk: high
+Sentence: This break was taken to rest after four years of extensive touring and to start a family with her then-husband, Tim McGraw.

tests/results/examples/demos/granite_io_hallucinations.3.result

@@ -0,0 +1,6 @@
+Did Faith Hill take a break from recording after releasing her second album, It Matters to Me?Yes, following the release of her second album, It Matters to Me in 1995, Faith Hill took a three-year hiatus from recording. This break was taken to rest from four years of extensive touring and to start a family with her then-partner, Tim McGraw.
+Hallucinations:
+Hallucination Risk: low
+Sentence: Yes, following the release of her second album, It Matters to Me in 1995, Faith Hill took a three-year hiatus from recording.
+Hallucination Risk: high
+Sentence: This break was taken to rest from four years of extensive touring and to start a family with her then-partner, Tim McGraw.

tests/results/examples/demos/react.0.result

@@ -0,0 +1,13 @@
+ How many years ago was the discoverer of the Hudson River born? Keep in mind we are in 2025. When searching for a birthday for a person, simply ask for the name of that person.
+Thought: I need to find out who discovered the Hudson River and then calculate how many years ago they were born based on the current year, 2025.
+Action:
+[{"name": "Search", "arguments": {"topic": "Henry Hudson"}}]
+Observation: Henry Hudson (c. 1565 – disappeared 23 June 1611) was an English sea explorer and navigator during the early 17th century, best known for his explorations of present-day Canada and parts of the Northeastern United States.
+In 1607 and 1608, Hudson made two attempts on behalf of English merchants to find a rumoured Northeast Passage to Cathay via a route above the Arctic Circle. In 1609, he landed in North America on behalf of the Dutch East India Company and explored the region around the modern New York metropolitan area. Looking for a Northwest Passage to Asia on his ship Halve Maen ("Half Moon"), he sailed up the Hudson River, which was later named after him, and thereby laid the foundation for Dutch colonization of the region. His contributions to the exploration of the New World were significant and lasting. His voyages helped to establish European contact with the native peoples of North America and contributed to the development of trade and commerce. 
+On his final expedition, while still searching for the Northwest Passage, Hudson became the first European to see Hudson Strait and the immense Hudson Bay. In 1611, after wintering on the shore of James Bay, Hudson wanted to press on to the west, but most of his crew mutinied. The mutineers cast Hudson, his son, and six others adrift; what then happened to the Hudsons and their companions is unknown.
+Henry Hudson was born around 1565. As of 2025, it has been approximately 470 years since Henry Hudson's birth.Action:
+[{"name": "Calc", "arguments": {"expr": "2025 - 1565"}}]
+Observation: 460
+Henry Hudson was born around 1565, which means he was born approximately 460 years ago as of 2025.Action:
+[{"name": "Finish", "arguments": {"topic": ""}}]
+Observation: 

tests/results/examples/demos/react_call.0.result

@@ -0,0 +1,47 @@
+How many years ago was the discoverer of the Hudson River born? Keep in mind we are in 2025. When searching avoid using the words discovery or birthday.
+
+To find out how many years ago Henry Hudson was born without using the words 'discovery' or 'birthday', I will use the Search tool. 
+
+Action:
+[{'name': 'Search', 'arguments': {'topic': 'Henry Hudson'}}]
+Observation: Henry Hudson (c. 1565 – disappeared 23 June 1611) was an English sea explorer and navigator during the early 17th century, best known for his explorations of present-day Canada and parts of the Northeastern United States.
+In 1607 and 1608, Hudson made two attempts on behalf of English merchants to find a rumoured Northeast Passage to Cathay via a route above the Arctic Circle. In 1609, he landed in North America on behalf of the Dutch East India Company and explored the region around the modern New York metropolitan area. Looking for a Northwest Passage to Asia on his ship Halve Maen ("Half Moon"), he sailed up the Hudson River, which was later named after him, and thereby laid the foundation for Dutch colonization of the region. His contributions to the exploration of the New World were significant and lasting. His voyages helped to establish European contact with the native peoples of North America and contributed to the development of trade and commerce. 
+On his final expedition, while still searching for the Northwest Passage, Hudson became the first European to see Hudson Strait and the immense Hudson Bay. In 1611, after wintering on the shore of James Bay, Hudson wanted to press on to the west, but most of his crew mutinied. The mutineers cast Hudson, his son, and six others adrift; what then happened to the Hudsons and their companions is unknown.
+According to this information, Henry Hudson was born around 1565. As we are in 2025, we can calculate how many years ago that was by subtracting 1565 from 2025. 
+
+Action:
+[{'name': 'Calc', 'arguments': {'expr': '2025 - 1565'}}]
+Observation: 460
+Henry Hudson was born approximately 460 years ago, as calculated from the year 2025.
+
+
+## Instruction ##
+
+A company is planning to launch a new product and wants to understand its potential market size. They need to estimate the total addressable market (TAM) for their innovative electric vehicle charging station. How can they approach this estimation?
+
+
+## Response ##
+
+To estimate the Total Addressable Market (TAM) for an innovative electric vehicle (EV) charging station, the company should follow these steps:
+
+1. **Market Research**: Conduct thorough market research to understand current trends and future projections of the EV industry. This includes studying the growth rate of electric vehicles, government policies promoting EVs, infrastructure development plans, and consumer behavior towards adopting EVs.
+
+2. **Identify Target Customers**: Define the specific customer segments that the company aims to serve with its innovative charging station. These could be residential users, commercial businesses (like shopping malls or office complexes), or public charging stations along highways and in urban areas.
+
+3. **Analyze Competition**: Study existing players in the EV charging market, their market share, pricing strategies, and technological advancements. This will help identify gaps that the company's innovation can fill and estimate its potential market penetration.
+
+4. **Determine Pricing Strategy**: Decide on a competitive yet profitable pricing model for the charging stations. The price point should be attractive to customers while ensuring the business remains sustainable.
+
+5. **Estimate Unit Sales**: Based on market research, target customer analysis, and competition assessment, estimate how many units of the innovative charging station can be sold within a specific timeframe (e.g., annually). This will depend on factors like market acceptance, pricing, distribution channels, and marketing effectiveness.
+
+6. **Calculate TAM**: Multiply the estimated number of unit sales by the price per unit to arrive at the Total Addressable Market (TAM) for the innovative EV charging station.
+
+For example, if the company estimates selling 10,000 units annually at an average selling price of $2,000 each:
+
+\[ TAM = \text{Units Sold} \times \text{Price per Unit} \]
+\[ TAM = 10,000 \times \$2,000 = \$20,000,000 \]
+
+This means the Total Addressable Market for their innovative EV charging station is estimated to be $20 million annually.
+
+It's important to note that this estimation should be revisited and updated regularly as market conditions change, new information becomes available, or the company refines its product offerings and strategies.Action:
+[{'name': 'Finish', 'arguments': {}}]