revise for pro mode notebook

Author: chienyuanchang

data/invoice_contract_verification/input_docs/contoso_lifts_invoice.pdf renamed to data/field_extraction_pro_mode/invoice_contract_verification/input_docs/contoso_lifts_invoice.pdf

@@ -9,7 +9,7 @@
     "> #################################################################################\n",
     ">\n",
     "> **Note:** Pro mode is currently available only for `document` data.  \n",
-    "> Supported file types: pdf, tiff, jpg, jpeg, png, bmp, heif\n",
+    "> [Supported file types](https://learn.microsoft.com/en-us/azure/ai-services/content-understanding/service-limits#document-and-text): pdf, tiff, jpg, jpeg, png, bmp, heif\n",
     ">\n",
     "> #################################################################################\n",
     "\n",
@@ -63,8 +63,33 @@
    "source": [
     "# Define paths for analyzer template, input documents, and reference documents\n",
     "analyzer_template = \"../analyzer_templates/invoice_contract_verification_pro_mode.json\"\n",
-    "input_docs = \"../data/invoice_contract_verification/input_docs\"\n",
-    "reference_docs = \"../data/invoice_contract_verification/reference_docs/\""
+    "input_docs = \"../data/field_extraction_pro_mode/invoice_contract_verification/input_docs\"\n",
+    "reference_docs = \"../data/field_extraction_pro_mode/invoice_contract_verification/reference_docs\""
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "> Let's take a look at the analyzer template"
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "import json\n",
+    "with open(analyzer_template, \"r\") as file:\n",
+    "    print(json.dumps(json.load(file), indent=2))"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "> In the analyzer, `\"mode\"` needs to be in `\"pro\"`. The defined field - \"PaymentTermsInconsistencies\" is a `\"generate\"` field and is asked to reason about inconsistency, and will be able to use referenced documents to be uploaded in [reference docs](../data/field_extraction_pro_mode/invoice_contract_verification/reference_docs)"
    ]
   },
   {
@@ -89,7 +114,6 @@
    "outputs": [],
    "source": [
     "import logging\n",
-    "import json\n",
     "import os\n",
     "import sys\n",
     "from pathlib import Path\n",
@@ -120,7 +144,7 @@
     "    token_provider=token_provider,\n",
     "    # IMPORTANT: Uncomment this if using subscription key\n",
     "    # subscription_key=AZURE_AI_API_KEY,\n",
-    "    # x_ms_useragent=\"azure-ai-content-understanding-python/pro_mode\", # This header is used for sample usage telemetry, please comment out this line if you want to opt out.\n",
+    "    x_ms_useragent=\"azure-ai-content-understanding-python/pro_mode\", # This header is used for sample usage telemetry, please comment out this line if you want to opt out.\n",
     ")"
    ]
   },
@@ -201,10 +225,45 @@
    "metadata": {},
    "outputs": [],
    "source": [
+    "from IPython.display import FileLink, display\n",
+    "\n",
     "response = client.begin_analyze(CUSTOM_ANALYZER_ID, file_location=input_docs)\n",
     "result_json = client.poll_result(response, timeout_seconds=360)\n",
     "\n",
-    "logging.info(json.dumps(result_json, indent=2))"
+    "# Create the output directory if it doesn't exist\n",
+    "output_dir = \"output\"\n",
+    "os.makedirs(output_dir, exist_ok=True)\n",
+    "\n",
+    "output_path = os.path.join(output_dir, f\"{CUSTOM_ANALYZER_ID}_result.json\")\n",
+    "with open(output_path, \"w\", encoding=\"utf-8\") as file:\n",
+    "    json.dump(result_json, file, indent=2)\n",
+    "\n",
+    "logging.info(\"Full analyzer result saved to:\")\n",
+    "display(FileLink(output_path))"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "> Let's check the extracted fields with Pro mode "
+   ]
+  },
+  {
+   "cell_type": "code",
+   "execution_count": null,
+   "metadata": {},
+   "outputs": [],
+   "source": [
+    "fields = result_json[\"result\"][\"contents\"][0][\"fields\"]\n",
+    "print(json.dumps(fields, indent=2))"
+   ]
+  },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "> As seen in the field `PaymentTermsInconsistencies`, for example, the purchase contract has detailed payment terms that were agreed to prior to the service. However, the implied payment terms on the invoice conflict with this. Pro mode was able to identify the corresponding contract for this invoice from the reference documents and then analyze the contract together with the invoice to discover this inconsistency."
    ]
   },
   {