Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 7 additions & 6 deletions ai/generative-ai-service/llm-comparator/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

A web application that enables side-by-side comparison of Large Language Models (LLMs) and their fine-tuned counterparts on Oracle Cloud Infrastructure (OCI). The application provides an intuitive interface to evaluate model performance, response quality, and inference time improvements achieved through fine-tuning.

Reviewed: 23.07.2025
Reviewed: 19.09.2025

<img width="1703" height="1280" alt="image" src="https://github.com/user-attachments/assets/2cc14579-3422-4272-a766-c48bb6c3afe4" />

Expand All @@ -19,11 +19,12 @@ Configure your Oracle Cloud Infrastructure credentials and endpoints in the conf

# Useful Links

- [Gen AI DAC: Performance](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/performance.htm)
- [Gen AI Data handlining](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/data-handling.htm)
- [Hyperparameter details](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/fine-tuning-parameters.htm)
- [Model performance details](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/concepts-metrics.htm)
- [Available fine tunning methods](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/choose-method.htm)
- [Gen AI DAC Performance](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/performance.htm): Understand the performance characteristics of Generative AI Dedicated AI Cluster on OCI.
- [Gen AI Data Handling](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/data-handling.htm): Learn about data handling practices and policies for Generative AI on OCI.
- [Hyperparameter Details](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/fine-tuning-parameters.htm): Explore the hyperparameters available for fine-tuning Generative AI models on OCI.
- [Model Performance Details](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/concepts-metrics.htm): Understand the metrics used to evaluate the performance of Generative AI models on OCI.
- [Available Fine-Tuning Methods](https://docs.public.content.oci.oraclecloud.com/en-us/iaas/Content/generative-ai/choose-method.htm): Discover the fine-tuning methods supported by Generative AI on OCI and how to choose the right one.
- [Sample Fine-Tuning Dataset](https://huggingface.co/datasets/gbharti/finance-alpaca): Access a sample dataset for fine-tuning Generative AI models, specifically in the finance domain.

# License

Expand Down
6 changes: 3 additions & 3 deletions ai/generative-ai-service/llm-comparator/files/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -124,9 +124,9 @@ The project includes a utility script for converting datasets to OCI Generative

### Dataset Format Conversion (`format_dataset\dataset_to_oci_format.py`)

**Purpose**: Converts standard instruction-following datasets to OCI-compatible JSONL format.
**Purpose**: Converts standard instruction-following datasets (e.g., [gbharti/finance-alpaca](https://huggingface.co/datasets/gbharti/finance-alpaca) on Hugging Face) to OCI-compatible JSONL format.

**Input Format** (e.g., `finance_data.json`):
**Input Format** (e.g., `finance_data.json` in JSON format):
```json
[
{
Expand Down Expand Up @@ -265,4 +265,4 @@ ModuleNotFoundError: No module named 'langchain_community'

- **API Keys**: Store OCI credentials securely
- **Network Security**: Use HTTPS endpoints only
- **Access Control**: Implement proper OCI IAM policies
- **Access Control**: Implement proper OCI IAM policies