how to see dataframe schema?

[kchusam]

I would like to understand what is really sent to the llm server and how the dataframe schema looks like. How can I do that?
Specially when set enforce_privacy = True, I want to be sure, that only the header is sent

[gventuri]

@kchusam I confirm you that with enforce_privacy=True only the schema is actually sent. You can check out the prompt that is passed to the LLM as it follows:

response = PandasAI(df, "Your query....")
print(response.last_prompt)

Hope that works for you!

[kchusam]

Thank you for your reply! Unfortunately, I'm using the titanic dataset to test and I still don't get what is passed to the LLM when I use last_prompt. Here is a screenshot of what I'm getting:

[mspronesti]

@kchusam Here's a MRE (minimal reproducible example) adapted from the from_dataframe example of this package

"""Example of using PandasAI with a Pandas DataFrame"""

import pandas as pd

from pandasai import PandasAI
from pandasai.llm import OpenAI

# dummy example dataframe
dataframe = {
    "country": [
        "United States",
        "United Kingdom",
        "France",
        "Germany",
        "Italy",
        "Spain",
        "Canada",
        "Australia",
        "Japan",
        "China",
    ],
    "gdp": [
        19294482071552,
        2891615567872,
        2411255037952,
        3435817336832,
        1745433788416,
        1181205135360,
        1607402389504,
        1490967855104,
        4380756541440,
        14631844184064,
    ],
    "happiness_index": [6.94, 7.16, 6.66, 7.07, 6.38, 6.4, 7.23, 7.22, 5.87, 5.12],
}

df = pd.DataFrame(dataframe)

api_key = 'sk-...' # <-- your OpenAI API key here 
llm = OpenAI(api_token=api_key)
pandas_ai = PandasAI(llm, enable_cache=False, enforce_privacy=True)

response = pandas_ai(df, "Calculate the sum of the gdp of north american countries")
print(pandas_ai.last_prompt)

Which displays:

You are provided with a pandas dataframe (df) with 10 rows and 3 columns.
This is the metadata of the dataframe:
country,gdp,happiness_index
.

When asked about the data, your response should include a python code that describes the dataframe `df`.
Using the provided dataframe, df, return the python code and make sure to prefix the requested python code with <startCode> exactly and suffix the code with <endCode> exactly to get the answer to the following question:
Calculate the sum of the gdp of north american countries

The reason why you see the conversational prompt instead is due to the conversational=True option. Not sure this is an undesired behavior though.
Hope this helps.