emmm, CLI prompt compliance appears weaker than direct calls with Gemini 2.5 Flash #2710
brokenwing
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I've noticed that the default system prompt for the CLI is primarily geared towards code generation. However, the issues I'm encountering are related to character profiling. My goal is to gather information about specific game characters from the internet for the purpose of simulation or novel writing.
Compared to directly using Gemini Flash, the information collected via the CLI often includes irrelevant details, such as game guides, or it lacks crucial aspects like appearance and personality descriptions, or the overall content is too brief.
I've conducted limited tests with Gemini Pro, so I'm unsure about its impact, but my initial impression is that its results are >= direct usage of Gemini Flash.
Regarding how preference information is handled, whether stored in a .md or .txt file for reading, the difference in prompt compliance seems negligible.
Currently, I haven't been able to view the raw prompt sent to the model; it appears some additional configuration is required. I might need to significantly simplify irrelevant system prompts or extract only the relevant ones each time. Otherwise, I might be forced to rely solely on Gemini Pro (maybe this why almost free use of pro).
Beta Was this translation helpful? Give feedback.
All reactions