Codestral Autocomplete insufficient

[MESC2020]

Context
I'm using Codestral-2501 through Azure Machine Learning Studio. The provided FIM Endpoints are working as expected.

Issue
However, autocomplete suggestion is very basic.

Example 1
For instance, I'm trying to do the tutorial continue_tutorial.py

#                            Autocomplete provides inline code suggestions as you type.

# 1. Place cursor after `sorting_algorithm:` below and press [Enter]
# 2. Press [Tab] to accept the Autocomplete suggestion

# Basic assertion for sorting_algorithm

but Codestral returns this as suggestion:
assert sorting_algorithm([3, 1,

In Continue Console, everything seems alright.

Example 2
Or if I have this as my code:
def addTwoNumbers(l1, l2)

Codestral's suggestion is: :

Attempt to fix
I saw that there's a json configuration "multilineCompletions": "always" but json is depcrecated and it seems like yaml does not have this as configuration?

Question
So my question now: Continue specifically recommends to use codestral and yet it does not do the intended job.
Any idea why?

Edit:
Maybe you @GHuyHuynh have any idea?

[MESC2020]

Adding to this, multiline autocompletion is on always, but has no effect on the result

[MESC2020]

Adding one more revelation:
In this example, I stopped typing after luckycoin. Continue triggers two calls

First one completes successfully, but only showing { as suggestion even though it received the whole class definition.
Then there's a second call, which is cancelled.

In the meantime, I get this error message in the console:
[Extension Host] No suitable jump location found after trying all positions

So it looks like Codestral is doing everything right, but there's an issue with continue and visual studio code?

[GHuyHuynh]

Hi @MESC2020 , how did you able to open this console?

[MESC2020]

@GHuyHuynh
On Windows: Ctrl + ,

Then continue: enable console

[TyDunn]

@MESC2020 Thanks for the detailed context! This does look like a bug. We'll have someone look into this, transferring to an issue

[TyDunn]

If you are able to try out Codestral via the Mistral API directly, I'd be curious if you are seeing the same problem in this situation

[MESC2020]

@TyDunn Yea I have the same issue. Used this config:

models:
  - name: Codestral
    provider: mistral
    model: codestral-latest
    apiKey: <key>
    roles:
      - autocomplete

in Continue console I see two API calls per autocomplete request. One goes to /chat the other to /fim. The later one gets sometimes cancelled.

[TyDunn]

#7341