[Inference API] Add parameters to perform inference API as alias to task_settings

[maxhniebergall]

Alias task_settings as parameters in the perform inference API.

examples:

Put the endpoint

  {
  "service": "cohere",
  "service_settings": {
    "model_id": "rerank-english-v3.0",
    "api_key": "<REDACTED>"
  },
  "task_settings": {
    "return_documents": true
  }
  }

perform inference with task settings:

request:

{
    "input": ["test1", "test2", "test3"],
    "query": "test",
    "task_settings":{
        "return_documents":true,
        "top_n": 1
    }
}

response:

{
    "rerank": [
        {
            "index": 0,
            "relevance_score": 9.927262E-4,
            "text": "test1"
        }
    ]
}

perform inference with parameters:

request:

{
    "input": ["test1", "test2", "test3"],
    "query": "test",
    "parameters":{
        "return_documents":true,
        "top_n": 1
    }
}

response:

{
    "rerank": [
        {
            "index": 0,
            "relevance_score": 9.927262E-4,
            "text": "test1"
        }
    ]
}

without parameters or task_settings:

request:

{
    "input": ["test1", "test2", "test3"],
    "query": "test"
}

response:

{
    "rerank": [
        {
            "index": 0,
            "relevance_score": 9.927262E-4,
            "text": "test1"
        },
        {
            "index": 1,
            "relevance_score": 7.1802974E-4,
            "text": "test2"
        },
        {
            "index": 2,
            "relevance_score": 2.1152887E-4,
            "text": "test3"
        }
    ]
}

with both parameters and task settings (the latter one is used)

request:

{
    "input": ["test1", "test2", "test3"],
    "query": "test",
    "parameters":{
        "top_n": 1
    },
    "task_settings":{
        "top_n": 2
    }
}

response:

{
    "rerank": [
        {
            "index": 0,
            "relevance_score": 9.927262E-4,
            "text": "test1"
        },
        {
            "index": 1,
            "relevance_score": 7.1802974E-4,
            "text": "test2"
        }
    ]
}

[elasticsearchmachine]

Hi @maxhniebergall, I've created a changelog YAML for you.

[elasticsearchmachine]

Pinging @elastic/ml-core (Team:ML)