Mistral

Configure Mistral specification.

When using Mistral LLMs, you have the choice of using a built-in Graphlit model, which accrues credits for usage, or using your own Mistral API key.

Graphlit currently supports these built-in Mistral models via the model field: MIXTRAL_8X7B_INSTRUCT, MISTRAL_SMALL, MISTRAL_MEDIUM and MISTRAL_LARGE.

By assigning the model field to CUSTOM, you also will need to assign the key and modelName to use your own Mistral developer account.

You can find the list of current Mistral models here, and use the model name syntax such as open-mixtral-8x7b.

Create Built-In Model Specification

Mutation:

mutation CreateSpecification($specification: SpecificationInput!) {
  createSpecification(specification: $specification) {
    id
    name
    state
    type
    serviceType
  }
}

Variables:

{
  "specification": {
    "type": "COMPLETION",
    "serviceType": "MISTRAL",
    "mistral": {
      "model": "MIXTRAL_8X7B_INSTRUCT"
    },
    "name": "Mistral"
  }
}

Response:

{
  "type": "COMPLETION",
  "serviceType": "ANTHROPIC",
  "id": "a87ce6cd-75f4-4391-8d00-33149e9afc86",
  "name": "Anthropic",
  "state": "ENABLED"
}

Create Custom Model Specification

Mutation:

mutation CreateSpecification($specification: SpecificationInput!) {
  createSpecification(specification: $specification) {
    id
    name
    state
    type
    serviceType
  }
}

Variables:

{
  "specification": {
    "type": "COMPLETION",
    "serviceType": "MISTRAL",
    "mistral": {
      "key": "redacted",
      "modelName": "open-mixtral-8x7b",
      "model": "CUSTOM"
    },
    "name": "Mistral Custom"
  }
}

Response:

{
  "type": "COMPLETION",
  "serviceType": "MISTRAL",
  "id": "3c7d107c-cc9f-4c2f-8ac5-0b0b7ddd2ddf",
  "name": "Mistral Custom",
  "state": "ENABLED"
}