LocalAiProcessingSettings

Settings for LocalAiProcessing. Values fall back through three levels: document → SDK → built-in default. Writes target the document only when set on a document’s settings, otherwise the SDK globally when set on SdkSettings.

using Nutrient;

The SDK creates this class through factory methods or other SDK objects.

Properties

ContextTokens

public int ContextTokens { get; set; }

Gets or sets the value of ContextTokens. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: int

GpuLayers

public int GpuLayers { get; set; }

Gets or sets the value of GpuLayers. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: int

ImageMinTokens

public int ImageMinTokens { get; set; }

Gets or sets the value of ImageMinTokens. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: int

MaxConcurrency

public int MaxConcurrency { get; set; }

Gets or sets the value of MaxConcurrency. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: int

MmprojPath

public string MmprojPath { get; set; }

Gets or sets the value of MmprojPath. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: string

ModelPath

public string ModelPath { get; set; }

Gets or sets the value of ModelPath. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: string

Threads

public int Threads { get; set; }

Gets or sets the value of Threads. Reads walk the chain: Document override → SDK override → Default. Writes go to document level if available, otherwise SDK level.

Type: int

Resource management

public void Dispose()

LocalAiProcessingSettings implements IDisposable. Call Dispose() or use a C# using declaration to release its native handle right away. If you don’t, the handle is released when the object is garbage collected.