Class CriteriaEvalChain

constructor

• new CriteriaEvalChain(fields): CriteriaEvalChain

• Parameters

  • fields: LLMChainInput<EvalOutputType, BaseLanguageModelInterface>

  Returns CriteriaEvalChain

llm

outputKey

prompt

Optional llmKwargs

Optional memory

Optional skipInputWarning

inputKeys

• get inputKeys(): any

• Returns any

outputKeys

• get outputKeys(): string[]

• Returns string[]

apply

• apply(inputs, config?): Promise<ChainValues[]>

• Parameters

  • inputs: ChainValues[]

  • Optional config: any[]

  Returns Promise<ChainValues[]>

  ⚠️ Deprecated ⚠️

  Use .batch() instead. Will be removed in 0.2.0.

  This feature is deprecated and will be removed in the future.

  It is not recommended for use.

  Call the chain on all inputs in the list

call

• call(values, config?): Promise<ChainValues>

• Run the core logic of this chain and add to output if desired.

  Wraps _call and handles memory.

  Parameters

  • values: any

  • Optional config: any

  Returns Promise<ChainValues>

checkEvaluationArgs

• checkEvaluationArgs(reference?, input?): void

• Check if the evaluation arguments are valid.

  Parameters

  • Optional reference: string

    The reference label.

  • Optional input: string

    The input string.

  Returns void

  Throws

  If the evaluator requires an input string but none is provided, or if the evaluator requires a reference label but none is provided.

evaluateStrings

• evaluateStrings(args, callOptions?, config?): Promise<ChainValues>

• Evaluate Chain or LLM output, based on optional input and label.

  Parameters

  • args: StringEvaluatorArgs

  • Optional callOptions: unknown

  • Optional config: any

  Returns Promise<ChainValues>

  The evaluation results containing the score or value. It is recommended that the dictionary contain the following keys:

  • score: the score of the evaluation, if applicable.
  • value: the string value of the evaluation, if applicable.
  • reasoning: the reasoning for the evaluation, if applicable.

invoke

• invoke(input, config?): Promise<ChainValues>

• Invoke the chain with the provided input and returns the output.

  Parameters

  • input: ChainValues

    Input values for the chain run.

  • Optional config: any

    Optional configuration for the Runnable.

  Returns Promise<ChainValues>

  Promise that resolves with the output of the chain run.

predict

• predict(values, callbackManager?): Promise<EvalOutputType>

• Format prompt with values and pass to LLM

  Parameters

  • values: any

    keys to pass to prompt template

  • Optional callbackManager: any

    CallbackManager to use

  Returns Promise<EvalOutputType>

  Completion from LLM.

  Example

  llm.predict({ adjective: "funny" })
  Copy

prepOutputs

• prepOutputs(inputs, outputs, returnOnlyOutputs?): Promise<Record<string, unknown>>

• Parameters

  • inputs: Record<string, unknown>

  • outputs: Record<string, unknown>

  • returnOnlyOutputs: boolean = false

  Returns Promise<Record<string, unknown>>

run

• run(input, config?): Promise<string>

• Parameters

  • input: any

  • Optional config: any

  Returns Promise<string>

  Deprecated

  Use .invoke() instead. Will be removed in 0.2.0.

serialize

• serialize(): SerializedLLMChain

• Returns SerializedLLMChain

  Deprecated

Static deserialize

• deserialize(data): Promise<LLMChain<string, any>>

• Parameters

  • data: SerializedLLMChain

  Returns Promise<LLMChain<string, any>>