Supported Models

Details on the support evaluation models within the Context.ai platform.

Overview

Context.ai supports many models for generating responses for evaluation. All the below models are allowed values for the model parameter when uploading test sets.

OpenAI

Models

Name	API Identifier
GPT 3.5 Turbo	gpt-3.5-turbo
GPT 3.5 Turbo 16K	gpt-3.5-turbo-16k
GPT 3.5 Turbo 1106	gpt-3.5-turbo-1106
GPT 4	gpt-4
GPT 4 Turbo	gpt-4-turbo-preview
GPT 4 Turbo 1106	gpt-4-1106-preview
GPT 4 Turbo 0125	gpt-4-0125-preview
GPT 4 0613	gpt-4-0613

Supported Parameters

Parameter Name	Model Config Key	JSON Type
Temperature	temperature	Float
Top P	top_p	Float
Max Output Tokens	max_output_tokens	Integer
Stop Sequences	stop_sequences	String Array
Presence Penalty	presence_penalty	Float
Frequency Penalty	frequency_penalty	Float

Anthropic

Models

Name	API Identifier
Claude V2.1	claude-v2.1
Claude V2	claude-v2
Claude Instant	claude-instant-v1

Supported Parameters

Parameter Name	Model Config Key	JSON Type
Temperature	temperature	Float
Top P	top_p	Float
Top K	top_k	Float
Max Tokens to Sample	max_tokens_to_sample	Integer
Stop Sequences	stop_sequences	String Array

Meta

Models

Name	API Identifier
Llama2 70B Chat	llama2-70b-chat-v1
Llama2 13B Chat	llama2-70b-chat-v1

Supported Parameters

Parameter Name	Model Config Key	JSON Type
Temperature	temperature	Float
Top P	top_p	Float
Max Output Tokens	max_output_tokens	Integer

Google

Models

Name	API Identifier
Gemini Pro	gemini-pro
Chat Bison	chat-bison

Supported Parameters

Parameter Name	Model Config Key	JSON Type
Temperature	temperature	Float
Top P	top_p	Float
Top K	top_k	Float
Max Tokens to Sample	max_tokens_to_sample	Integer
Stop Sequences	stop_sequences	String Array