PaLM 2 for Chat (chat-bison) is a version of the PaLM 2 language model fine-tuned specifically for multi-turn conversation use cases. With a maximum input token limit of 4096 and an output token limit of 1024, it is well-suited for handling lengthy and complex conversations. Trained on a diverse dataset until February 2023, this model has the ability to understand and generate responses in a wide range of topics. PaLM 2 is known for its enhanced multilingual capabilities, advanced reasoning skills, and proficiency in coding tasks.
from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="palm/chat-bison", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)from openai import OpenAI client = OpenAI( base_url="https://api.respan.ai/api/", api_key="YOUR_RESPAN_API_KEY",) response = client.chat.completions.create( model="palm/chat-bison", messages=[{"role": "user", "content": "Hello!"}],)print(response.choices[0].message.content)Gateway routes for this model on the Respan gateway, including fallback routes when configured.
Other models from the same provider available through the gateway.
ISO 27001
Respan is fully compliant with ISO 27001, the internationally recognized standard for information security management.
SOC 2
We meet SOC 2 requirements to ensure secure and compliant management of data across all our systems.
GDPR
With operations designed for global compliance, we operate under GDPR - the world's strictest standard for data privacy.
HIPAA
Respan is HIPAA compliant with a Business Associate Agreement available for healthcare organizations.