Skip to main content

Having Conversations

Once a model is loaded, you can start chatting.

Sending Messages

  1. Type your message in the input box
  2. Press Enter or click Send
  3. Wait for the model to respond
  4. Continue the conversation

Conversation Context

The chat maintains conversation history:
  • Each message you send includes previous context
  • The model “remembers” what you’ve discussed
  • Longer conversations use more memory

Context Window

Models have a maximum context length:
Context lengths vary by model version. Check the model card on Hugging Face for exact specifications.
When context fills up, oldest messages may be dropped.

Conversation Tips

For Testing Fine-tuned Models

Test with prompts similar to your training data:

For Evaluating Quality

Ask questions that reveal model capabilities:
  • Factual: “What is the capital of France?”
  • Reasoning: “If A > B and B > C, is A > C?”
  • Creative: “Write a haiku about programming”
  • Domain-specific: Questions from your fine-tuning domain

For Finding Issues

Test edge cases:
  • Very short inputs (“Hi”)
  • Very long inputs
  • Unusual characters or formatting
  • Questions outside training domain
  • Attempts to confuse the model

Clearing History

To start fresh:
  • Look for “Clear” or “New Chat” button
  • Or reload the page
This is useful when:
  • Testing different scenarios
  • Context gets too long
  • Starting a new demo

Multi-turn Conversations

The model sees the full conversation:
The second response uses context from the first exchange.

Common Patterns

Question-Answer Testing

Instruction Following

Role-Playing

Next Steps

Parameters

Adjust generation settings

CLI Training

Train better models