Skip to content

Local Text Generation (Built-in Engine)

This is the most straightforward approach to running local language models, as it uses DREAMIO's integrated inference engine. All you need to do is download a model file and tell the game where to find it.

Step 1: Download a GGUF Model

First, you need a model file in the GGUF format.

  • What is GGUF? It's a special file format for language models that's optimized to run efficiently on consumer hardware.
  • Where to find models: The best place to find GGUF models is Hugging Face, a vast online hub for AI models. A popular and reliable creator of GGUF models is "bartowski".
  • How to Download:
    1. Go to the Hugging Face website and search for models with "GGUF" in the name (e.g., "Gemma 3 12B GGUF").
    2. On the model's page, navigate to the "Files and versions" tab.
    3. Look for a file ending in .gguf. Models come in different sizes (quantizations). Smaller files (e.g., Q4_K_M) run faster and use less memory, while larger files (e.g., Q8_0) are more capable but require more powerful hardware. A Q4 or Q5 model is a good starting point.
    4. Click the download icon to save the GGUF file to your computer. It's a good idea to create a dedicated folder for your DREAMIO models to keep them organized.

While you can use any GGUF model, here are some recommendations based on your available VRAM:

  • For users with 12 GB VRAM or more:

    • Model: gemma-3-12b-it-q4_0_s.gguf
    • Notes: This is a high-quality quantized model that offers a great balance of performance and resource usage.

  • For users with 24 GB VRAM or more:

    • Model: gemma-3-27b-it-q4_0_s.gguf
    • Notes: This is a larger and more capable model that can produce more detailed and creative text.

Step 2: Configure DREAMIO

Next, point DREAMIO to your new model.

  1. Launch DREAMIO and go to the Text Generation Settings.
  2. Select the "Local" provider option.
  3. Click on the "Models Path" setting and navigate to the folder where you saved your downloaded GGUF model.
  4. Once the folder is selected, you should be able to choose the specific GGUF model file from the "Model" dropdown menu.
  5. You're all set! The game will now use the model running on your computer.

Alternative: Using External Tools

For more advanced control and features, you can use external tools like Ollama or LM Studio to serve your models.

Learn how to use external text generation tools »