August 2024 Patch – Tech Café

2024-08-31 19:54:50

Guillaume Poggiaspalla updates the practical guides for running artificial intelligence on your PC.

(Advertisement)

Infomaniak shares the values ​​of Tech Café:
ethics, ecology and respect for privacy.
👉 Discover our partner’s free offers: infomaniak.com

❤️ Patreon
💬 Discord
💻 techcafe.fr

Previous episodes

Images

• What’s new? The new generation is transforming.
• Stable Diffusion 3. Because yes: it still exists.
• Flux and his weight problem:
  • With ComfyUI8 bits are still popular!
  • Flux dev and Flow Fast in 8 bits; it’s not retro at all.
  • ForgeWebUIfor spaghetti allergies.
  • If 8 bits is great… try 4. For Devpour Fast.
  • Bag of knots: Comfy will always remain Comfy…
  • GGUF : little Gregory strikes again.
  • The solution not all in and of All.
• Auraflow: the outsider to test in ligne et hors ligne.

Texts

• What’s new? Everything! Mistral Large and Nemo, Llama 3.1 and the Gemma 2.
• Koboldcpp news, you can now whisper in the ear…
• Yes him to show your… head.
• Oh la la Ollama! They are OpenWebUI is very attractive.
• Revengethe alternative to LM Studio.
• AI in your pocket
  • Maid
  • What’ll you do when you get lonely ? Layla for Android and iOS.
  • The little LLM girls: Gemma 2b et Phi 3.5 mini.

Addendum : https pour koboldcpp

To make a key/certificate pair, download openssl. Install it wherever you want.

Then, on the command line, to create a key:

openssl genrsa 2048 > ca-key.pem

To generate the certificate:

openssl req -new -x509 -nodes -days 3600 -key ca-key.pem -out ca.pem

Then provide the ca.pem certificate and ca-key.pem key to Koboldcpp.

Addendum: How to make Minecraft talk with koboldcpp?

CraftGPTa plugin for any Minecraft Paper/Spigot server.

Start the server, stop it. Go to the plugin’s config.yml. Put a key like “sk-a123456789llama” and the base-url: “http://localhost:5001”. Or other if it is not the local machine of course. Modify the prompts as you want, especially if you want it to speak French. Launch your koboldcpp with the model of your choice then your Minecraft server. And have fun!

Participants

• A program prepared by Guillaume Poggiaspalla
• Presented by Guillaume Vendé

1725244773
#August #Patch #Tech #Café