Simple webchat for server by tobi · Pull Request #1998 · ggerganov/llama.cpp
github.com
I put together a simple web-chat that demonstrates how to use the SSE(ish) streaming in the server example. I also went ahead and served it from the root url, to make the server a bit more approach...
  • andybug@lemmy.worldEnglish
    1·
    1 year ago

    Hey that’s pretty cool, thanks for sharing! I’ll give it a spin this evening. I think this will make the project much more accessible.