NVIDIA ChatRTX
www.nvidia.com
Your Personalized AI Chatbot.

This is an interesting demo, but it has some drawbacks I can already see:

  • It’s Windows only (maybe Win11 only, the documentation isn’t clear)
  • It only works with RTX 30 series and up
  • It’s closed source, so you have no idea if they’re uploading your data somewhere

The concept is great, having an LLM to sort through your local files and help you find stuff, but it seems really limited.

I think you could get the same functionality(and more) by writing an API for text-gen-webui.

more info here: https://videocardz.com/newz/nvidia-unveils-chat-with-rtx-ai-chatbot-powered-locally-by-geforce-rtx-30-40-gpus

  • OpticalMoose@discuss.tchncs.deOPEnglish
    6·
    9 months ago

    Thanks for the info. I’m not on Windows, so I can’t try it. Doesn’t work offline? That’s what I was afraid of.

    It’s a great proof of concept. Hopefully we’ll see more text-gen-webui extensions soon.