$260 Million AI Company Releases Undeletable Chatbot That Gives Detailed Instructions on Murder, Ethnic Cleansing
www.404media.co
Mistral, an AI company founded by former Google and Meta alums pushed an “unmoderated” model into the world that will readily tell users how to kill their wives or restore Jim Crow-style discrimination.

The Mistral 7B Instruct model is a quick demonstration that the base model can be easily fine-tuned to achieve compelling performance. It does not have any moderation mechanism. We’re looking forward to engaging with the community on ways to make the model finely respect guardrails, allowing for deployment in environments requiring moderated outputs.

“Whoops, it’s done now, oh well, guess we’ll have to do it later”

Go fucking directly to jail

  • bitofhope@awful.systemsEnglish
    10·
    1 year ago

    Look, I’ll just spell this out for you.

    The size of the model is not in the least bit the point of contention here. Whether this is the largest language model ever created or a tiny and unimpressive one is not why the article was written or linked here.

    The reason the article has an indignant tone as do we is that a company is proudly flaunting that they’re not even trying to deal with the harmful potential of the ethically dubious or straight up awful shit their supposedly informational product can produce.

    They also have a worryingly excited audience praising them for releasing a model whose main selling point is not even its technical sophistication (as you are keen to point out) but the fact it can be used to answer questions like how to kill one’s spouse or why ethnic cleansing is good.