Category: ChatGPT

Auto Added by WPeMatico

On the Poisoning of LLMs

Posted on By infossl
academic papers, artificial intelligence, ChatGPT, hacking, secrecy, Security technology, snake oil, Uncategorized

Interesting essay on the poisoning of LLMs—ChatGPT in particular: Given that we’ve known about model poisoning for years, and given the strong incentives the black-hat SEO crowd has to manipulate results, it’s entirely possible that bad actors have been poisoning ChatGPT for months. We don’t know because OpenAI doesn’t talk about their processes, how they … Read More “On the Poisoning of LLMs” »

Credible Handwriting Machine

Posted on By infossl
artificial intelligence, biometrics, ChatGPT, robotics, Security technology, Uncategorized

In case you don’t have enough to worry about, someone has built a credible handwriting machine: This is still a work in progress, but the project seeks to solve one of the biggest problems with other homework machines, such as this one that I covered a few months ago after it blew up on social … Read More “Credible Handwriting Machine” »

AI to Aid Democracy

Posted on By infossl
artificial intelligence, ChatGPT, Security technology, Uncategorized

There’s good reason to fear that A.I. systems like ChatGPT and GPT4 will harm democracy. Public debate may be overwhelmed by industrial quantities of autogenerated argument. People might fall down political rabbit holes, taken in by superficially convincing bullshit, or obsessed by folies à deux relationships with machine personalities that don’t really exist. These risks … Read More “AI to Aid Democracy” »

LLMs and Phishing

Posted on By infossl
ChatGPT, essays, machine learning, phishing, scams, Security technology, Uncategorized

Here’s an experiment being run by undergraduate computer science students everywhere: Ask ChatGPT to generate phishing emails, and test whether these are better at persuading victims to respond or click on the link than the usual spam. It’s an interesting experiment, and the results are likely to vary wildly based on the details of the … Read More “LLMs and Phishing” »

Prompt Injection Attacks on Large Language Models

Posted on By infossl
academic papers, ChatGPT, cyberattack, Security technology, Uncategorized

This is a good survey on prompt injection attacks on large language models (like ChatGPT). Abstract: We are currently witnessing dramatic advances in the capabilities of Large Language Models (LLMs). They are already being adopted in practice and integrated into many systems, including integrated development environments (IDEs) and search engines. The functionalities of current LLMs … Read More “Prompt Injection Attacks on Large Language Models” »

Defending against AI Lobbyists

Posted on By infossl
artificial intelligence, ChatGPT, essays, impersonation, laws, Security technology, Uncategorized

When is it time to start worrying about artificial intelligence interfering in our democracy? Maybe when an AI writes a letter to The New York Times opposing the regulation of its own technology. That happened last month. And because the letter was responding to an essay we wrote, we’re starting to get worried. And while … Read More “Defending against AI Lobbyists” »

ChatGPT Is Ingesting Corporate Secrets

Posted on By infossl
amazon, ChatGPT, leaks, Security technology, Uncategorized

Interesting: According to internal Slack messages that were leaked to Insider, an Amazon lawyer told workers that they had “already seen instances” of text generated by ChatGPT that “closely” resembled internal company data. This issue seems to have come to a head recently because Amazon staffers and other tech workers throughout the industry have begun … Read More “ChatGPT Is Ingesting Corporate Secrets” »

AI and Political Lobbying

Posted on By infossl
academic papers, artificial intelligence, ChatGPT, laws, Security technology, Uncategorized

Launched just weeks ago, ChatGPT is already threatening to upend how we draft everyday communications like emails, college essays and myriad other forms of writing. Created by the company OpenAI, ChatGPT is a chatbot that can automatically respond to written prompts in a manner that is sometimes eerily close to human. But for all the … Read More “AI and Political Lobbying” »

Threats of Machine-Generated Text

Posted on By infossl
academic papers, ChatGPT, machine learning, privacy, Security technology, threat models, Uncategorized

With the release of ChatGPT, I’ve read many random articles about this or that threat from the technology. This paper is a good survey of the field: what the threats are, how we might detect machine-generated text, directions for future research. It’s a solid grounding amongst all of the hype. Machine Generated Text: A Comprehensive … Read More “Threats of Machine-Generated Text” »