{"id":8373,"date":"2023-02-20T12:00:00","date_gmt":"2023-02-20T10:00:00","guid":{"rendered":"https:\/\/blog.eset.ee\/et\/2023\/02\/20\/will-chatgpt-start-writing-killer-malware\/"},"modified":"2023-02-20T12:00:00","modified_gmt":"2023-02-20T10:00:00","slug":"will-chatgpt-start-writing-killer-malware","status":"publish","type":"post","link":"https:\/\/blog.eset.ee\/et\/en\/2023\/02\/20\/will-chatgpt-start-writing-killer-malware\/","title":{"rendered":"Will ChatGPT start writing killer malware?"},"content":{"rendered":"<p>ChatGPT didn\u2019t write this article \u2013 I did. Nor did I ask it to answer the question from the title \u2013 I will. But I guess that\u2019s just what ChatGPT might say. Luckily, there are some grammar errors left to prove I\u2019m not a robot. But that\u2019s just the kind of thing ChatGPT might do too in order to seem real.<\/p>\n<p>This current robot hipster tech is a fancy autoresponder that is good enough to produce homework answers, research papers, legal responses, medical diagnoses, and a host of other things that have passed the \u201csmell test\u201d when treated as if they are the work of human actors. But will it add meaningfully to the hundreds of thousands of malware samples we see and process daily, or be an easily spotted fake?<\/p>\n<p>In a machine-on-machine duel that the technorati have been lusting after for years, ChatGPT appears a little \u201ctoo good\u201d not to be seen as a serious contender that might jam up the opposing machinery. With both the attacker and defender using the latest machine learning (ML) models, this had to happen.<\/p>\n<p>Except, to build good antimalware machinery, it\u2019s not just robot-on-robot. Some human intervention has always been required: we determined this many years ago, to the chagrin of the ML-only purveyors who enter the marketing fray \u2013 all while insisting on muddying the waters by <a href=\"https:\/\/www.welivesecurity.com\/2017\/04\/11\/fighting-post-truth-reality-cybersecurity\/#:~:text=Editorial%3A%20Fighting%20post,over%20a%20decade\">referring to their ML-only products as using \u201cAI\u201d<\/a>.<\/p>\n<p>While ML models have been used for coarse triage front ends through to more complex analysis, they fall short of being a big red \u201ckill malware\u201d button. Malware just isn\u2019t that simple.<\/p>\n<p>But to be sure, I\u2019ve tapped some of ESET\u2019s own ML gurus and asked:<\/p>\n<p><strong>Q. How good will ChatGPT-generated malware be, or is that even possible?<\/strong><\/p>\n<p>A. We are not really close to \u201cfull AI-generated malware\u201d, though ChatGPT is quite good at code suggestion, generating code examples and snippets, debugging, and optimizing code, and even automating documentation.<\/p>\n<p><strong>Q. What about more advanced features?<\/strong><\/p>\n<p>A. We don\u2019t know how good it is at obfuscation. Some of the examples <a href=\"https:\/\/twitter.com\/svpino\">relate<\/a> to scripting languages like Python. But we saw ChatGPT \u201creversing\u201d the meaning of disassembled code <a href=\"https:\/\/twitter.com\/ptracesecurity\/status\/1609021558047080449?t=wUa8-JNj2oDLZNPM-9kv7Q&amp;s=19\">connected to IDA Pro<\/a>, which is interesting. All in all, it\u2019s probably a handy tool for assisting a programmer, and maybe that\u2019s a first step toward building more full-featured malware, but not yet.<\/p>\n<p><strong>Q. How good is it right now?<\/strong><\/p>\n<p>A. ChatGPT is very impressive, considering that it\u2019s a Large Language Model, and its capabilities surprise <a href=\"https:\/\/arxiv.org\/pdf\/2206.07682.pdf\">even the creators<\/a> of such models. However, currently it\u2019s very shallow, makes errors, creates answers that are closer to hallucinations (i.e., fabricated answers), and isn\u2019t really reliable for anything serious. But it seems to be gaining ground quickly, judging by the swarm of techies poking their toes in the water.<\/p>\n<p><strong>Q. What can it do right now \u2013 what is the \u201clow-hanging fruit\u201d for the platform?<\/strong><\/p>\n<p>A. For now, we see three likely areas of malicious adoption and use:<\/p>\n<ul>\n<li><strong>Out-phishing the phishers<\/strong><\/li>\n<\/ul>\n<p>If you think phishing looked convincing in the past, just wait. From probing more data sources and mashing them up seamlessly to vomit specifically crafted emails that will be very difficult to detect based on their content, and success rates promise to be better at getting clicks. And you won\u2019t be able to hastily cull them due to sloppy language mistakes; their knowledge of your native language is probably better than yours. Since a wide swath of the nastiest attacks start with someone clicking on a link, expect the related impact to supersize.<\/p>\n<ul>\n<li><strong>Ransom negotiation automation<\/strong><\/li>\n<\/ul>\n<p>Smooth-talking ransomware operators are probably rare, but adding a little ChatGPT shine to the communications could lower the workload of attackers seeming legit during negotiations. This will also mean fewer mistakes that might allow defenders to home in on the true identities and locations of the operators.<\/p>\n<ul>\n<li><strong>Phone scams get better<\/strong><\/li>\n<\/ul>\n<p>With natural language generation getting more, well, natural, nasty scammers will sound like they are from your area and have your best interests in mind. This is one of the first onboarding steps in a confidence scam: sounding more confident by sounding like they\u2019re one of your people.<\/p>\n<p>If all this sounds like it may be way in the future, don\u2019t bet on it. It won\u2019t all happen all at once, but criminals are about to get a lot better. We&#8217;ll see if the defense is up to the challenge.<\/p>\n<p><span><\/p>\n<p><em>BEFORE YOU GO: <a href=\"https:\/\/www.welivesecurity.com\/2023\/02\/22\/chatgpt-level-up-phishing-defenses\/\">Writing like a boss with ChatGPT and how to get better at spotting phishing scams<\/a><\/em><\/p>\n<p><\/span><\/p>\n<p class=\"wls-source\"><a href=\"https:\/\/www.welivesecurity.com\/2023\/02\/20\/will-chatgpt-start-writing-killer-malware\/\" rel=\"nofollow noopener\" target=\"_blank\">Read the full analysis on WeLiveSecurity \u2192<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>AI-pocalypse soon? As stunning as ChatGPT\u2019s output can be, should we also expect the chatbot to spit out sophisticated malware?<\/p>\n","protected":false},"author":5,"featured_media":8374,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[147],"tags":[],"class_list":["post-8373","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-cybercrime"],"acf":[],"amp_enabled":true,"_links":{"self":[{"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/posts\/8373","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/users\/5"}],"replies":[{"embeddable":true,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/comments?post=8373"}],"version-history":[{"count":0,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/posts\/8373\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/media\/8374"}],"wp:attachment":[{"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/media?parent=8373"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/categories?post=8373"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blog.eset.ee\/et\/en\/wp-json\/wp\/v2\/tags?post=8373"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}