{"id":88591,"date":"2023-03-28T07:45:00","date_gmt":"2023-03-28T07:45:00","guid":{"rendered":"https:\/\/cloudnewshub.com\/?p=88591"},"modified":"2023-03-28T07:45:00","modified_gmt":"2023-03-28T07:45:00","slug":"europol-warns-cops-to-prep-for-malicious-ai-abuse","status":"publish","type":"post","link":"https:\/\/cloudnewshub.com\/?p=88591","title":{"rendered":"Europol warns cops to prep for malicious AI abuse"},"content":{"rendered":"<div><img decoding=\"async\" src=\"http:\/\/cloudnewshub.com\/wp-content\/uploads\/2023\/03\/europol-warns-cops-to-prep-for-malicious-ai-abuse.jpg\" class=\"ff-og-image-inserted\"><\/div>\n<p>The European Union Agency for Law Enforcement, or Europol, has made a series of recommendations to the law enforcement community should prepare for the positive and negative impacts that <a href=\"https:\/\/www.techtarget.com\/searchenterpriseai\/definition\/language-modeling\">large language models<\/a> (LLMs) \u2013 the artificial intelligence (AI) models <a href=\"https:\/\/www.computerweekly.com\/news\/365533696\/How-large-language-models-address-enterprise-IT\">underpinning products such as ChatGPT<\/a> that process, manipulate and generate text \u2013 will have on the criminal landscape.<\/p>\n<p>In the report <i><a href=\"https:\/\/www.europol.europa.eu\/publications-events\/publications\/chatgpt-impact-of-large-language-models-law-enforcement\">ChatGPT \u2013 the impact of large language models on law enforcement<\/a><\/i>, Europol\u2019s Innovation Lab compiled the findings of a number of workshops and expert criminologists to explore how criminals \u2013 not just cyber criminals \u2013 can abuse LLMs in their work, and how LLMs might help investigators in future.<\/p>\n<p>\u201cThe aim of this report is to raise awareness about the potential misuse of LLMs, to open a dialogue with AI companies to help them build in better safeguards, and to promote the development of safe and trustworthy AI systems,\u201d Europol said.<\/p>\n<p>The Europol researchers described the outlook for the potential exploitation of LLMs and AIs by criminals as \u201cgrim\u201d. <a href=\"https:\/\/www.computerweekly.com\/news\/252529081\/Should-we-be-worried-about-malicious-use-of-AI-language-models\">In common with other researchers<\/a> who have looked into the technology, they found three key areas of concern:<\/p>\n<ol class=\"default-list\">\n<li>The ability of LLMs to reproduce language patterns and impersonate the style of specific individuals or groups already means it can draft highly realistic text at scale to generate convincing phishing lures.<\/li>\n<li>The ability of LLMs to produce authentic-appearing text at speed and scale makes it well-suited for exploitation to create propaganda and disinformation.<\/li>\n<li>The ability of LLMs to produce potentially usable code in different programming makes it potentially interesting to cyber criminals to use as a tool in creating new malwares and ransomware lockers. Note that the cyber security community regards this impact as <a href=\"https:\/\/www.computerweekly.com\/news\/365532535\/NCSC-warns-over-AI-language-models-but-rejects-cyber-alarmism\">a little more long-term at this point<\/a>, although this may change as the technology develops.<\/li>\n<\/ol>\n<p>Europol made a number of recommendations for law enforcement professionals to incorporate into their thinking to be better prepared for the impact of LLMs:<\/p>\n<ul class=\"default-list\">\n<li>Given the potential for harm, agencies need to begin to raise awareness of the issues to ensure that potential loopholes of use for criminal purposes are found and closed;<\/li>\n<li>Agencies also need to understand the impact of LLMs on all potentially affected areas of crime, not just digitally enabled crime, to predict, prevent and investigate different types of AI abuse;<\/li>\n<li>They should also start to develop the in-house skills needed to make the most of LLMs \u2013 gaining an understanding of how such systems can be usefully used to build knowledge, expand existing expertise, and extract the required response. Serving police officers will need to be trained on how to assess the content produced by LLMs in terms of accuracy and bias;<\/li>\n<li>Agencies should also engage with external stakeholders, that is to say, the tech sector, to make sure that safety mechanisms are considered, and subject to a process of continuous improvement, during the development of LLM-enabled technologies;<\/li>\n<li>Finally, agencies may also wish to explore the possibilities of customised, private LLMs trained on data that they themselves hold, leading to more tailored and specific use cases. This will require extensive ethical consideration, and new processes and safeguards will need to be adopted, in order to prevent serving police officers from abusing LLMs themselves.<\/li>\n<\/ul>\n<p>Julia O\u2019Toole, CEO of <a href=\"https:\/\/mycena.co\/\">MyCena Security Solutions<\/a>, said: \u201cIt\u2019s not surprising Europol has issued this new report warning organisations and consumers about the risks associated with ChatGPT, as the tool has the potential to completely reform the phishing world, in favour of the bad guys.<\/p>\n<p>\u201cWhen criminals use ChatGPT, there are no language or culture barriers. They can prompt the application to gather information about organisations, the events they take part in, the companies they work with, at phenomenal speed.<\/p>\n<p>\u201cThey can then prompt ChatGPT to use this information to write highly credible scam emails. When the target receives an email from their \u2018apparent\u2019 bank, CEO or supplier, there are no language tell-tale signs the email is bogus.<\/p>\n<p>\u201cThe tone, context and reason to carry out the bank transfer give no evidence to suggest the email is a scam. This makes ChatGPT-generated phishing emails very difficult to spot and dangerous,\u201d she added.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>The European Union Agency for Law Enforcement, or Europol, has made a series of recommendations to the law enforcement community should prepare for the positive and negative impacts that large language models (LLMs) \u2013 the artificial intelligence (AI) models underpinning products such as ChatGPT that process, manipulate and generate text \u2013 will have on the [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":88592,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[533],"tags":[],"class_list":["post-88591","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it"],"_links":{"self":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/88591","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=88591"}],"version-history":[{"count":0,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/88591\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/media\/88592"}],"wp:attachment":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=88591"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=88591"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=88591"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}