{"id":88690,"date":"2023-04-05T07:15:00","date_gmt":"2023-04-05T07:15:00","guid":{"rendered":"https:\/\/cloudnewshub.com\/?p=88690"},"modified":"2023-04-05T07:15:00","modified_gmt":"2023-04-05T07:15:00","slug":"italys-chatgpt-ban-sober-precaution-or-chilling-overreaction","status":"publish","type":"post","link":"https:\/\/cloudnewshub.com\/?p=88690","title":{"rendered":"Italy\u2019s ChatGPT ban: Sober precaution or chilling overreaction?"},"content":{"rendered":"<div><img decoding=\"async\" src=\"http:\/\/cloudnewshub.com\/wp-content\/uploads\/2023\/04\/italys-chatgpt-ban-sober-precaution-or-chilling-overreaction.jpg\" class=\"ff-og-image-inserted\"><\/div>\n<p><a href=\"https:\/\/www.theguardian.com\/technology\/2023\/mar\/31\/italy-privacy-watchdog-bans-chatgpt-over-data-breach-concerns\">A sudden ban<\/a> on the use of ChatGPT by the Italian data protection authority has divided artificial intelligence (AI) and data privacy experts over whether or not officially restricting the use of the <a href=\"https:\/\/www.computerweekly.com\/news\/365530593\/Is-business-ready-for-ChatGPT\">groundbreaking yet highly controversial service<\/a> is a sensible and right-thinking precaution under the circumstances, or a massive overreaction with chilling implications for individuals\u2019 freedoms.<\/p>\n<p>The data protection regulator, the <a href=\"https:\/\/www.garanteprivacy.it\/\">Garante per la Protezione dei Dati Personali<\/a> (GPDP) issued its order against ChatGPT\u2019s US-based owners, OpenAI, on Friday 31 March.<\/p>\n<p>The authority accused ChatGPT of collecting data unlawfully. It claimed there was \u201cno way\u201d for ChatGPT to continue processing data without breaching privacy laws, and no legal basis underpinning its collection and processing of data for training purposes. The GPDP added that the information that the ChatGPT bot provides is not always accurate, which implies inaccurate data is being processed.<\/p>\n<p>Furthermore, the GPDP said, ChatGPT lacks an age verification mechanism, and by doing so exposes minors to receiving responses that are age and awareness-appropriate, even though OpenAI\u2019s terms of service claim the service is addressed only to users aged 13 and up.<\/p>\n<p>The Italians additionally took a <a href=\"https:\/\/openai.com\/blog\/march-20-chatgpt-outage\">20 March data breach at the service<\/a> into account. This incident resulted from a bug in the <a href=\"https:\/\/github.com\/redis\/redis-py\">redis-py<\/a> open source library that exposed active user\u2019s chat histories to other users in some circumstances, and additionally exposed payment information of approximately 1.2% of ChatGPT Plus service subscribers during a nine-hour window. This data included first and last names, email and postal addresses, and limited credit card data.<\/p>\n<p>Under the European Union (EU) General Data Protection Regulation (GDPR), OpenAI\u2019s designated representative in the European Economic Area (EEA) will have 20 days to notify the GPDP of measures implemented to comply with the order, or face fines of up to \u20ac20m or 4% of worldwide annual turnover.<\/p>\n<p>The decision makes Italy the first country to have issued any kind of ban or restriction on the use of ChatGPT \u2013 although it is unavailable in several countries, including China, Iran, North Korea and Russia, because OpenAI has not made it available there.<\/p>\n<section class=\"section main-article-chapter\" data-menu-title=\"Commitment to privacy\">\n<h3 class=\"section-title\"><i class=\"icon\" data-icon=\"1\"><\/i>Commitment to privacy<\/h3>\n<p>In a statement, ChatGPT said it had disabled access to the service in Italy as a result, but hoped to have it back online soon. It said it was \u201ccommitted to protecting people\u2019s privacy\u201d and that to the best of its knowledge, it operates in compliance with GDPR and other privacy laws and regulations.<\/p>\n<p>It added that it has been working to reduce the use of personal data in training ChatGPT because it wanted the system to learn about the world in general, not private individuals.<\/p>\n<\/section>\n<section class=\"section main-article-chapter\" data-menu-title=\"Time for a reset\">\n<h3 class=\"section-title\"><i class=\"icon\" data-icon=\"1\"><\/i>Time for a reset<\/h3>\n<p>At about the same time as the Italian authorities were putting the finishing touches to their announcement, a group of more than 1,000 AI experts and other figures in the tech industry, among them Apple co-founder Steve Wozniak and increasingly-erratic social media baron Elon Musk, put their names to <a href=\"https:\/\/www.theguardian.com\/technology\/2023\/mar\/29\/elon-musk-joins-call-for-pause-in-creation-of-giant-ai-digital-minds\">an open letter calling for a temporary moratorium<\/a> on the creation and development of AI models such as the large language model (LLM) behind ChatGPT.<\/p>\n<p>In their letter, the signatories argued that the race to deploy AIs has become out of control, and that a pause was necessary to allow humanity to determine if such systems will truly have beneficial effects, and manageable risks. They called on governments to step in, should the industry not hold back voluntarily.<\/p>\n<p>Michael Covington, vice-president of strategy at <a href=\"https:\/\/www.jamf.com\/\">Jamf<\/a>, was among many who applauded the GPDP\u2019s decision on similar grounds. \u201cI am encouraged when I see regulators stand up and enforce written policies that were designed to protect individual privacy, something that we at Jamf consider to be a fundamental human right,\u201d he said.<\/p>\n<p>\u201cChatGPT has been experiencing massive growth, and this growth has happened with near-zero guardrails. OpenAI has dealt with a few issues, like a lack of data handling policies and well-publicised data breaches. I see value in forcing a reset so this truly innovative technology can develop in a more controlled fashion.<\/p>\n<p>\u201cThat said, I get concerned when I see attempts to regulate common sense and force one \u2018truth\u2019 over another,\u201d added Covington. \u201cAt Jamf, we believe in educating users about data privacy, and empowering them with more control and decision-making authority over what data they are willing to share with third parties.<\/p>\n<p>\u201cRestricting the technology out of fear for users giving too much to any AI service could stunt the growth of tools like ChatGPT, which has incredible potential to transform the ways we work,\u201d he said.<\/p>\n<p>\u201cFurthermore, there is a lot of misinformation on the internet today, but without knowing how the world will monitor for \u2018facts\u2019, we have to respect freedom of speech, and that includes factual inaccuracies. Let the market decide which AI engine is most reliable, but don\u2019t silence the tools out of fear for inaccuracies, especially as this exciting technology is in its infancy,\u201d he argued.<\/p>\n<\/section>\n<section class=\"section main-article-chapter\" data-menu-title=\"Security concerns will get worse\">\n<h3 class=\"section-title\"><i class=\"icon\" data-icon=\"1\"><\/i>Security concerns will get worse<\/h3>\n<p>Dan Shiebler, head of machine learning at <a href=\"https:\/\/abnormalsecurity.com\/\" target=\"_blank\" rel=\"noopener noreferrer\">Abnormal Security<\/a>, said security concerns over LLMs would likely get \u201csubstantially worse\u201d as the models become more closely integrated with APIs and the public internet, something that to his mind is being demonstrated by <a href=\"https:\/\/openai.com\/blog\/chatgpt-plugins\">OpenAI\u2019s recent implementation of support for ChatGPT plugins<\/a>.<\/p>\n<p>He speculated that more such actions may follow. \u201cThe EU in general has shown itself to be pretty quick to act on tech regulation \u2013 GDPR was a major innovation \u2013 so I\u2019d expect to see more discussion of regulation from other member countries and potentially the EU itself,\u201d he said.<\/p>\n<p>Shiebler said the ban was unlikely to have much impact on the development of AI, simply because this can be done very flexibly from any jurisdiction. However, should bans or restrictions start to spread across the EU or US, this would be a much larger hindrance.<\/p>\n<p>However, he said, the while the UK should \u201cabsolutely\u201d look into concerns over potential malicious use cases for LLMs, adopting a similar policy would not be helpful. \u201cAn immediate blanket ban is more likely to exclude the UK from the conversation than anything else,\u201d he pointed out.<\/p>\n<p><a href=\"https:\/\/www.withsecure.com\/gb-en\/home\">WithSecure\u2019s<\/a> Andrew Patel \u2013 who has <a href=\"https:\/\/www.computerweekly.com\/news\/252529081\/Should-we-be-worried-about-malicious-use-of-AI-language-models\">conducted extensive research<\/a> into the LLMs that underpin ChatGPT \u2013 agreed, saying that Italy\u2019s ban would have little impact on the ongoing development of AI systems, and furthermore, could render future models substantially more dangerous to Italian-speakers.<\/p>\n<p>\u201cThe datasets used to train these models already contain a great deal of examples of Italian,\u201d he said. \u201cIf anything, by shutting off Italian input to future models will cause such models to be mildly worse for Italian inputs than for others. That\u2019s not a great situation to be in.\u201d<\/p>\n<\/section>\n<section class=\"section main-article-chapter\" data-menu-title=\"Blatant overreaction\">\n<h3 class=\"section-title\"><i class=\"icon\" data-icon=\"1\"><\/i>Blatant overreaction<\/h3>\n<p>Asked if he thought the Italian authorities have perhaps gone too far, Patel said simply: \u201cYes, this is an overreaction.\u201d<\/p>\n<p>Describing ChatGPT as a \u201cnatural\u201d technological progression, Patel said that if the GPDP\u2019s issue was really to do with Italian citizens interacting with an invasive US technology company, it would have taken similar actions against other US-based platforms.<\/p>\n<p>\u201cThe fact that ChatGPT is hosted by a US company should not be a factor,\u201d he said. \u201cNor should concerns that AI might take over the world.<\/p>\n<p>Patel argued that by restricting the ability of every Italian citizen to access ChatGPT, Italy was putting itself at a substantial disadvantage.<\/p>\n<p>\u201cChatGPT is a useful tool that enables creativity and productivity,\u201d he said. \u201cBy shutting it off, Italy has cut off perhaps the most important tool available to our generation. All companies have security concerns, and of course employees should be instructed to not provide ChatGPT and similar systems with company-sensitive data. [But] such policies should be controlled by individual organisations and not by the host country.\u201d<\/p>\n<p>Erick Galinkin, principal AI researcher at <a href=\"https:\/\/www.rapid7.com\/\">Rapid7<\/a>, said it has been known for years that LLMs memorise training data, and there have already been countless examples of generative models reproducing examples from their training data, so ChatGPT could not have come as a surprise to the GPDP.<\/p>\n<p>Ultimately, he said, the GPDP\u2019s concerns seem to stem more from data collection than from actual training and deployment of LLMs, so what the industry really needs to be addressing is how sensitive data makes it into training data, and how it\u2019s collected.<\/p>\n<p>\u201cAs Bender et al cover well in their paper, <i><a href=\"https:\/\/dl.acm.org\/doi\/10.1145\/3442188.3445922\">On the dangers of stochastic parrots<\/a><\/i>, these models do have real privacy risks that have been well known to the AI ethics and AI security community for years now,\u201d said Galinkin.<\/p>\n<p>\u201cWe cannot put the toothpaste back in the tube, so to speak. \u2018Banning\u2019 these models \u2013 whatever that term means in this context \u2013 is simply encouraging more perfidy on the part of these companies to restrict access and concentrates more power in the hands of tech giants who are able to sink the money into training such models.<\/p>\n<p>\u201cRather, we should be looking for more openness around what data is collected, how it is collected and how the models are trained,\u201d he said.<\/p>\n<\/section>\n","protected":false},"excerpt":{"rendered":"<p>A sudden ban on the use of ChatGPT by the Italian data protection authority has divided artificial intelligence (AI) and data privacy experts over whether or not officially restricting the use of the groundbreaking yet highly controversial service is a sensible and right-thinking precaution under the circumstances, or a massive overreaction with chilling implications for [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":88691,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[533],"tags":[],"class_list":["post-88690","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-it"],"_links":{"self":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/88690","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=88690"}],"version-history":[{"count":0,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/posts\/88690\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=\/wp\/v2\/media\/88691"}],"wp:attachment":[{"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=88690"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=88690"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/cloudnewshub.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=88690"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}