No control over how data is used
听from the School of Computer Science in the Faculty of Engineering said this was a prudent move as there is currently no control over how data given to the chatbot was used. Dr Kummerfeld works on AI and natural language processing, with a particular focus on systems for collaboration between people and AI models.
鈥淎t the same time, it is important to note that Australia can benefit from the scientific discoveries underpinning DeepSeek. We can use those innovations to build our own systems, without the risks of using the chatbot service," says Dr Kummerfeld. 听
DeepSeek being open-source poses unique challenge
, a privacy and cybersecurity expert says听similar to the case with TikTok, this decision is not surprising given the potential risks. 听
鈥淟arge Language Models (LLMs) introduce well-known concerns, including data privacy, confidentiality, and the possibility of containing backdoors. Also, despite significant recent advancements, LLMs can still hallucinate, meaning their outputs must be verified in critical settings
鈥淏eyond the AI itself, the app鈥檚 access to user data鈥攕uch as the clipboard鈥攃an pose additional risks. A unique challenge arises from DeepSeek being open-source; while the original company controls the official web and app versions, anyone can host their own instance. This makes a complete ban challenging to enforce, though in this case, the risk may be considered low,鈥� says Dr Seneviratne, from the School of Computer Science, Faculty of Engineering 听
People now tend to blindly trust AI-generated content. AI can intentionally or unintentionally hallucinate or provide false answers, yet people trust it as if it comes from reliable sources.
Dr Armin Chitizadeh
School of Computer Science, Faculty of Engineering
More user caution needed with AI tools
, an expert in AI ethics at the School of Computer Science, Faculty of Engineering says people need to be more cautious when dealing with any GenAI tools.
"The emergence of GenAI tools has introduced many issues, and I'm glad that DeepSeek's arrival has created a wave of concern.
鈥淭he first concern is that in the race to create the fastest and best AI, companies might cut corners on how customer data is stored, with insufficient time spent on protecting it from malicious actors.听
鈥淭he second concern is that people now tend to blindly trust AI-generated content. AI can intentionally or unintentionally hallucinate or provide false answers, yet people trust it as if it comes from reliable sources.听
鈥淭he third, and possibly most crucial concern is that AI can easily reason and draw important conclusions from seemingly insignificant user data. Users might provide data to GenAI tools, assuming it's not valuable. However, AI can connect the dots and reach important conclusions. This newly inferred information is then in the hands of the GenAI tool owner, who has full control over its use and sale."
It doesn鈥檛 matter whether it鈥檚 China or any other country: government data should not be housed offshore and outside of secure Australian systems.
Professor Kai Reimer
爆料王 Business School and Director of Sydney Executive Plus
Impact on AI industry the real story
is a Professor of Information Technology and Organisation at the 爆料王 Business School and Director of , where he teaches an executive education course on AI fluency.
鈥淭his generates a lot of interest because it鈥檚 AI and China, but it鈥檚 just prudent data security. It doesn鈥檛 matter whether it鈥檚 China or any other country: government data should not be housed offshore and outside of secure Australian systems,鈥� says Professor Reimer.
鈥淭he real story here is how these open-source platforms appear to be reverse engineering the breakthroughs made by pioneers such as OpenAI and impacting the AI industry business model. I liken products such as DeepSeek and Meta AI to MP3s: they didn鈥檛 invent recorded music, but this clever compression technique had a huge impact on how we access it.鈥�
Ban a pre-emptive measure to protect national security
is a Professor of Business Information Systems at the 爆料王 Business School. His research focuses on the organisational and ethical aspects of digital technologies, including data security.
鈥淕overnment agencies typically manage highly sensitive information, and there are worries that DeepSeek鈥檚 extensive collection of data 鈥� such as device details, usage metrics, and personal identifiers 鈥� could expose confidential information to vulnerabilities if accessed or stored outside Australian borders. Although the open-source nature of the model offers transparency regarding its code, it does not guarantee that user data is handled solely within Australia or according to local privacy standards. This risk of cross-border data access is a key factor behind the ban.听
听
鈥淏eyond government applications, generative AIs like DeepSeek pose additional risks to the public. These include the potential spread of misinformation, unintentional biases in outputs, and the risk of privacy breaches if personal data is inadvertently exposed or misused.听
鈥淢oreover, the scale and automation of such systems can lead to accountability challenges, which could complicate efforts to trace and rectify erroneous or harmful content. The ban can thus be seen as a pre-emptive measure aimed at protecting national security and public trust until robust data protection safeguards are established.鈥�
Media contact
Manual Name : Ivy Shih
Manual Description : Media Adviser (Engineering)
Manual Address :
Manual Addition Info Title :
Manual Addition Info Content :
Profile image :
Manual Type : contact
_self
Auto Type : contact
Auto Addition Title :
Auto Addition Content :
Auto Name : true
Auto Position : true
Auto Profile image :
Auto Phone Number : false
Auto Mobile Number : true
Auto Email Address : true
Auto Address : false
UUID :