FINAL WORD attack methods , such as for example automating the creation of phishing emails .
Multiple ways in which AI can fail
• AI is helpful in mundane administrative tasks associated with spreadsheets and statistics .
• AI is an algorithmic construct built on human creative endeavours and data that is often flawed and biased .
• AI is not truly artificial or intelligent .
• AI is made from vast amounts of human labour , and is not intelligent like human intelligence .
• AI is not able to discern things without extensive human training , and it has a different statistical logic for how meaning is made .
• We have made this terrible error , to believe that minds are like computers and vice versa .
• We assume things are an analogue to human intelligence , and nothing could be further from the truth .
• AI hallucination , is where the output is either fake or nonsense and happens when prompts are outside of training data .
• The AI model hallucinates or contradicts itself in order to respond .
• Human beings tend to attribute human characteristics to machines and develop feelings of empathy towards them .
• People become vulnerable to manipulation , persuasion , social engineering because of the over-trust effect .
• People tend to believe and follow machines more than they should .
• People are likely to alter their responses to queries in order to comply with suggestions made by robots .
• The presence of bias in the data and the current absence of regulations regarding AI development , all raise ethical concerns .
• It is important to be mindful of the information we share with AI chatbots and virtual personal assistants .
• We should always question how our data is being used and by whom .
• There is a risk of sharing personal and business information with data training models .
Anna Collard , SVP Content Strategy and Evangelist , KnowBe4 AFRICA
Automated attacks
This taps directly into the potential of Generative Adversarial Network , as cybercriminals make use of deepfakes in more sophisticated attacks . They use it in impersonation attacks , where fake voice or even video versions of someone can be used to manipulate victims into paying or following other fraudulent instructions .
Cybercriminals also benefit from jailbroken generative AI models to help them automate or simplify their
Over-trust effect
This refers to the fact that human beings tend to attribute human characteristics to machines and develop feelings of empathy towards them . This tendency becomes even stronger when the interactions with machines seem intelligent . Although this can positively impact user engagement and support in the service sector , it also carries a risk .
People become more vulnerable to manipulation , persuasion , and social engineering because of this over-trust effect . They tend to believe and follow machines more than they should . Research has shown , people are likely to alter their responses to queries in order to comply with suggestions made by robots .
Manipulation
AI , through the use of natural language processing , machine learning , and algorithmic analyses , can both respond to and simulate emotions . By gathering information from various sources , agenda driven AI chatbots for example can promptly react to sensory input in real time and use it to accomplish specific objectives , such as persuasion or manipulation . These capabilities create opportunities for the dissemination of predatory content , misinformation , disinformation , and frauds .
Ethical issues
The presence of bias in the data and the current absence of regulations regarding AI development , data usage , and AI application all raise ethical concerns . Global efforts are underway to tackle the challenge of ethics in AI and reduce the risks of AI poisoning , which entails manipulating data to introduce vulnerabilities or biases .
However , South Africa currently lacks momentum in addressing these issues . This must change , as managing and detecting the risk of polluted AI data before it causes long-term harm is essential .
It is important to be mindful of the information we share with AI chatbots and virtual personal assistants . We should always question how our data is being used and by whom . There is a risk of sharing sensitive personal and business information with data training models .
While AI is a valuable tool , it is crucial to use it with critical thinking and mindfulness , and only rely on it in situations where it provides the most value and has been fact checked . p
76 INTELLIGENTCIO AFRICA www . intelligentcio . com