Magazine menu Close Magazine menu

audio

Latest stories

insight story, ethical and ai, robot communicates with people

As AI’s influence rapidly expands, here’s how business ethics must keep up

  • min read
    • We live in a world where algorithms can make decisions and data fuels innovation. It means ethical considerations are more critical than ever for business. They must balance using new technology to increase competitive advantage while preserving integrity and protecting customers. In our podcast Insight Story, experts Tomoko Yokoi (Switzerland,) senior business executive and researcher at Global Centre for Digital Business Transformation, IMD Business School and Andy Crouch (UK,) consultant and co-founder of ethical-AI natural language processing company, Akumen, outline how AI biases can impact business and what steps they can take to ensure its fairness. Kaspersky Global Research and Analysis Team's Dr. Amin Hasbini expands on the privacy and responsible data use implications. Not all AI is created ethically equal Andy's company Akumen found a problem that needed solving. "Scores out of five are useful, but we wanted insight from written responses like product reviews, and there was no way to do it. The team created an AI solution to identify meaning like topics, emotions and sentiment. Sentiment measures opinion – positive, negative or neutral – but emotions drive behavior. It works on text feedback anywhere, which might be about consumer goods, healthcare or anything else." Their approach uses AI differently from generative AI tools like ChatGPT. "Our AI is rule-based, human-created and human-curated. It's completely transparent and there are no algorithms as with large language models. We can dive in and make rules more nuanced if we recognize bias. With large language models, that would be complex and expensive." Andy expands on generative AI's limits for truly understanding people. "We asked ChatGPT how many emotions humans experience – it said 138,000. That doesn't help us understand what drives behavior. Our platform has 22 emotions – enough to see what drives behavior. Through our partner, Civicom, we're helping the UK's national health service (NHS) to understand what patients and staff experience." And that understanding can improve lives: Larger language models use big data pools, but there are also more contained, enterprise-level tools like ChatGPT Enterprise that businesses can furnish with their own data and control how they use it. Tomoko sees enterprise-level tools as useful but notes they can't do what big data can do. "Organizations are developing new functions around AI, like data annotators, who clean data before it goes into models. But is it foolproof? The beauty of using data from everywhere is it gives you insights you otherwise wouldn't get." Choosing ethical suppliers Luckily for companies using AI ethically, more businesses are adopting digital responsibility policies and choosing ethics-first suppliers. Tomoko gives an example. "Deutsche Telekom has been a pioneer in AI ethics. They've trained all employees to ensure AI ethics are distributed throughout the organization. At the same time, they have about 300 suppliers and ensure it's in all their contracts. So it goes beyond the boundaries of the company." But many businesses don't know where to start. Tomoko says, "Over 250 companies have committed to AI ethics, but codified mechanisms only help if they change behavior. How can we live these principles and ideals? External experts can help, and there's a case for individuals taking responsibility, which will have a collective impact." She suggests how companies frame AI ethics matters. "You can see AI ethics as value or as compliance. If it's compliance, it will be cost- or risk-driven. But AI ethics could also be a competitive advantage." Andy compares AI ethics to health and safety. "If you have a health and safety director, it's only one person's responsibility. Change won't happen unless everyone understands health and safety's importance, and especially that it drives productivity and revenue." The competitive advantage is real. McKinsey research found 72 percent of customers considered a business's AI policy before making an AI-related purchase. Tomoko highlights the importance of backing up policies with action. Which AI issues should companies care about? Tomoko outlines three places to look. "First, consider the software development lifecycle. If you're considering developing an AI product, think of how it's designed. Look for bias in the data. "Second, once it's being developed, although many companies say they're implementing AI ethics, people developing AI-driven products don't know how to apply those principles. So, look at how people use ethical principles in day-to-day software development. "Third, we test products in controlled environments. Once it launches, ask who is monitoring it and how we ensure it doesn't gather bias and that people use it correctly." Tomoko is part of IMD Business School and knows that what future executives learn about AI ethics will shape future companies' ethical behaviors with AI. She says, "First, we say everyone has a responsibility to these issues that goes beyond the company. You need to be aware of this responsibility, but also be able to make others in your team aware." Secondly, "What type of organizations do we want to build? We coach people to be able to handle multiple goals – not only profit but also social, environmental and ethical goals. We want them to walk away thinking of the future." Andy drills down into the data AI is using. "Understand how the AI model is built. Is the data you're analyzing through that AI model ethically sourced, and are you using it ethically? The lack of transparency over large language models is rife for ethical risk and bias." AI training data bias can have life-threatening impacts. Poor AI translations have been found to be jeopardizing asylum claims. Andy sees retrieval-augmented generation (RAG,) which uses more proofed datasets, as part of the solution. Can we have secure and well-regulated AI? Dr. Amin Hasbini. Head of Research Centre, Middle East, Turkey and Africa for Kaspersky Global Research and Analysis Team, thinks AI ethical standards are needed. "AI won't self-define its ethics. They must be programmed with ethical standards." Since there is almost no way the public can evaluate, critique or improve AI ethics, regulation must play a part, according to Amin. "We need security and safety by design, and continuous verification of it. That would require transparency, especially from big tech vendors, and letting the public influence how these technologies develop." He likens the challenge to that of regulating social media. "We're asking people to adopt technologies that can do much damage without giving them ways to ensure that doesn't happen. The same has happened before with social media, with it being used for data leaks and fake news. European Union regulation is moving fast around AI, but AI could be much more dangerous than social media – we need rules now." For improved ethical data use, Amin recommends asset management controls. "If well deployed, asset management controls allow data to be classified, including which is available to AI, which can be shared publicly and which needs to stay inside the organization." Andy says regulation is hard in this fast-moving space because no one knows what's coming next. "I question anyone saying they know what will happen in the next six months or beyond. But there's a lot of fear and lobbying going on – so go slow. If your AI-driven capability can't deliver because it's non-compliant, ethically or otherwise, it will be damaging." However, he believes regulation is necessary. "It will be interesting to see how they regulate something that's not easily defined and morphs quickly, but we must protect those who need protecting." Kaspersky has recently proposed six principles for ethical use of AI in the cybersecurity industry with transparency at the core. Getting started with AI ethics Our experts have straightforward advice for those business executives yet to approach AI ethics. Tomoko says, "As a mindset, remember the analog and digital worlds are the same. Your analog-world values should extend into the digital world." Andy highlights the need for both widespread knowledge and deep expertise. "Get your whole team conversant with AI, but have a well-informed friend who lives and breathes this stuff to call when there are challenges." With headlines about AI taking our jobs and AI founders like Geoffrey Hinton sounding the alarm on unregulated AI perils, it's easy to write off AI ethics as a problem too hard to fix. But these complex issues need priority. There are green shoots of change. In December 2023, the AI Alliance launched to focus on developing AI responsibly, including safety and security tools. Its 50 members include Meta, IBM, CERN and Cornell. The message may be, 'Let's not move too fast and not break things.' With OpenAI, creators of ChatGPT, not invited to the party, could the tortoise of collective corporations beat the nimble hare of innovation? AI gives business potential for great gains but comes with great risks to reputation, security and privacy. With strong ethical AI policies translated into action and widespread knowledge among employees, businesses can have more confidence to take advantage of AI's many benefits.
insight story digital sovereignty

Digital sovereignty and the rise of data spaces: What does it mean for business?

  • min read
    • Data. It seems businesses can't live with it – without big friction – and can't live without it. Cory Doctorow wrote for Secure Futures in 2020 that data – rather than being the 'new oil' – can fast become toxic waste, without due attention to minimization and proper management. Now data fuels almost every business, it's critical leaders understand the next evolution of data regulation – digital sovereignty – and how it applies to their work. It's not just about complying with the law, but an opportunity for competitive advantage with the bonus of enhancing customer trust. In our podcast Insight Story, experts Ben Farrand (UK,) Professor in Law and Emerging Technologies at Newcastle University and Sille Sepp (Finland,) Director of Operations at MyData Global, explore how business can do better in an increasingly interconnected world. Dr. Amin Hasbini of Kaspersky's Global Research and Analysis Team talks about the role of transparency in digital sovereignty, and why sharing intelligence makes good business sense. What is digital sovereignty, and what does it mean for business? Ben says, "Digital sovereignty is about geopolitics. We're seeing increasing tensions between states and concern over the power of big market players like Google, Amazon and Facebook in the US and Chinese companies like Baidu, Alibaba and Tencent. When data moves between countries, there may be detrimental impacts from geopolitics and national regimes, regulations or policies." Against this backdrop, the EU introduced its General Data Protection Regulation (GDPR) in 2016, providing that identifying, personal or sensitive data about EU citizens kept anywhere in the world is governed by EU law. GDPR and digital sovereignty more broadly mean companies must think about the legal implications of their cross-border interactions. Ben recommends firms wanting to trade more internationally have people dedicated to data security and digital sovereignty. "Companies handling EU citizens' personal data need someone aware of how to comply with GDPR's requirements. In the EU and UK, they're often called data protection officers. They must know data security protocols, and how data can and can't be used." Can state concerns and business interests align? Businesses often don't have the same priorities as nations. Is digital sovereignty making it harder to trade internationally? Ben says, "Digital sovereignty covers the whole supply chain from raw materials to cybersecurity services. For example, when supply chains for semiconductors collapsed during the pandemic, shutting some car manufacturers, the EU, China and the US started seeking more control of resources." But he questions the merit of attempts at strategic autonomy in today's world. Getting ahead of compliance with data ethics Digital sovereignty is on the radar for many businesses, but those who go the extra mile to do the right thing, rather than simply comply, may see advantages. Ben says, "We'll see both 'stick' and 'carrot' regulation. There's much legislation about investment, like the US CHIPS and Science Act, around how companies can cooperate and seek funding to diversify supply chains, for improving trade relations with third parties in ways that build resilience." Businesses should also note a growing focus on regulating social media platforms, given its role in communicating with customers. "The EU recently passed the Digital Services Act. It applies to content on social media platforms and search engines that may be illegal in member states, such as hate speech or trade in prohibited goods," says Ben. The legislation isn't concerned with individual instances of illegal content but requires social media platforms and search engines to have transparency, accountability and oversight systems. Ben sees benefits for business. "Companies don't want to be associated with illegal or immoral things. They already manage this by pulling advertising or moving over to other platforms. Digital sovereignty isn't just coming from regulation, but market-based decisions." AI and digital sovereignty The explosion of AI systems has made it even more important that organizations are clear on data ownership. Ben sees regulation in this field coming soon. "The EU is talking about regulating high-risk systems because they believe AI shouldn't be doing some things." And it's not just the EU. "At the AI Safety Summit hosted by UK Prime Minister Rishi Sunak in November 2023, there was an agreement between the EU, US, China and others to take a united approach in managing high-risk systems." Again, there are business opportunities. "New technologies arise from regulation like the 'federated computing' approach, where you train AI on data sets remotely then communicate only the outcomes centrally, minimizing data privacy risks," explains Ben. Making space for data security and data power All businesses want to use their data better for innovation and growth. But it may be challenging to do so securely, fairly and in ways customers trust. Data spaces are one tool for addressing safe and ethical data use while leveraging its power for better business. Sille Sepp is Director of Operations at human-centered data non-profit MyDataGlobal. She explains data spaces: "They're a systemic approach to increasing trust and sovereignty in sharing and using data across organizations and sectors. It's not just technological infrastructure but includes business, legal and operational layers for trustworthy data sharing." Examples include the Smart Connected Supplier Network for manufacturing supply chains and Catena-X for automotive supply chains. MyData is involved in a cross-data space project, Data Spaces Support Center, and preparing for the Data Space for Skills. Businesses can join projects as a data provider, data user or enabling service, or look at creating their own data space with collaborators. Sille recommends how to start: "As a partner in the Data Spaces Support Center, I recommend exploring the website, the repositories of initiatives and the contributing partners. Associations like International Data Spaces, Gaia-X and FIWARE have long mapped data space work." Data spaces go beyond EU-based businesses. "Many initiatives collaborate with international partners and look at business cases that will bring global benefits," says Sille. Sille highlights the need to put customer control of their data at the heart of developing data spaces. "When developing design principles and architecture for data spaces, we must embed human-centric principles. There are ways to empower people through design choices. Businesses can get involved as enabling services – intermediaries that serve the interests of individuals, managing permissions and returning value to them." Transparency's role in digital sovereignty Dr. Amin Hasbini of Kaspersky's Global Research and Analysis Team explains how tech businesses can use transparency centers to uphold different states' digital sovereignty worldwide. "Digital sovereignty means companies, especially multinationals operating in digital, need tools that comply with regulation in countries where they operate. As an example, Kaspersky operates transparency centers in several countries. These let entities check code to ensure it complies with their laws." But he thinks international firms can go further in building regulators' trust. Sharing also benefits the industry as a whole. "We publish many of our threat intelligence findings, which means better threat visibility for everyone. The cybersecurity community can build on our findings," says Amin. Taking the first steps into digital sovereignty Ben advises businesses to consider the basics as they start exploring digital sovereignty. "What data are you collecting and where does it go? Once you know that, you can think through the implications: Security provisions you may need to protect data within your company and outside. Think first about why you need this data, and that will help you define every step of the process." Let's be super clear: Digital sovereignty, like all matters of global trade, is complex. It's not an off-the-shelf charter or compliance checklist. Enterprises should grasp the opportunity now to get involved with data spaces and other cooperation projects to shape the new international standards for data. Digital sovereignty regulation will only grow – particularly around the use of AI. Businesses should think through how they use data and what security should be in place to safeguard it. Digital sovereignty also presents opportunities for better business, such as through data spaces and transparency initiatives.
two professors teach robot to resolve tasks, tech learning

How to get better returns on business tech investments

  • min read
    • In a tech store, it's tempting to convince yourself you need the latest shiny gadget. That device upgrade will radically improve your productivity. You leave with a bag of stylish little boxes and a dented credit card. Enterprise tech decision-makers also struggle with these magpie-like impulses. Recent research found GE, Ford and other major players poured 1.3 trillion US dollars into digital transformation. 70 percent of it – $900 billion – went into failed programs. That's quite some buyer's remorse. Businesses know they need tech for competitive advantage – but which tech? And when they've got it, how do they use it effectively? In our podcast Insight Story, Olivier Blanchard, Research Director for future analysts The Futurum Group, and Arun Narayanan, Chief Digital Officer at renewable energy service providers RES, share how business leaders can ensure best bang for their new tech buck. Every enterprise is different Olivier says there's no one-size-fits-all approach to getting better tech returns. "A major mistake is picking tools because other companies are using them. A solution might be good for your problem but might not suit your company's technical capabilities and cultural processes." Instead, he suggests figuring out what you need the technology to achieve. "Understand your problems and look for the best solution to help them." Arun, who has overseen digital transformation in several big mining and oil and gas companies, echoes Olivier's belief in starting in the right place. "Don't rush around trying to work out what a technology can do for you. Instead, think about how you want to change your business. Do you want to delight customers in new ways? Make employees safer and more productive? Get better returns for investors? Imagine the business processes, then find the technology to make them work." He gives an example from sectors he's worked in – oil and gas, mining and renewable energy. "What they have in common is the work is in remote places. They now have remote operations centers giving information on screen to those who can do the work but can't spend days to weeks away." But the aim isn't to replace those working on-site. "Successful digital transformation will balance what's operationally correct at a site and what a remote center can know and understand. You can't take all control away from operations, nor can those making minute-to-minute decisions on site examine long-term trends and patterns." Evolution or revolution? Olivier thinks senior leadership can contribute to improved returns by appreciating the size of change possible. "If you want to become more competitive within your existing understanding of your company, then it's about finding problem areas to optimize." Arun suggests one place to start. "You're spending a lot of money on this, so find the waste. For example, if you don't know where the oil is and you're drilling in the wrong location. The business question is, how do we drill more in the right place?" The answer isn't always high-tech. "Once you understand the business question, you'll know what technology to find. If software from the 1990s can solve your problem beautifully, use that. Or if you find nothing available, technology like AI might solve it." Getting the people on side Failing to bring your people along on the tech journey can be expensive. Many fear technology will replace them, with Elon Musk saying there'll be no jobs for people in the future. How can leaders ensure people understand tech is there to help, not put them out of work? Arun says, "When calculators came out, they didn't replace accountants – but they let them do a better job, faster. Generative AI solutions like chatbots and document generators are tools – they aim to do the mundane piece fast, then the artistic, skillful and human piece can follow." Arun has had much experience getting people on board with tech integration in industrial settings. "Technology change will create many new jobs. The economic models will change, jobs will be created and lost." "We'll still need project managers, HR and people who can communicate. You don't need to be a technical expert to take part in the transformation." Olivier highlights that cost savings can flow from upskilling employees. "It's easier for someone to learn a new skill than learn everything about a company from scratch. Focusing on employee retention and development rather than letting workers fall by the wayside makes good financial sense." Cybersecurity education's role in new tech adoption Dr. Amin Hasbini, Head of Research Center Middle East, Turkey and Africa for Kaspersky Global Research and Analysis Team (GReAT,) thinks successful tech adoption means getting everyone up to speed on cybersecurity. But many companies aren't yet doing it. Amin says, "A recent Kaspersky and Longitude study found organizations that emphasize cybersecurity training have 25 percent more readiness for dealing with security incidents from employees." The most effective forms of cybersecurity education are generally immersive. Amin says, "Gaming and VR are great for security training because they allow better engagement and learning. Gamification and competition challenges improve managers and director safeguarding decisions." Some approaches are even more immersive. "The most successful involve simulating a real attack on the organization when only a few people in top management know it's a simulation. They test employee capacity and how well teams cooperate to contain and close down an incident." Training must go beyond the IT team. "Security everyone's job, from desk employees in a remote office to top managers. If everyone is aware, it stops incidents getting big." How much risk is right? Arun says businesses must accept that in making room for success, some initiatives will fail. "If you're reimagining with a bold vision, you're guessing about the future. Some guesses will come true – others won't. If your structure has no room for failure, you sell out the opportunity for innovation." He says one way is to make a few calculated smaller bets rather than one big bet. Even if some fail, it's better than not taking those risks. Olivier points to lower-risk ways to trial solutions. "You don't have to buy all your technology anymore. With cloud services and managed services, fantastic industry partners can help you test, implement or scale up new tech. There's a giant menu of opportunities to get expert help." With enterprises finding many tech investments don't pay off, there's much potential for competitive advantage in smarter exploration of new tech options. Business leaders may find more implementations succeed if they start with the right problems and upskill their people as part of the transformation.
insight story industrial iot a doctor makes an injection to a robot using a wire syringe connected to their smartphone

Industrial ‘Internet of Things:’ Is security too far down the production line?

  • min read
    • Imagine every part of the workplace – from manufacturing equipment to energy grids, healthcare devices to farms – had the connectivity of a smartphone. That's the Industrial Internet of Things (IIoT) – sometimes known as Industry 4.0. It brings a host of efficiencies, like real-time data-analysis and improved predictive maintenance. But with great connectivity comes great responsibility. IIoT can be especially vulnerable to attack. And while it's now widely used, many businesses know their IIoT systems are poorly protected. In the second episode of Insight Story season 2, guests Chris Kubeska, Netherlands-based security researcher, cyber warfare specialist and CEO of HypaSec, and Alison Peace, patient management operations manager for UK and Ireland at Medtronic, illuminate how industry can use and protect game-changing IIoT. Where is IIoT most commonly used? All sectors are using IIoT, but some more than others. Chris says, "The maritime industry uses IIoT a lot. It's also widely used in the space industry, medical devices and critical infrastructure." Medtronic is a global developer and producer of medical devices and therapies like insulin pumps, pacemakers and implantable defibrillators – all increasingly connected. Alison explains the patient benefits: "In the UK, more than 100,000 patients receive an implanted cardiac device each year. They then have constant hospital checks, which places a burden on healthcare services. Remote monitoring for cardiac devices started in basic form almost 20 years ago. Devices can now send wireless alerts if they detect a problem. Data shows patient outcomes are better – they don't go into hospital as much." Cybercriminals have noticed loosely protected IIoT Despite its relative newness, there have been many documented attacks on IIoT. In 2014 an attack on a German steel mill's IIoT systems killed three people and injured many more. The attacker gained access to the mill's office network then compromised its industrial control system. The compromise prevented a blast furnace shutting down, leading to an explosion. Even without a breach, users finding vulnerabilities in everyday tech means reputation-damaging headlines. At-home stationary fitness bike makers Peloton were embarrassed when a security researcher found their gear included an open channel that allowed access to users' private information like weight, gender and date of birth. Similarly, a hacker accessed footage from Verkada internet-connected security cameras. Securing industrial smarts Dr. Amin Hasbini, Head of Research Center Middle East, Turkey and Africa for Kaspersky's Global Research and Analysis Team (GReAT,) is concerned about the gap between businesses who use IIoT and those who fully secure it. "A recent Kaspersky study found over 60 percent of businesses use IoT. But close to half say these systems aren't fully protected. A third of these organizations blame lack of budget, but when it's not resources stopping them, what is it?" Whatever it is, senior leaders in organizations using IIoT must shift the barriers to best-practice security. Amin says, "Some technology vendors race to add features while largely ignoring security." "The challenge starts at the top in each organization. If security becomes a priority, it gets translated into policies, guidelines and methods." Chris advises thinking about how when security may not be front of mind in your organization's tech decision-making. "Your procurement department will be looking for the least expensive deal, but that deal might not include the best security." She continues, "Many IIoT systems come with older operating systems that don't have the security settings you'd want. And then, there may not be a secure way to update the software. These are some of the risks. Know what you're buying so you can plan ahead and mitigate those risks." Alison says medical devices are now made differently to ensure security. "It's important to incorporate an encryption module to make sure others can't read the device's data. Our devices don't connect to the internet, but use a pass-through to a monitor or app. Data is encrypted in the device and sent encrypted." Alison believes the high standards of institutions they work with helps give patients confidence in their devices. "In the UK and Ireland there are strict controls when health systems engage third parties. You must have rules, regulations and systems in place to work with hospitals." Chris also has recommendations for contracts with third parties. "For encryption, your contract should specify meeting the standards of the time. So when you renew, the expectation is to keep to those standards. Have a responsible disclosure policy, and ensure your suppliers have good data security and privacy policies." She says don't be shy to end a technology vendor relationship if security conversations feel awkward. "If you don't feel comfortable speaking about cybersecurity and privacy with your supplier, look for a new one. Look at suppliers who take part in security conferences. If they're actively looking at security, that gives credence." Is regulation keeping up with IIoT? Chris thinks business should expect regulation around IIoT to speed up. "The tech's definitely moving faster than law, but there are some guidelines and frameworks." Alison feels those designing IIoT must allow for changing security requirements – something Medtronic has strived for. "Our global security office is tasked with making sure our devices comply with standards worldwide. National legislation could say, we want the data from your device in this format, and our devices are designed to enable that." Simplifying a tangled net of things Chris thinks IIoT manufacturers could aspire to lead in many ways, but chiefly, making levels of security simple to understand. "Start applying what I call 'easy standards,' like a traffic light system, so consumers and companies can know if something has a minimum level of security – for example, can it be updated? Medical uses would need a higher standard compared with consumer home grade." Alison agrees that clear and standard practice matter. "A third party can easily comply with clearly communicated, standardized security requirements. Open communication and clear criteria are essential." IIoT is already commonplace and will only grow as those organizations yet to adopt see its potential to improve productivity and reduce costs. As technology becomes increasingly connected, securing IIoT is fundamental to the safety of just about everything in our lives. As Chris warns, "I want to retire knowing my own technology won't kill me." Leaders can keep their organization and customers safe by asking the right questions and pursuing IIoT vendors who prioritize security.
insight story, employer uses generative ai

How businesses can use generative AI to empower employees

  • min read
    • Headlines about the power of generative artificial intelligence (gen AI) are everywhere. But business leaders are asking, is it really that game-changing, or just a fad? And if it is a game-changer, how can you make the most of it? In the first episode of our second season of Kaspersky's podcast Insight Story, I speak with experts Shagun Sachdeva (India,) Project Manager for Disruptive Tech at business intelligence service GlobalData Plc and Karen Quinn (UK,) Senior Director, Brand and Corporate Communications at financial software providers, Finastra. What is generative AI? TechTarget defines gen AI as any "artificial intelligence technology that can produce various types of content, including text, imagery, audio and synthetic data." Some applications rely on Natural Language Processing so users can ask for outputs using everyday speech. Well-known examples of gen AI include OpenAI's chatbot ChatGPT and Google Bard, but current and potential business uses are near endless. Shagun thinks many businesses already understand its importance. "A recent GlobalData Plc survey found more than 50 percent of businesses expect gen AI will tangibly disrupt their industry in the next five years. 30 percent are already using gen AI tools." How are businesses using gen AI? "Business leaders are having more sophisticated conversations about how gen AI can go from an experiment to giving strong returns on investment," says Shagun. "Whether it's chatbots engaging with customers, sharing financial tips and customizing financial plans based on individual spending habits. It's also generating loan options based on a user's credit profile." Finastra plans to develop gen AI tools for customers in future, but they've started in-house with GENAI (X,) a gen AI-based system now rolled out to their 8,000 employees. "We use it for things like understanding and reviewing contracts, predicting behaviors and optimizing workflows," says Karen. She believes that although only being used internally so far, their gen AI tools are benefiting customers. "We can only work with the data we have to make financial decisions. Anything that can generate new scenarios, pull in more data sources or enable federated learning can only benefit." Is gen AI a threat to jobs? Shagun acknowledges employees worry AI might replace them. "Some of that anxiety may be justified – a Goldman Sachs report in March 2023 said AI could replace 300 million full-time jobs." But getting to know gen AI better may help overcome that concern. "Lean in to the technology. Education and training is key. Start with courses like prompt engineering." Karen refers to a quote from economist and professor Richard Baldwin, "AI won't take your job. It's somebody using AI that will take your job." In other words, it's not the technology itself that's a threat to jobs but failing to explore it and take full advantage of it. She advises looking at the benefits of gen AI broadly. "This is not an efficiency play. People will become more productive, but hopefully that means work is more rewarding." Getting gen AI right While generative AI offers much possibility, it also raises concerns around ethics, bias and data privacy. It is largely unregulated today and developing AI models can be resource-intensive. Karen highlights Finastra's caution. "We rigorously tested the products, then launched a full-scale training program and disabled other tools. They're still going through testing, like panels to try and break them and make sure no sensitive data gets shared with the wrong audiences." She continues, "In brand and communications, there are copyright issues. If you're using text-to-image prompts, where is it drawing data from? We need to be very careful." Materials used to train AI are often copyrighted, and whether people or businesses can copyright outputs of gen AI is subject to legal challenges in many countries, with some courts – including in the US and Italy – ruling no, at least in the case of visual arts. Balancing gen AI optimism with realism Shagun feels misinformation is the biggest business risk from gen AI. "It can fabricate 'facts' – what Google researchers call hallucinations." She also recommends businesses pay attention to copyright. "Disputes have arisen between artists and AI companies over the value of human creativity." Data privacy and security also rate highly for Shagun. "Large language models are trained on vast swathes of internet data. There's no data protection embedded in these systems by design or default. Training data can fail to include women, older people or marginalized groups – that's an ethical challenge." Security and generative AI Amin Hasbini is Kaspersky's Head of Research Center for its Global Research and Analysis Team (GReAT,) Middle East, Turkey and Africa. He says many employees are already using freely available AI tools, potentially without their employers knowing. "In a 2023 Kaspersky study, we found 57 percent of workers are using generative AI to save time. This raises many security questions. What kind of data are they putting into it? Is it intellectual property, code or documents to summarize? That's a major concern." Cybercriminals are also using generative AI to help them fool people with more realistic fake websites. In 2022, Kaspersky's anti-phishing system blocked more than 500 million attempts to access fraudulent websites – a doubling of attempts in the previous year. It's likely cybercriminals are already using generative AI chatbot ChatGPT's ability to produce convincing texts to create automated spearphishing attacks – phishing targeted at specific people. To protect against generative AI-based threats, Amin advises, "It starts with awareness. Employees need to know their organization's boundaries around putting data into AI websites. Businesses need enterprise cybersecurity solutions that allow monitoring and control of devices, systems and data used within the organization." Leading employee cybersecurity awareness approaches include implementing a cyber champions program or targeted education as used by Heathrow Airport. Gen AI's future potential What kinds of applications for gen AI will we see businesses pursuing in the near future? Shagun believes what businesses do today will decide the future of gen AI. "The world will look completely different by 2030. Global Data Plc estimates the AI market will be worth around 900 billion by 2030. But that doesn't mean carelessly diving in. "Gen AI is no magic bullet. While the enthusiasm around it is justified, prudence is imperative. We need responsible innovation," says Shagun. Karen imagines gen AI helping to make markets fairer. "Gen AI has incredible potential to overcome inefficiencies, like small-to-medium business (SMB) access to trade finance. Gen AI might be able to generate or automate some of the processes for onboarding smaller companies into global trade, opening them up to a wider audience." She also thinks gen AI could help solve some of the problems it's been known to introduce. "It can help identify bias through explainability and ensure we close feedback loops that cause biases. It could also look at efficiencies in supply chains, contracts and communications and marketing. It can take out some of the drudgery and enrich the processes." "We're on the cusp of understanding what gen AI can do," Karen says. "Who knows what the future brings? This could be game-changing in ways we can't even imagine." Like Karen and Shagun, as a creative marketer, I'm drawn between mostly optimism and a little fear about what gen AI will bring. As I wrote following a gen AI talk for marketers where I heard about Karen's exceptional AI program at Finastra, I'm optimistic we can do it right. Having the training, technologies and policies to bring the whole organization on the journey, we can use this tech to free us by shifting mundane tasks down to these somewhat smart bots. But in that shift, we may narrow opportunities – particularly for talent entering our industries – to refine their craft and learn the difference between average and distinctive output. Refined talent that generative AI lacks. For now, anyway.
by Innovating leaders.
Innovative tech.
About Secure Futures

Secure Futures magazine is your go-to business guide for opinions, trends and insight into the world of technology and cybersecurity. We help your business to bring on the future. Brought to you by Kaspersky, the global cybersecurity experts.

  • For all other countries