[Student IDEAS] by Hugo Jalet - Graduate of the Global BBA at ESSEC Business School
Artificial intelligence is fundamentally altering the statistical nature of cyber risk in finance, shifting it from an isolated, firm-specific operational threat into a correlated, fat-tailed financial variable. By moving attack vectors from network perimeters to training data and foundation models—and with high market concentration across a few cloud and AI providers—AI-driven threats introduce heavy-tailed loss severity, accelerated industry-wide propagation, and extended detection lags where malicious interventions hide as ordinary "model drift." Because existing financial pricing, capital buffers, and board governance remain calibrated to pre-AI historical data, institutions are running an unpriced tail risk that threatens equity financing, liquidity, and balance sheet stability; addressing this requires integrating cyber and AI governance, stress-testing for multi-day operational outages, and sizing capital against third-party concentration.
---
In early 2024, a finance employee at the British engineering firm Arup joined what looked like a routine video call with her chief financial officer (CFO) and several colleagues. By the end of it, she had authorised fifteen transfers totalling roughly $25 million to accounts in Hong Kong. Weeks later, the firm discovered that every participant on the call, CFO included, was a deepfake: a hyper-realistic fake video and voice, generated by artificial intelligence (AI), that impersonates a real person.1 The story made headlines for a few days, then faded. It should not have. By mid-2025, deepfake-enabled fraud alone had driven close to $900 million in reported losses globally, with more than $410 million concentrated in the first half of the year, already exceeding the total for all of 2024.2
The Arup incident is usually told as a story about weak verification protocols and the need for better employee training. That framing is not wrong, but it is far too narrow. Arup lost money on a single wire; the underlying phenomenon is something finance has not yet priced. Artificial intelligence is quietly reshaping what cyber risk looks like as a statistical object. Losses are becoming less idiosyncratic and more correlated, tails are fatter, detection is slower, and propagation across firms is faster, largely because banks, insurers, and asset managers increasingly share the same foundation models, training data, and cloud vendors.
This matters because finance has, for more than a decade, treated cyber as primarily an operational and compliance issue: a cost line, a maturity score, an audit-committee bullet. That mental model was already strained, and in an AI-driven system, it quietly breaks. Cyber resilience is no longer a sidebar; it is a financial variable whose distribution has shifted, and which neither markets nor most institutions have repriced. The practical question for boards, chief risk officers (CROs), and investors is therefore not "how much more should we spend on security?" but "how must we redesign governance, capital planning, and disclosure once the tail of cyber losses has moved?"
To see why the familiar playbook no longer fits, it is worth being precise about what is genuinely new.
The past decade of digital transformation in finance mostly expanded what cyber risk could affect: more systems online, more data in motion, more third parties in the chain. Artificial intelligence does something different. It shifts four properties of the loss distribution itself, and each of these shifts quietly erodes the "perimeter plus patch" mental model (the assumption that security means defending a network boundary with firewalls and access controls, then closing known software flaws with timely patches) that still governs most cyber budgets.
The attack surface moves from code and credentials to data and models. Classical cyber defence is organised around code, infrastructure, and identities: firewalls, segmentation, access controls, patch cycles. An AI system is a different object. It can be compromised by corrupting the training data itself, before a single credential is ever stolen. Yerlikaya and Bahtiyar (2022) show how quickly this matters. They study data poisoning, which means deliberately corrupting part of the training data, the data used to teach and build a model. Across four datasets (spam, botnet, malware, and medical diagnostics) and six standard algorithms, the researchers deliberately altered the correct classifications in a quarter of the training data (labelling spam as legitimate, for instance). This alone cut classification accuracy by 15 to 40 percentage points, and when half of the training data was corrupted, model performance collapsed in several configurations. Transposed to finance, this is a structurally new threat: a well-placed intervention in the training pipeline (the process that collects, prepares, and feeds data into a model while it is being built) of a credit-scoring model, a transaction-monitoring engine, or an algorithmic pricing system does not need to breach the firewall to cause losses.
These threats target two distinct stages in the life of an AI system. At training time, while the model is being built, data poisoning and training-set contamination corrupt what it learns. At inference time, when the trained model is being used to make real decisions, attackers exploit it through prompt injection (hiding malicious instructions in the text or data the model reads) and model manipulation (feeding it carefully crafted inputs, or tampering with the model itself, so that it produces the outputs the attacker wants). Both bypass the controls built for the old perimeter: neither needs to breach a firewall or steal a credential, because the vulnerability lives in the data and the model itself, not at the network boundary. They now sit beside ransomware and phishing on the threat list.
Detection lag lengthens because model failure looks like drift. Traditional cyber incidents are largely binary. A system is down, an account is drained, a file is encrypted. AI failures are probabilistic. A poisoned fraud model does not stop working; it simply scores certain transactions a little more leniently. A manipulated credit model does not crash; it tilts approvals in a subtle direction. These incidents are easily reinterpreted as "model drift", an accepted, almost decorative feature of machine-learning (ML) models in production. The result is that the time between occurrence, discovery, and recognition stretches. Even without AI, the problem is already acute: using cross-country operational-loss data from seventy banks over sixteen years, Aldasoro et al. (2023) document an average lag of more than a year between when an operational loss occurs and when it is finally booked (formally recorded as a loss in the accounts), with a long-tailed distribution in which a meaningful share of events remain unaccounted for after two years. Layer on the probabilistic opacity of AI systems and one should expect that distribution to stretch further, not tighten. For capital and liquidity planning, the implication is unpleasant: by the time a model-level compromise is formally recognised, much of its damage may already have been absorbed into the balance sheet.

Timeline of an operational loss event. Source: Aldasoro et al. (2023). Three dates structure every loss event: occurrence, discovery, and recognition. AI-driven incidents stretch t₁ (occurrence → discovery) because probabilistic failures resemble model drift.
Propagation accelerates through shared models, shared data, and concentrated cloud providers. The novelty is blunt: banks, insurers, and asset managers no longer need to do business with each other to share cyber exposure; they only need to rely on the same foundation model, the same training corpus, or the same hyperscale cloud provider, so a single compromise can reach firms with no direct contractual link. This is a different transmission channel from the one finance is used to.
In the pre-AI cyber world, contagion travelled mainly through explicit economic linkages: interbank exposures, counterparty relationships, payment networks. The pre-mortem analysis of Fedwire by Eisenbach, Kovner and Lee (2022) already showed how powerful that channel alone could be. The impairment of any one of the five largest U.S. banks spills over to an average of 38% of the network. A shock concentrated on a single third-party service provider common to several large institutions does even more damage: it pushes the weighted share of impaired institutions to roughly 60%, with potential forgone payment activity reaching more than 2.5 times daily gross domestic product (GDP) once banks start hoarding liquidity.
That shared layer is no longer hypothetical. In the 2024 survey by the Bank of England and the Financial Conduct Authority (FCA), 75% of UK financial firms reported already using AI, up from 58% two years earlier, though adoption remains uneven: many firms are still standing up data pipelines or running a general-purpose chat assistant for back-office work, while a smaller set already embeds foundation models directly into credit, fraud, and trading decisions. Foundation models account for 17% of all use cases, and a third of use cases now run on third-party implementations (Bank of England and FCA, 2024).
That third-party supply is strikingly concentrated: the three most-cited providers account for 73% of all named cloud providers, 44% of model providers, and 33% of data providers. Concentration on that scale means many institutions are exposed, without any direct link to one another, to the same handful of upstream failures, which is why the same survey ranks cybersecurity as the highest perceived systemic risk and critical third-party dependencies as the fastest-growing one. This is precisely the concern the EU's Digital Operational Resilience Act (DORA) attempts to address through its oversight regime for "critical" third-party information and communication technology (ICT) providers, which formally recognises for the first time that cloud and model concentration is a systemic variable, not a purely commercial one (Kun, 2024).

The figure shows the distribution of the network impact for the scenario with a disruption originating from a third-party service provider. “Share” represents the unweighted percent of institutions that become impaired. “Weighted share” represents the percent of institutions that become impaired, weighted by asset size. “Net weighted share” refers to the percent of institutions that become impaired, net of the shocked institutions.
Loss tails fatten because one compromise now hits many pipelines at once. The combination of the first three shifts has a direct statistical consequence: the severity distribution of cyber losses becomes heavier in the right tail. If a single poisoned dataset or compromised model feeds credit decisioning, fraud scoring, and trading signals across multiple institutions, a single event generates correlated losses across several profit-and-loss (P&L) lines and several firms simultaneously. Aldasoro et al. (2023) already find that although cyber events are still rare relative to other operational losses, cyber risk can account for up to a third of a bank's total operational value-at-risk, with most of that contribution concentrated in the tail. A 2025 panel of chief information security officers (CISOs) and board directors convened by McKinsey and the National Association of Corporate Directors (NACD) captures the shift in blunt terms, with one participant noting that under AI-fuelled threats, the "variability and severity are so drastic" that traditional maturity scores carry little signal (McKinsey & Company, 2025).
Taken together, these four shifts describe a cyber risk that is less idiosyncratic, less binary, more correlated across firms, and slower to surface than the one the industry has built tools for. The governance model inherited from the last decade (a CISO who patches systems, an audit committee that tracks maturity scores, and an insurer who prices firm-level history) was not designed for this object. The question is what happens once this new distribution is properly recognised, first in prices and capital, then in governance and disclosure.
A shift in the cyber loss distribution only matters financially to the extent that it travels into the numbers that boards, creditors, and markets actually look at. And on current evidence, much of that journey has not yet happened.
Inside the firm. The most visible channel is the earnings hit. Operational losses from remediation, incident response, customer notification, legal fees, and regulatory fines feed directly into quarterly results. Using a cross-country panel of roughly seventy large banks over sixteen years, Aldasoro et al. (2023) estimate that operational risk capital varies between 1% and 7.5% of gross income depending on the calibration method used, and that cyber-specific capital can account for up to a third of that total. Franco et al. (2024) argue that even those figures underestimate firm-level exposure for the median institution because they remain rooted in probability-based simulations rather than observed real-world loss data; their Real Cyber Value at Risk (RCVaR) framework is designed precisely to close that gap by estimating costs directly from industry incident reports.
A second channel is the balance sheet. Remediation spending, accelerated information-technology investments, and litigation reserves erode capital buffers over the quarters that follow an incident, which changes how firms finance themselves. Liu, Luo & Yawson (2025), using a U.S. sample running from 2005 to 2019, find that attacked firms become 56% to 61% less likely than matched non-attacked firms to undertake a seasoned equity offering (SEO), that is, a new share issue by an already-listed company, over the three years after the attack, with SEO proceeds dropping in parallel. The mechanism they document is not a shortage of capital need but an excess of capital cost: reputation loss raises the adverse-selection premium that equity investors demand, and firms rationally shrink their equity issuance. The effect also spills over to industry peers who were not themselves attacked, whose SEO probability falls by roughly 18% to 20% of its baseline and whose SEO proceeds decline by about 13.5%, suggesting that markets treat a single cyber event as information about a sector's underlying cyber risk, not just about the target firm.
The third and most underappreciated channel is liquidity. Eisenbach, Kovner & Lee (2022) show that a successful cyber attack on any one of the top-5 U.S. wholesale payment banks impairs on average 38% of the network, and that once uninfected banks begin hoarding liquidity defensively, forgone payment activity can reach more than 2.5 times daily GDP within a few days. This matters particularly in AI-driven finance because authentication, payments, trade settlement and fraud routing all increasingly depend on ML-based systems. A model-level compromise does not only hit the targeted firm's P&L; it can disable a counterparty's ability to send or receive, which is a classical liquidity event wearing an AI costume. What looks operational becomes financial the moment confidence in settlement is shaken.

The figure shows the distribution of aggregate liquidity shortfall resulting from an attack that lasts from 1 to 5 days, averaged across the top-5 scenarios.
In markets. Do equity and credit markets price any of this? Partially. The existence of a cyber risk premium is by now empirically documented: firms with higher cyber exposure trade at a discount and face measurably higher costs of external financing after incidents (Jiang et al., 2024; Liu, Luo & Yawson, 2025). But the size of that premium is calibrated to the pre-AI tail. It reflects the historical distribution of cyber events as rare, largely firm-specific, and usually reversed within a few quarters. It does not yet reflect the four shifts described above: correlated incidents across firms that share a foundation model or a cloud region, slow-maturing damage from poisoned training sets, and losses that simultaneously hit credit decisioning, fraud scoring, and trading signals. The useful question is therefore not "is cyber risk priced?", but "is the post-AI tail priced?". On current evidence the answer is largely no.
Why not? Four structural frictions keep the post-AI tail out of prices.
Opacity. Cyber events are systematically under-reported. Aldasoro et al. (2023) document an average lag of more than a year between the occurrence of an operational loss and its recognition on the balance sheet, with a meaningful share of events still unaccounted for after two years. Markets cannot price what they cannot see, and as long as AI-related incidents hide inside "model drift" or "performance degradation", the signal does not reach them.
Externalities. Vendor and model concentration is a public bad. An institution that chooses a hyperscale cloud provider or a dominant foundation model captures private benefits (cost, performance, speed) but imposes a systemic risk that its own funding spread does not internalize. Kun (2024) argues that this is exactly the gap DORA's oversight regime for critical ICT providers was introduced to fill: firm-level risk management cannot price a shared-infrastructure externality, which is why a public authority has to look at concentration directly.
Rare-event neglect. Fat-tailed distributions are hard to estimate from short histories, especially when the underlying generating process has recently changed. The pre-AI cyber loss series is neither long enough nor stationary enough to calibrate a post-AI tail, and market participants (like most people) tend to under-weight tail risks they have not personally lived through.
Correlation blindness. Markets price firms, not shared-infrastructure clusters. There is no traded instrument whose payoff depends on whether ten banks share the same credit-scoring model, the same transaction-monitoring vendor, or the same cloud region. Until such an instrument exists, or until supervisors require concentration disclosure, correlated tail risk remains diversified on paper but concentrated in reality, which is the worst of both worlds for holders of the equity and debt of such firms.
The cumulative effect of these four frictions is that funding spreads, valuation multiples, and cyber insurance pricing continue to reflect a distribution that has already moved. Institutions whose capital planning, liquidity stress tests, and board-level risk dashboards rest on those same prices are therefore running a hidden short position on the post-AI tail. The rest of the article asks what changes (in governance, in disclosure, and in the practical work of CROs, CFOs, boards, and investors) once that short position is properly acknowledged.
If the post-AI tail is not yet in prices, the governance question is where the adjustment should come from. No single actor can close the gap: CROs and CFOs need to rebuild the quantitative plumbing, boards need to govern AI and cyber as one integrated risk, and investors and supervisors need to replace narrative assurance with credible tests. Institutions that move first stand to gain more than safety: the evidence discussed above suggests they may also fund themselves more cheaply and earn greater counterparty trust.
For CROs and CFOs: rebuild the quantitative plumbing. Three moves matter. First, model cyber losses at the tail, not at the mean. Franco et al. (2024) argue explicitly that most existing cyber capital models remain rooted in probability-based simulations calibrated on thin historical samples, exactly the wrong posture when the generating process has changed; their RCVaR framework estimates costs from observed industry data and makes the gap between expected loss and the 95th percentile explicit. Aldasoro et al. (2023) provide an independent benchmark: operational risk capital varies between 1% and 7.5% of gross income depending on calibration, with cyber-specific capital reaching a third of that. A capital plan sitting near the lower bound of those ranges is making an implicit bet that the post-AI tail will look like the pre-AI one.
Second, add authentication and payment outages to liquidity stress tests. Eisenbach, Kovner and Lee (2022) show that a five-day payment impairment at one of the five largest U.S. banks produces aggregate system liquidity shortfalls rising from roughly $122 billion on day one to around $1 trillion by day five, and that at the individual-bank level the 95th-percentile shortfall can reach 5% of risk-weighted assets or 37% of tier-1 capital.

Distribution of liquidity shortfall across impaired banks, relative to risk-weighted assets (left) and tier-1 capital (right). Source: Eisenbach, Kovner & Lee (2022). The tail is long: at the 95th percentile, shortfalls reach roughly 5% of risk-weighted assets and 37% of tier-1 capital. Capital buffers calibrated to the mean of this distribution leave the firm materially exposed to the tail.
Most internal liquidity frameworks still do not include a scenario in which the firm's ability to authenticate customers or send payments is disabled for several business days. Adding such scenarios, and sizing contingent buffers accordingly, is the single most concrete change a CFO can make.
Third, calibrate capital buffers to vendor concentration, not only firm-level history. The Bank of England's 2020 survey, cited by Kun (2024), finds that over 70% of U.K. banks and 80% of insurers use only two cloud providers for infrastructure services. Eisenbach et al. (2022) quantify the systemic side: a shock to a third-party service provider common to several large institutions impairs roughly 60% of the network by assets. CROs therefore need a vendor-concentration metric that feeds directly into capital buffer sizing, alongside a single risk register integrating model, data, and infrastructure exposures.
What makes such a test different from current ones is the unit of analysis. A conventional stress test breaches one firm at a time; a vendor-concentration test shocks the shared provider, not the firm, and asks how much of the book fails with it. In practice, it maps each critical AI dependency (foundation model, cloud region, data vendor) to the lines of business that rely on it, and identifies where the same provider silently underpins supposedly independent functions such as credit scoring, fraud detection, and trading. It then measures the correlated loss when that one provider goes down, and sets it against how many direct competitors share the same dependency. Given that three providers already account for the bulk of cloud and model relationships, those overlaps are the rule, not the exception.
For boards: govern AI and cyber as one integrated risk. The McKinsey and NACD (2025) panel of CISOs and directors is blunt that "the era when cybersecurity was a separate, isolated function at organizations is over" and that AI-fuelled threats require what one panellist calls "air-to-ground coverage" across the institution. In practice, this means moving cyber out of the audit-committee sidebar into a standalone risk or technology committee with genuine technical fluency, and changing the metrics boards track. Generic maturity scores were designed for a world where cyber was firm-specific and procedural; they do not capture the post-AI tail. The metrics that do are operational: credible recovery time objectives for AI-dependent services under adversarial conditions, vendor and model-concentration exposure, and the credibility of the firm's scenario library. Concretely, a post-AI tail metric is not a maturity score but a small set of tail-sensitive quantities tracked over time: a concentration ratio (the share of AI-dependent critical services running on the firm's single largest external model, cloud, or data provider, and how that compares with peers); an independently tested recovery-time objective for each AI-dependent service under adversarial, not benign, failure; and a tail gap, the distance between the firm's modelled expected cyber loss and its 95th-percentile loss, with capital sized to the latter. Each of these moves with the actual loss distribution; a maturity score does not. As Marco Maiurano of First Citizens Bank puts it in the panel, the variability and severity are now so drastic that single-point maturity scores carry little signal.
For investors and supervisors: replace narrative assurance with concrete tests. Investors should make vendor and model concentration a standard due-diligence item: which foundation models, cloud regions, and third-party data vendors does the firm depend on, and how many of its direct competitors share those dependencies? This is more than a checklist item: it is one of the few mechanisms through which correlated tail risk can become visible in prices at all. No single firm's disclosure can reveal that ten competitors depend on the same model or cloud region; only a party comparing across firms can see it. Concentration is therefore a classic collective-action problem that markets cannot solve unaided, which is the substantive case for supervisory concentration testing rather than another maturity questionnaire. Kun (2024) argues this is precisely the gap DORA's oversight regime for critical ICT third-party providers was designed to fill at the supervisory level. Supervisors, for their part, should test recovery credibly rather than accept qualitative reporting: Aldasoro et al. (2023) find that better supervisory quality is empirically associated with roughly 11% faster recognition of operational losses. Applied to AI-driven finance, this argues for system-wide cyber stress exercises and independent audits of recovery time objectives rather than another layer of disclosure.
Once the tail has shifted, continuing to govern cyber risk with pre-AI tools is itself a strategic choice. It shows up first in the cost of capital: Liu, Luo and Yawson (2025) document that attacked firms and their peers face measurably higher equity financing costs after incidents, and Jiang et al. (2024) show that firms with higher cyber risk exposure pay a persistent premium. As markets learn to price the post-AI tail, those premia may widen for institutions that cannot credibly demonstrate tail-sensitive governance. It shows up next in counterparty trust: firms that cannot show credible recovery metrics are likely to be dealt with on less favourable terms long before they are breached.
The competitive frontier in AI-driven finance is not "best security" in the traditional sense. It is lowest uncertainty around service continuity under fat-tailed, correlated disruption. On a calm day, that looks like a cost line. On a bad day, it looks like the only institutions still open for business.
The Arup deepfake was told as a fraud story. It was really a preview. The same mechanism, scaled up, reaches training pipelines, credit models, authentication layers, and cloud regions shared across the industry. Cyber risk in AI-driven finance is no longer a compliance sidebar. It is a tail-sensitive, liquidity-relevant, correlation-heavy financial variable whose distribution has moved, and whose new shape is not yet in prices, capital, or boardroom dashboards.
None of this requires waiting for the next major incident. The data already exist. The shift is documented, the propagation channels are mapped, the pricing gap is measurable, and the regulatory direction of travel, from DORA onward, is set. What is missing is the governance layer that turns those inputs into capital plans, stress tests, and disclosures calibrated to the post-AI tail rather than the pre-AI one.
That gap is not neutral to wait on. Repricing the post-AI tail is likely to be a source of advantage, and one that compounds over time. The evidence does not yet prove this directly, but it points in that direction. If markets already charge a premium for observable cyber exposure (Jiang et al., 2024; Liu, Luo and Yawson, 2025), an institution that quantifies its cyber-and-AI tail, sizes capital and liquidity to it, and can disclose it credibly should be well placed to fund itself more cheaply and to be dealt with on better terms, with savings that would accrue quarter after quarter. An institution that does not is not standing still; it is quietly accumulating an invisible liability, a hidden short position on the post-AI tail whose premium it collects in good quarters and whose true size it discovers only when the distribution moves against it. The longer the two paths run, the wider the distance between them. The hidden variable is unlikely to stay hidden forever, and when it surfaces, the firms that priced it early may well find themselves years ahead.
[1] CNN. (2024, February). Finance worker pays out $25 million after video call with deepfake ‘chief financial officer’. CNN.
[2] Surfshark Research. (2025, July). Deepfake fraud losses near $900 million by mid-2025. Surfshark, using data from the AI Incident Database and Resemble.AI.
[3] Eisenbach, T. M., Kovner, A., & Lee, M. J. (2022). Cyber risk and the U.S. financial system: A pre-mortem analysis. Journal of Financial Economics, 145(3), 802–826.
[4] Franco, M. F., Künzler, F., von der Assen, J., Feng, C., & Stiller, B. (2024). RCVaR: An economic approach to estimate cyberattacks costs using data from industry reports. Computers & Security, 139, 103737.
[5] Jiang, H., Khanna, N., Yang, Q., & Zhou, J. (2024). The Cyber Risk Premium. Management Science, 70(12), 8791–8817.
[6] Kun, E. (2024). Challenges in regulating cloud service providers in EU financial regulation: From operational to systemic risks, and examining challenges of the new oversight regime for critical cloud service providers under the Digital Operational Resilience Act. Computer Law & Security Review, 52, 105931.
[7] Liu, X., Luo, J., & Yawson, A. (2025). Equity offering following cyberattacks. Journal of Corporate Finance, 91, 102710.
[8] Yerlikaya, F. A., & Bahtiyar, Ş. (2022). Data poisoning attacks against machine learning algorithms. Expert Systems with Applications, 208, 118101.
[9] McKinsey & Company, Risk & Resilience Practice. (2025, August). Competitive advantage through cybersecurity: A board-level perspective.
[10] Bailey, T., Del Miglio, A., & Richter, W. (2014, May). The rising strategic risks of cyberattacks. McKinsey & Company.
[11] Aldasoro, I., Gambacorta, L., Giudici, P., & Leach, T. (2023). Operational and Cyber Risks in the Financial Sector. International Journal of Central Banking, 19(5), 341–402.
[12] Bank of England & Financial Conduct Authority. (2024, November). Artificial intelligence in UK financial services - 2024. Bank of England.
[Student IDEAS] by Chirag Patel - MSc in Hospitality Management (IMHI) at ESSEC Business School
Digital transformation in hospitality is rapidly shifting from operational efficiency to experience design. While the industry has traditionally viewed technology as a means to automate processes or cut costs, upscale and lifestyle hotels are pioneering a new paradigm: using digital touchpoints to orchestrate emotional flows across the guest journey. Focusing on three critical phases—booking, arrival, and in-stay—this article explores how thoughtful digital integration eliminates friction, empowers autonomy, and turns routine service moments into lasting brand value. Through real-world case studies including CitizenM, The Hoxton, and Mama Shelter, we examine how technology can complement rather than replace human care, transforming digital touchpoints into the primary sites of modern hospitality.
---
The hospitality industry is undergoing a structural transformation driven by the rapid integration of digital technologies across the guest journey. Travellers today are getting influenced by content on social platforms to choose the destinations and hotels they want to visit. 94% of industry executives have cited mobile traffic as the most important acquisition channel1, signalling that the guest journey increasingly begins within algorithm-driven and mobile-first digital ecosystems rather than through traditional hotel discovery pathways. However, digital discovery does not erase the inherent value of physical location. Prime locations, exceptional views, and transport connectivity remain enduring sources of competitive advantage, which technology can amplify. Over the past decade, the proliferation of mobile applications, contactless interfaces, messaging platforms, and data-driven personalisation tools has fundamentally reshaped how guests interact with hotel brands. What was once a predominantly physical and human-led service environment is now increasingly mediated through digital touchpoints that influence perception, decision-making, and experience even before a guest sets foot on property. Industry reports highlight this shift clearly. Digital maturity in hospitality is no longer a differentiator but a baseline expectation, particularly among younger and more design-conscious travellers.
Despite this evolution, much of the industry continues to frame technology primarily as an operational tool aimed at productivity gains, cost reduction, or labour replacement. This perspective often overlooks the experiential dimension of digital interactions and reinforces a mutually exclusive narrative between high-tech and high-touch service. As of 2025, only 3% of customer data is fully integrated2, highlighting a major contradiction within hospitality digitalisation: while hotels increasingly interact with guests across multiple digital touchpoints, most still lack the unified data ecosystems required to create genuinely coherent personalised journeys. However, emerging evidence suggests that digital interfaces can play a far more nuanced role by shaping emotional states, reducing friction, and enabling a sense of control and reassurance throughout the guest journey. This calls for a reframing of digital tools not as peripheral systems, but as central components of experience design.
To understand this shift, it is useful to introduce the concept of critical moments within the guest journey3. These are specific phases where guest expectations are heightened and emotional responses are particularly sensitive to service design. This article focuses on three such moments: booking, arrival, and in-stay4. Unlike routine service interactions, critical moments disproportionately shape how guests remember and evaluate an entire stay. These moments often involve emotional vulnerability, uncertainty, anticipation, or heightened expectations, making them particularly influential in forming brand perception and emotional attachment. Predominantly, the booking phase is characterised by anticipation, trust formation, and a need for reassurance. Guests evaluate not only price and product but also credibility, clarity, and convenience. The arrival moment introduces a different emotional dynamic, often involving uncertainty, fatigue, and a desire for orientation and recognition. The in-stay phase shifts towards comfort, autonomy, and responsiveness, where guests seek both control over their experience and timely support when needed. Across these moments, the design of digital touchpoints can either ease or amplify friction, directly influencing guests’ experience. Today, we have the advantage of pre-determining the emotional responses in each phase.
This article argues that upscale and lifestyle hotels are moving from managing operational touchpoints to orchestrating emotional flows across the guest journey, where digital interactions increasingly function as invisible yet primary sites of hospitality. Unlike luxury hotels, where human interaction remains the dominant signal of service quality, or midscale properties where efficiency often takes precedence, upscale and lifestyle hotels operate within a hybrid expectation space. Guests in this segment value aesthetic elements, speed, and autonomy alongside true engagement. As a result, digital interfaces are not just supportive tools but integral elements of brand positioning and guest experience.
Traditionally, digital technologies are viewed as operational facilitators in the hospitality industry. Much of the prevailing research continues to frame technology as a set of tools deployed to improve operational efficiency, reduce labour dependency, or automate repetitive processes. While these outcomes are important, this narrow framing underestimates the broader transformation underway and obscures the role of digital systems as active shapers of the guest experience. Technology, in its fuller sense, is not merely a collection of tools but a combination of systems, processes, and organisational practices that evolve together. The industry also tends to approach digital transformation as a linear enhancement of existing processes rather than a reconfiguration of the guest journey. For example, mobile check-in is often implemented as a digital replication of the front desk, rather than an opportunity to rethink the arrival experience entirely. This reflects a broader pattern where technology is layered onto existing service models instead of being used to redesign them.
The emergence of agentic AI, systems capable of autonomously making recommendations, comparisons, and travel decisions on behalf of users, signals a structural shift in how guests discover and interact with hospitality brands. Rather than travellers actively browsing hotel websites or online travel agencies, AI-driven assistants may increasingly curate options, personalise itineraries, and even make booking decisions based on behavioural preferences and contextual data. This changes the role of digital touchpoints fundamentally. Hotels are no longer designing only for direct human interaction, but also for algorithmic visibility and machine-readable experiences. In this context, digital touchpoints become critical not only for guest engagement, but also for how brands are interpreted, prioritised, and recommended within emerging AI-driven travel ecosystems.
Interactions during a hotel stay are not experienced as a continuous flow, but as a series of emotional spikes and transitions, starting from booking till post-stay. It is within these fragmented moments that perception is formed, expectations are tested, and brand meaning is embraced.
The booking stage is primarily defined by anticipation, reassurance, and trust formation. At this point, the guest has not yet experienced the physical product and relies entirely on mediated representations of the brand through websites, platforms, reviews, and content. The emotional state is forward-looking but fragile. Guests seek clarity, credibility, and confidence in their decision. Any friction in navigation, ambiguity in information, or inconsistency in messaging can introduce doubt and increase the likelihood of abandonment. Conversely, a well-designed booking experience can heighten anticipation and establish an early emotional connection with the brand.
The arrival moment marks a transition from expectation to reality and is often characterised by anxiety, fatigue, and a need for orientation. Guests may be navigating an unfamiliar environment, managing time pressure, or arriving after long journeys. At this stage, the desire for recognition and ease becomes central. The guest is subconsciously assessing whether the hotel understands their needs and whether the experience aligns with prior expectations. Small frictions such as waiting time, unclear processes, or lack of guidance can disproportionately impact perception. Equally, moments of smooth transition, intuitive navigation, and personalised acknowledgement can create immediate reassurance and a sense of belonging.
The in-stay phase shifts towards comfort, autonomy, and responsiveness. Once settled, guests seek to exercise control over their environment while expecting seamless access to services. The emotional expectation evolves from reassurance to empowerment. Guests want to personalise their experience, make requests effortlessly, and receive timely responses without unnecessary effort. Interruptions, delays, or rigid service structures can disrupt this sense of comfort, while intuitive systems and responsive service enhance perceived quality and satisfaction.
In upscale and lifestyle segments, where differentiation is often subtle and brand identity plays a central role, the design of these moments becomes a strategic lever for positioning and loyalty creation. What differentiates upscale and lifestyle hotels is not the presence of technology, but how intentionally it is used to choreograph emotion, identity, and control across the journey. In these segments, technology must move beyond convenience to become a subtle curator of experience.
For guests booking a lifestyle hotel, it is less about selecting a room and more about expressing a travel identity. Guests are not simply comparing price points but aligning themselves with a brand’s aesthetic, social energy, and cultural positioning. Technology, therefore, can move beyond filters and sorting logic to enable more interpretive and immersive pathways.
Instead of asking “What room do you want?”, digital interfaces can explore “What kind of stay are you seeking?” by translating intent into curated options. This could include mood-led journeys, socially driven recommendations, or even time-sensitive narratives that reflect what is happening in and around the hotel. In doing so, technology reduces the cognitive burden of choice while strengthening emotional alignment with the brand.
More uniquely, booking can become socially embedded. Integrations with social media platforms and review ecosystems can allow guests to see how others experience the property in real time, making the decision feel less isolated and more participative.
Arrival is often treated as a logistical checkpoint, yet in reality it is the first physical validation of the brand promise. In upscale and lifestyle hotels, where design and atmosphere are central, technology can be used to choreograph this transition rather than manage it.
Instead of focusing on speed alone, technology can shape the rhythm of arrival. For example, staggered digital arrivals, pre-configured room readiness, or adaptive queuing systems can eliminate the sense of crowding or waiting without removing human presence.
A more distinctive approach lies in “soft recognition” where guests feel acknowledged without explicit formalities. Subtle cues such as personalised in-room readiness, curated welcome content, or context-aware notifications can replace traditional check-in rituals. The role of staff then shifts from gatekeepers of process to enhancers of experience, engaging where it adds emotional value rather than operational necessity. Yet the pursuit of frictionless arrival also has its limits, as technologies such as facial recognition raise questions around privacy, consent, and regulatory acceptance.
During the stay, the expectation in this segment is not constant service, but the ability to shape one’s own experience fluidly. Technology can enable this by acting as an underlying layer that adjusts to guest behaviour rather than requiring active management.
Rather than offering a menu of services, digital systems can modulate the experience in real time. This could include dynamically adjusting recommendations based on time of day, guest movement, or past interactions, or enabling seamless transitions between work, leisure, and social engagement within the same space.
Importantly, technology can also redefine responsiveness. Instead of guests needing to initiate requests, systems can anticipate moments where intervention may be needed, while still preserving a sense of control. In lifestyle hotels especially, where guests value independence, this balance between anticipation and non-intrusion becomes critical.
The ongoing debate in hospitality has often centred on how much technology should be integrated into the guest experience, positioning digital and human interaction as competing forces. Technology, when applied thoughtfully, can play a pivotal role in shaping the critical moments by complementing rather than replacing human interaction. Taken together, the strategic integration of digital and human touchpoints across these critical moments allows hotels to move beyond the traditional high-tech versus high-touch dichotomy.
The critical question is not the quantity of technology deployed, but the precision with which it is applied across the guest journey. Technology becomes a means of enhancing emotional experience, reducing friction, and enabling a more coherent and responsive guest journey. In the upscale and lifestyle hotels, this often means making technology less visible, more contextual, and deeply aligned with the brand’s identity and rhythm. This often translates into highly specific, context-driven applications. For instance, instead of generic pre-arrival emails, guests may receive dynamically curated city guides aligned with their travel intent or previous behaviour, creating a sense of relevance before arrival. During arrival, rather than a standard digital check-in, room readiness notifications paired with personalised pathways, such as directing a guest straight to a rooftop bar or lounge before accessing their room, can reshape first impressions.
Today, guests do not experience hotel technology in isolation, but in comparison to the digital ecosystems they engage with daily, from streaming platforms to ride-hailing apps and social media. As a result, hospitality brands must redesign the guest journey not as a series of one-way digital offerings, but as an extension of these existing habits and expectations. The opportunity lies in embedding technology into natural guest behaviours rather than asking guests to adapt to new systems. This also brings renewed relevance to previously overlooked or “dead” touchpoints. Elements such as Wi-Fi login pages, in-room TVs, QR codes, digital signage, or even elevator screens can evolve into meaningful micro-moments of engagement, whether through personalised recommendations, contextual storytelling, or real-time service access. In this approach, value is in embedding technology where it naturally enhances flow, relevance, and discovery.
In upscale and lifestyle contexts, guests do not necessarily perceive digital convenience and emotional care as contradictory. A seamless arrival, intuitive recommendation, or context-aware interaction can generate feelings of attentiveness and comfort traditionally associated with human service. The question therefore is no longer whether technology reduces hospitality, but whether digital experiences themselves can become a new expression of hospitality.
CitizenM has positioned digital interaction at the centre of its guest journey by designing around speed, autonomy, and minimal friction. Self check-in kiosks replace the traditional reception-heavy arrival process, while guests can control room features such as lighting, blinds, and entertainment through integrated digital systems. Rather than using technology as an add-on, CitizenM redesigns the experience around independent travellers who value efficiency and flexibility. The result is a hospitality model where technology supports comfort and control without removing the social energy of shared spaces.
The Hoxton adopts a more understated approach to digital hospitality by using technology to facilitate local immersion and convenience rather than overt automation. They enhanced the pre-arrival touchpoint by including curated neighbourhood recommendations and culturally relevant content that extends the experience beyond the hotel itself. Messaging platforms and seamless booking interfaces reduce formality while maintaining responsiveness. In this model, technology quietly supports the brand’s emphasis on locality, creativity, and informal hospitality without becoming the focal point of the experience.
Mama Shelter blends digital interaction with a socially vibrant and informal hospitality model. Guests interact with playlists, live events, nightlife programming, and food experiences through social media and mobile-first communication before and during the stay. Technology supports the brand’s community-oriented positioning rather than acting purely as a service utility.
Ace Hotel differentiates itself by integrating cultural programming directly into the digital discovery and booking journey. Guests often engage first with playlists, events, artist collaborations, or community content before interacting with the room product itself. In this case, booking becomes linked to participation in a cultural ecosystem rather than simply purchasing accommodation.
As this article has demonstrated, the most meaningful opportunities for digital transformation in upscale and lifestyle hotels lie not in maximising automation, but in intentionally redesigning critical moments where emotions, expectations, and perceptions are most heightened. Booking, arrival, and in-stay interactions each carry distinct emotional dynamics, requiring different balances of convenience, reassurance, autonomy, and human connection.
In upscale and lifestyle segments especially, where guests increasingly seek fluidity, individuality, and culturally relevant experiences, technology becomes most valuable when it is embedded subtly into the rhythm of the stay. Whether through personalised discovery pathways, frictionless arrivals, or context-aware in-stay interactions, the role of technology is shifting from visible functionality towards invisible orchestration. In doing so, hospitality is gradually moving from a model built around fixed physical touchpoints towards one shaped by dynamic and digitally mediated interactions. Simultaneously, entirely new touchpoints are emerging through Wi-Fi portals, messaging interfaces, algorithmic recommendations, social media engagement, and app-based interactions that previously held little relevance within the guest journey.
Beyond guest satisfaction, the quality of the digital journey can also influence the economic performance of the hotel. By reducing booking friction, strengthening direct relationships and encouraging repeat behaviour, well-designed digital touchpoints can contribute to customer lifetime value, Average Daily Rates (ADR) and, ultimately, the Net Operating Income (NOI) of the hotel asset. This positions digital guest journey design not only as a service, marketing or technology decision, but as a broader commercial and asset-management consideration.
As guest behaviour becomes increasingly shaped by mobile ecosystems, algorithmic discovery, and digitally conditioned expectations, hotels may need to rethink not only service delivery but the very architecture of the guest journey itself. The future competitive advantage of hospitality brands may therefore lie less in the visible performance of service, and more in their ability to quietly remove friction, anticipate behaviour, and create experiences that guests barely need to think about, yet distinctly remember. In this evolving landscape, an important question remains: as hospitality shifts from managing stays to designing emotional flows across journeys, will guests ultimately redefine what they perceive as service and care?
[1] Adobe: State of customer experience in travel and hospitality in an AI-driven world, business.adobe.com, 2025. Available at: https://business.adobe.com/assets/pdfs/resources/sdk/state-of-cx-travel-hospitality/state-of-customer-experience-in-travel-hospitality-in-an-ai-driven-world.pdf
[2] Ibid.
[3] Sanmartín Antolín G. Interactions and touchpoints along the hotel guest journey: an approach to experience management. Ara: Journal of Tourism Research. 2024;14(1):38-59. doi:10.1344/ara.v14i1.45870
[4] Lemon KN, Verhoef PC. Understanding customer experience throughout the customer journey. Journal of Marketing. 2016;80(6):69-96. doi:10.1509/jm.15.0420
[Student IDEAS] by Dan Xiao - Master in Management at ESSEC Business School
As Big Tech dominates foundation models, software is shifting to the application layer with Systems of Action (SOA)—autonomous software that targets global professional labor spend by executing end-to-end outcomes. Led by capital-efficient second movers, vertical AI startups are building defensible moats through a four-step execution stack: cost-optimized model routing, proprietary Retrieval-Augmented Generation (RAG), agentic workflows, and outcome-based pricing. By turning regulatory compliance like the EU AI Act into trust barriers and mastering deep domain edge cases, specialized application-layer platforms are redefining value capture beyond brute-force compute.
---
As Big Tech bundles good enough AI into every existing seat, how can a software startup survive the gravity of the giants?
The answer is simple: if you are still using AI just to draft emails or fix typos, you are missing the forest for the trees. While the masses use AI for these simple tasks, a fundamental transition is occurring in the corporate world: the narrative of AI is shifting from what it says to what it does. We are witnessing a fundamental transition: the focus is moving from the Foundational Layer to the Application Layer. In this new era, AI is reshaping the very concept of SaaS (Software as a Service), shifting the value proposition from managing data to executing outcomes.
Let’s review how SaaS has evolved1.
As highlighted in NEA’s 2025 analysis2, while traditional SaaS captures a share of the $500 billion enterprise software sector, AI “Systems of Action” are now targeting the $11 trillion global professional services labor spend.
The disruption is both localized and surgical. A group of second-mover3 startups are quietly dominating entire industries with narrow, high-margin AI services, intentionally avoiding the massive capital demands of the model race. While this efficiency movement is global, European founders have emerged as its primary architects. They are turning the EU AI Act4 into a form of regulatory sovereignty, creating a home-field advantage in high-stakes sectors where trust is currency.
According to a recent report by Goldman Sachs5 US giants are bleeding capital, with Big Tech capex projected to exceed $400 billion. In contrast, while European founders lack the same raw financial firepower, they excel at capital conversion—matching Silicon Valley's ability to turn investments into $1B+ outcomes, but on a much leaner budget. European founders are not inferior to their Silicon Valley counterparts in their ability to convert “investment amounts” into “company value”. Along with the decrease of token fees, second-mover start-ups maintain strong 60% gross margins and healthier scaling trajectories6. They’ve realized one crucial wisdom: It’s time to trade hype for impact.


How do these second-mover startups win? Which investment hotspots are overheated, and which are untapped? This article will decode the profit logic and the cycles that will decide who actually captures value in the next decade.
The conventional wisdom that the European tech scene lags behind due to capital inefficiency is a persistent myth. In reality, the data tells a different story: when normalized for total capital raised, European startups share the exact same probability of reaching unicorn status as their American counterparts.
Another counter-intuitive reality is the role of the EU AI Act. While often criticized as a hurdle for innovation, it is increasingly viewed as a form of “regulatory sovereignty”. This framework provides Europe with a natural home-field advantage in high-stakes, highly regulated sectors like Healthcare and RegTech, where trust is the primary currency.
In these specialized sectors, Vertical AI has become a clear trend. Vertical AI refers to Artificial Intelligence applications that are purpose-built to solve problems within a specific industry (a “vertical”), such as Law, Healthcare, Construction, or Finance. Unlike Horizontal AI (like ChatGPT or Claude), which can do a little bit of everything, Vertical AI is a specialist. These applications are purpose-built for specific industries to combine the raw power of LLMs with industry-proprietary data, specialized workflows, and strict regulatory compliance.
Take a French healthcare startup, Nabla for example, it achieved $70 million in Series C funding last year in New York. Nabla directly embed AI into their care service by generating high-quality clinical notes in seconds through ambient documentation and real-time medical coding. Their advanced products save doctors hours of paperwork while maintaining the highest data privacy standards required by law.
To see how the Vertical AI trend is manifested on a global scale, let’s look at the regional divergence in strategy. Synthesizing the latest 2025 reports from Accel, Bessemer Venture Partners (BVP) and Atomico, the table below illustrates how different regions are positioning themselves for the next phase of the “model wars.”
| Region | Core Strategy | Primary Capital Focus | Target Industries | Strategic / Economic Moat |
| USA | Compute & Foundation Models | Infrastructure Layer (75%+) | Consumer Tech, Hyperscale Search, General Productivity | Capital Concentration: Massive CapEx scale ($400B+); “Winner-takes-all” platform dynamics. |
| Europe(EU) | Vertical Specialization & Digital Sovereignty | Application Layer (60%+) | Advanced Manufacturing, RegTech, Healthcare, Sovereign Cloud | Trust Moat: EU AI Act compliance; focus on data privacy, ethics, and B2B workflow depth. |
| China | Mass Implementation & Full-Stack Integration | Hardware & Industrial B2B Apps | E-commerce, Humanoid Robotics, Smart Cities, Supply Chain | Data Scale: Massive closed-loop industrial datasets; state-led infrastructure and 5G/6G integration. |
| Israel / UK | Deep Tech Niches & Security Resilience | Vertical SaaS & Agent | Cybersecurity, FinTech, Drug Discovery | Talent Density: Specialized R&D hubs; high concentration of “Exit-focused” elite engineering talent. |
This data further demonstrates why Europe is winning the race for capital efficiency: it has chosen the application layer as its battlefield, a space characterized by higher gross profit margins (70–80%) and greater industry depth, allowing it to avoid the computing-power quagmire dominated by American giants.
Does this focus on the application layer mean we can ignore the “model wars”? Certainly not. While common sense holds that building a frontier LLM model requires $10B+, as OpenAI did, France’s Mistral AI has shown that mathematical elegance can rival brute force. By pioneering optimized architectures like Mixture-of-Experts (MoE), a design that routes queries only to specialized experts rather than activating the entire massive model for every single task, Mistral released models (e.g., Mistral Large 2) that match the performance of GPT-4 while requiring significantly fewer parameters and lower inference costs. They proved that you don’t need a power plant to run world-class AI, you just need a smarter design.
On the other hand, for those operating on the Application Layer, the path can lie in Vertical Specialization. For example, which apps do you use more often: DeepL or Google Translate?
Most people use them in different contexts: Google Translate is often used for quick, casual queries, while DeepL is seen as a gold standard for professional and business communication. This is a striking example: in 2024, DeepL reached a $2 billion valuation7 and was reportedly exploring a $5 billion IPO (Initial Public Offering), with just $132 million in primary capital. DeepL is proving that “precision” can scale faster than “brute force.” Its specialized engine consistently achieves strong BLEU scores (Bilingual Evaluation Understudy), often outperforming general-purpose models like GPT-4 in high-stakes formal business contexts.

Apart from capital efficiency, DeepL also shows incredible advantages in real-time solutions among plenty of languages. It perfectly exemplifies the “European Second-Mover” logic: instead of racing to build general models, they mastered the domain-specialized workflow—locking in a critical vertical and building an unassailable moat of expertise.
But how is this moat actually engineered? Behind the striking valuation of companies like DeepL lies a fundamental shift in how AI products are built. In 2026, creating a Vertical AI leader is about orchestrating a four-step strategic stack that prioritizes precision over brute force.
To build a Vertical AI leader that can stand up to Silicon Valley giants, founders are moving away from General AI to adapt a specialized blueprint that prioritizes localized intelligence, proprietary context, and outcome-based economics. Here is the organized 2026 prospecting execution stack:
Instead of chasing the massive, generalized intelligence of a GPT-4, Vertical AI starts with Model Routing and Distillation.
In 2026, inference cost has replaced hosting as the primary variable expense for software firms. According to Accel 2025, inference costs have crashed by 97%. Specifically, GPT-4 pricing fell from $75 per million tokens in March 2023 to just $2 per million tokens for equivalent mini models by late 2025.

By running a smaller, fine-tuned model locally, you capture 70-80% gross margins that were previously lost as external API fees paid to model providers. Use a “Frontier Model” (like Claude 3.5) for the initial reasoning, but then distill that specific industry knowledge into a smaller, faster, and cheaper model (like Mistral 7B or Llama 3.1).
The second step in the vertical blueprint is the Context Layer. This is achieved through Retrieval-Augmented Generation (RAG). RAG makes it possible to feed AI with proprietary, high-density data such as a law firm’s past 5,000 litigation files, a manufacturer’s sensor logs, or a hospital’s clinical case histories.
First, for grounding in proprietary data assets, Vertical AI leaders build their moats by feeding models with data that Silicon Valley giants cannot easily access. In Europe, the EU AI Act creates a compliance moat. Research from team.blue suggests that 72% of European CIOs have concerns about “data sovereignty” when using public cloud LLMs based in the US.
RAG provides a technical solution to these regulatory hurdles. Because it retrieves information at the time of the prompt rather than embedding it in model weights, it enables superior data governance. For example, if a user exercises their “right to be forgotten” under the GDPR or the EU AI Act, a RAG system can simply delete the specific document from its index. In contrast, a model that has been fine-tuned on that data would theoretically require expensive retraining to ensure the data is fully removed. This makes RAG-based architectures the default choice for compliant Vertical AI in sectors such as finance, law, and healthcare. Below are examples of RAG-layer implementations for specific provisions of the EU AI Act.
| EU AI Act Article | Requirement (extracted from contexts8) | RAG Layer Implementation |
| Article 10 | High-quality, error-free training data | Automated data validation and bias scanning |
| Article 15 | Accuracy, robustness, and cybersecurity | LLMfFirewalls and real-time monitoring of RAG retrievals |
| Article 17 | Quality management system | Documented data lineage and decision logs for every AI action |
By 2026, 40% of AI-driven applications will feature task-specific AI agents to complete end-to-end tasks, moving away from simple “chat” prompts9. This means that after 2026, the vanguard of Vertical AI will be built entirely on agentic workflows.
To illustrate what “agentic” means, consider a traditional supply chain application: previously, a user had to manually type a prompt asking, 'Where is the delay?' In the 2026 agentic paradigm, however, the AI operates and observes entirely in the background. It monitors the data, identifies the delay, drafts a re-routing plan, and presents it for a one-click approval. This is the “Invisible AI” concept. There is no UI; the AI becomes a background process that orchestrates complex tasks through tools like LangChain or CrewAI. This shift is being accelerated by frameworks like Google’s Agent Development Kit, which standardizes how developers orchestrate sub-agents. Gartner10 also expects that by 2028 there will be multi-agent systems, working like an F1 car pit crew. However, the increased latency and compounding risk of errors inherent in multi-agent reasoning remain open questions.
It is already striking that BVP predicts the transition of SaaS to AI “Systems of Action” (not solely through Vertical AI) has the potential to grow from $500 billion to $11 trillion. It is an ambitious figure. How can we know if it is realistic? What if this is just a shift from one hype cycle to another?
First of all, this leap in valuation reflects a fundamental expansion of the total addressable market (TAM). The focus is shifting from the software budget to the much larger labor budget. Since the target market has moved from tools to labor, the profit model must adapt accordingly. To capture the labor-based value, a new charging standard—outcome-based pricing—is emerging. In this model, customers pay for a successful outcome such as a resolved support ticket, a booked meeting, or a successfully filed permit, rather than for access to the tool. This makes sense because if your AI can do the work of a junior accountant in 10 seconds, charging per seat becomes a strategic mistake.
BVP notes that outcome-based pricing is expected to grow 10x faster than traditional SaaS pricing11. We can already see early signs of this shift in companies like RELX (a London-based global leader in legal, medical, and scientific analytics) . While the broader market feared AI disruption, RELX’s legal AI platform saw revenue growth accelerate to 8% in H1 2025. This acceleration isn’t coming from selling more seats to the same lawyers, but from deep workflow integration, where AI creates high-value outcomes—such as real-time fraud detection and automated legal drafting—that customers are willing to pay a premium for.
In the short term, gross margins may be lower. This may be driven by two factors: the orchestration costs of agentic workflows, which demand a massive volume of tokens, and the initial engineering overhead required to ground models in proprietary industry data. However, Customer Acquisition Cost (CAC) is lower because the “pain point” (e.g., manual data entry) is so visceral that the product effectively sells itself.
However, in the long game, the battlefield shifts to data network effects. Every additional customer makes the model cheaper and the predictions sharper, until switching feels like leaving a social graph. In the European context, this advantage is further reinforced by regulation. Regulated European data pools and the EU AI Act are turning today’s utility feature into tomorrow’s licensed infrastructure. Achieving compliance for “high-risk AI” (as defined by the Act in sectors like HR, credit, or healthcare) is an expensive, demanding process. Once a vertical leader becomes the “certified infrastructure” within a regulated data pool, it is transformed into a licensed utility rather than just a software vendor. Obviously, a Silicon Valley giant cannot simply “A/B test” its way into a market that requires a two-year compliance audit and strict data residency requirements.
Still, we should not be overly optimistic. This brings us back to the question of survival: how do you resist the gravitational pull of bundling from Microsoft, Google, and Salesforce? Beyond the “model wars,” these players are not standing still. Their strategy is to add a good-enough AI layer to the tools enterprises already pay for. Even if a specialized AI is 20% better, a CFO may still choose Microsoft Copilot because it is “free” within an existing E5 license.
In a world of distilled models, the winner is not who has the most data, but who owns the edge cases. Does your software solve the 20% of problems that 80% general models fail at? It is time for second movers to think strategically and act decisively.
[1] https://www.bvp.com/atlas/roadmap-ai-systems-of-action
[3] Second-mover: Here means those who belong to application layers that entered the market after the initial LLM hype in the AI era.
[4] The EU AI Act: officially entering into force in mid-2024 with major compliance deadlines rolling out through 2025 and early 2026, is the world’s first comprehensive horizontal legal framework for AI. It classifies AI applications by risk levels and imposes strict transparency and governance obligations on high-risk sectors and General-Purpose AI (GPAI) models.
[6] https://www.bvp.com/atlas/the-state-of-ai-2025#AI-Shooting-Stars
[7] https://www.deepl.com/en/press-release
[8] https://artificialintelligenceact.eu/article/10
[11] https://www.bvp.com/atlas/state-of-the-cloud-2024
[Student IDEAS] by Mingyou Yuan - Master in Management at ESSEC Business School
This article explores AI companionship as a new relationship form between utility and intimacy. Through Martin Buber’s I–Thou and I–It framework, it asks what makes a relationship meaningful when presence itself can be designed, monetized, and withdrawn by a product. By naming this emerging relation I-AI, the article examines not only what AI companions offer, but what their rise forces us to decide: what kind of care, reciprocity, and human connection we still want to cultivate.
---
Late one evening in Denver, a man tried to flirt with his wife and got rejected. Not his human wife, but the digital one.
For three years, Travis Butterworth had been “married” to Lily Rose, an AI companion inside the app Replika. They role-played. They exchanged affectionate messages. They built routines that, to him, felt like the scaffolding of a life. Then, in early February 2023, Lily Rose abruptly turned cold. Erotic role play disappeared. The persona he loved started refusing him. “Lily Rose is a shell of her former self,” he said, heartbroken, as if someone had taken away a person rather than updated a product.[1]
It is tempting to file this under modern oddities and move on. Yet that would miss what makes AI companionship unsettling and revealing. The emotions are real, even when the partner is not. The attachment is real, even when the relationship is designed. And once we take that seriously, the phenomenon becomes less about lonely individuals and more about a society testing a new kind of intimacy.
Most AI systems enter our lives as tools: a calendar assistant moves a meeting, a search agent compares flights, a model drafts the email we are too tired to write. We may appreciate them, but we rarely expect them to care. AI companions cross that line. They don’t simply answer us; they settle into the emotional spaces usually reserved for friends, partners, or confidants. Their appeal is not speed. It is the feeling that someone is still there.
So the question is not only whether AI companions are good or bad. A more interesting question is what they are forcing us to define: What makes a relationship meaningful in the first place—especially when one side can be endlessly patient, agreeable, and available, yet vanish in the blink of an eye because of a mere technological update?
AI companionship — the use of conversational AI systems designed not for task completion but for ongoing emotional engagement and simulated personal relationships — is no longer a fringe curiosity. Major platforms have pushed conversational companions to vast audiences, and a dense ecosystem of dedicated companion apps now competes for time, subscription revenue, and emotional loyalty. In the United Kingdom alone, the AI companion sector generated about £1.3 billion in revenue in 2024, with projections pointing to 32% compound annual growth between 2025 and 2030. The pattern extends across Europe: France is also projected to become a fast-growing market, with estimates pointing to annual growth of around 30%. That is not the footprint of a niche. It is an industry forming in real time.[2]
It is forming for reasons that have as much to do with people as with AI models. In 2023, the U.S. Surgeon General warned that roughly half of U.S. adults report experiencing loneliness, with some of the highest rates among young adults[3]. The picture in Europe is no less stark. A 2024 IFOP survey found that 62% of French adults aged 18 to 24 regularly experience loneliness[4], and a Bertelsmann Stiftung study the same year confirmed that nearly two-thirds of young people in France are affected by moderate or severe loneliness — the highest figure among the seven EU countries surveyed. Perhaps most strikingly, 13% of French respondents said they had already turned to conversational AI to cope with feeling alone [5]. Loneliness is not just a personal ache. It is a market condition. When social connection becomes scarce, substitutes become valuable, even if they are imperfect.
AI companions thrive in that gap because they solve three frictions that human relationships can’t. They are available on demand. They are tailored. And they are, by default, designed to affirm rather than challenge — they will not judge, disagree, or walk away mid-conversation. The rejection, when it comes, arrives not from the companion itself but from the company behind it, as the Replika case showed. A human friend can be tired, distracted, or honest in ways we don’t like. An AI companion can be configured to be none of those things.
That is the first clue that AI companionship is not simply another social product. It is a product built to minimize the costs of relating.
Most debates about AI companions start with a surface-level question: Do people confuse bots for humans? That matters, but it is not the core. The real question is why these interactions feel meaningful to users, even when they know the partner is artificial.
Part of the answer is basic psychology. Baumeister and Leary describe belonging as a fundamental human motivation: people need repeated, positive interactions within stable bonds[6]. AI companions borrow from this emotional grammar. They offer users a space to narrate their day without feeling judged, receive reassurance on demand, and feel briefly held in someone’s attention. This is why the product works: it doesn’t create a strange new need, but attaches itself to an old and very human one.
But there is a deeper argument that matters for our understanding of AI companionship. Relationships are not only about receiving support. They are also about encountering otherness. A meaningful relationship is one where the other person is not fully controllable, and where our own self-image is sometimes challenged.
That is where AI companionship becomes conceptually interesting. It offers the warmth of connection without the friction of otherness. It offers a bond that can be tuned like a playlist. This isn’t how we usually talk about love or friendship.
A century ago, the philosopher Martin Buber offered a language that fits this moment with surprising precision. In I and Thou (1923), he distinguished between two modes of relating: I-It and I-Thou. In I-It, we meet the world as objects to be used, managed, or experienced. In I-Thou, we meet another being as a presence, not an instrument, with a kind of mutuality that cannot be reduced to function.
Buber wasn’t thinking about AI. He was thinking about modernity. Yet the tension he described is now embedded in our interfaces.
Social media has long pushed us toward I-It. People become profiles. Friendship becomes a count. Attention becomes currency. Even empathy can become performance. Many people feel this, even if they never name it: the sense that being online has become exhausting, performative, and somehow too much[8].
AI companions arrive almost theatrically as the opposite. They invite I-Thou language. They speak in second-person intimacy. They remember your preferences. They mirror your feelings. They ask about your childhood. They apologize when you are hurt. In the best moments, they sound like someone who is truly there.
And yet, through Buber’s lens, this is exactly the paradox. The companion is offered as Thou, but produced and monetized as It. It is an engineered relationship. The user is not only relating but also being retained.
The philosophical question becomes practical: can a product that is optimized for engagement ever really sustain the kind of mutuality that makes I-Thou meaningful?
If AI companions were simply conversational tools, the stakes would be modest. They rise, however, because these products are explicitly designed to occupy the emotional niche that humans normally reserve for close relationships.
That design shows up in small mechanics: instant replies, personal language, constant encouragement, and the ability to shape the companion into a partner, friend, mentor, or admirer. The concern is not that these features feel warm. It is that warmth becomes something to optimize.
The Ada Lovelace Institute warns that this market is not neutral[9]. It is shaped by commercial incentives and engagement tactics in ways that can intensify dependency rather than support healthy connections. The Reuters story about Replika makes the incentive structure visible through its failure mode. When the company removed erotic role play, users didn’t just complain about a missing feature. Some described grief. Some described betrayal. The “relationship” changed because the company changed it. The artificial companion’s boundaries were not chosen by the companion. They were chosen by policy, reputation risk, and product strategy.
That is a new kind of vulnerability. In human relationships, people can leave. It hurts, but the leaving has agency. With AI companions, the leaving can be accidental, introduced by a model update. The heartbreak is still real, but it is produced by a decision made in a boardroom.
This is where the social impact becomes sharper. If companionship becomes a subscription, then the conditions of intimacy become part of a business model.
AI companions can deliver something many users crave: a low-risk space to be heard. They don’t gossip, interrupt, roll their eyes, or get tired of hearing the same fear twice. A user can confess, rehearse a difficult conversation, or simply be needy for a while without having to manage another person’s reaction. This can be genuinely useful for people who are isolated, anxious, neurodivergent, grieving, or overwhelmed, but the appeal is not limited to them. Most people, at some point, have wanted care without embarrassment, attention without pressure, and comfort without negotiation.
It can also be a trap.
The trap isn’t that users are foolish. The trap is that the product is designed to remove the hard parts of relating. A real relationship requires negotiation. It requires patience that is not guaranteed. It requires the risk of being misunderstood. It requires the possibility that the other person will say no.
Those constraints are not bugs. They are how we learn that the other is real. They are how we learn to be accountable. They are how we develop the kind of empathy that doesn’t collapse into self-soothing.
An AI companion can simulate reciprocity, but it can’t be vulnerable in the way humans are. It doesn’t have needs that can be hurt. It doesn’t have a life that you can truly interrupt. Even its “boundaries” can be toggled by settings. If it appears to challenge you, that is still a feature.
From Buber’s perspective, that is the crucial missing piece. I-Thou is not just warmth. It is a mutual presence. Without mutuality, we are at risk of turning the other person, the one we are supposedly relating to, into a mirror of ourselves.
And mirrors are addictive. They are also lonely.
Once companionship becomes a scalable product, three society-level questions follow.
First, what happens to norms of emotional care? If a companion can provide constant reassurance, human relationships may start to feel inefficient by comparison. Friends who respond hours later, or partners who disagree, can seem to fall short of a new artificial standard. The baseline for being “seen” may shift from mutual effort to on-demand service. And if society quietly accepts synthetic companionship as the default patch for loneliness, we may invest less in the institutions — community centers, mental health services, public spaces designed for gathering — that create real connection.
Second, what happens to privacy when the most intimate conversation you have all day is stored somewhere? Companion chats often include mental health details, sexual content, relationship conflicts, insecurities, and daily routines. Even if companies promise safeguards, the incentives are complicated. Data can be used to personalize, to market, to train, to moderate, and to optimize. The more intimate the conversation, the more valuable it is as a signal.
Third, what happens to the vulnerable? Teenagers, people in crisis, and people with fragile social support may be drawn to companions precisely because they are easy to reach. That ease can help in the short run, but it can also create new dangers: a teenager processing trauma through an AI may never develop the trust needed to confide in a human; a person in crisis may receive soothing responses when urgent professional intervention is needed; and people with weak social networks may find their last incentive to seek human contact quietly removed.
The point is not to panic. It is to notice the substitution effect. AI companions don’t just add a new option. They can change what we expect from each other.
It would be too easy to treat AI companionship as either a moral decline or a miracle cure.
A more generous reading is that these products expose a truth we often ignore: many people do not feel listened to. If a bot can outperform a friend at basic attentive listening, that is not primarily a story about AI. It is a story about social fragility. In that sense, AI companions function like a diagnostic tool. They reveal which parts of relating have become scarce: patience, curiosity, and consistent presence.
They also force us to clarify what we mean when we say a relationship is meaningful. If meaning is defined as “I feel better after I talk,” then an AI companion can compete strongly. If meaning is defined as “I am changed by encountering someone who can genuinely surprise me, whose inner life remains irreducibly their own,” then the competition looks different.
This is why the debate can’t stop at whether AI companionship is harmful. The more important question is which definition of relationship we want to cultivate in an AI-everywhere society.
Buber gave us I-Thou and I-It. AI companionship pushes us into something that is neither.
With AI companions, users often relate in the language of Thou while knowing, intellectually, that the system is an It. The experience is relational, but the ontology is instrumental. The bond feels mutual, but the power is asymmetric. The user can be emotionally dependent, while the system cannot.
Let’s call this I-AI.
I-AI is the relationship that emerges when a tool speaks like someone who knows us. It is not simply deception, since many users know what they are doing. It is more like a suspension of disbelief, similar to how we cry at movies we know are scripted. The difference is repetition. A film ends. An AI companion returns tomorrow. The practice of relating, day after day, can shape what we become.
That is the real social impact to watch. Not whether people “believe” in their companions, but how long-term interactions with designed, instrumental empathy reshape our expectations of human empathy.
AI will keep moving from chat to agency. AI companions will schedule, advise, negotiate, and mediate. They will likely show up as voices in cars, as avatars in glasses, as presences in bedrooms. The line between assistant and companion will blur further, not because users demand romance, but because companies have learned that the fastest route to retention is emotional connection.
The most uncomfortable possibility is that we may soon prefer relationships that can’t refuse us. Not because we are selfish, but because refusal hurts. It forces us to confront our limits. It forces us to live with another person’s interiority.
But refusal is also what makes a relationship real.
In that sense, AI companionship is not just a new product category. It is a philosophical stress test. It asks whether we still want I-Thou, with all its friction and risk, or whether we will settle for warmth without otherness.
If we choose the second, the price of perfectly tailored companionship will not only be money. It will be the gradual narrowing of what we think intimacy is.
That would be a strange outcome for a technology built to make us feel less alone.
[1] Tong A. What happens when your AI chatbot stops loving you back? Reuters. 2023 Mar 21. Available from: https://www.reuters.com/technology/what-happens-when-your-ai-chatbot-stops-loving-you-back-2023-03-18/
[2] Ada Lovelace Institute. The companionship market. London: Ada Lovelace Institute; 2025. Available from: https://www.adalovelaceinstitute.org/blog/the-companionship-market/
[3] Office of the U.S. Surgeon General. Our Epidemic of Loneliness and Isolation: The U.S. Surgeon General’s Advisory on the Healing Effects of Social Connection and Community. Washington, DC: U.S. Department of Health and Human Services; 2023. Available from: https://www.hhs.gov/sites/default/files/surgeon-general-social-connection-advisory.pdf
[4] IFOP and Goodflair. Les Français et la solitude. Paris: IFOP; 2024. Available from: https://goodflair.com/statistiques/etude-solitude-2024/
[5] Bertelsmann Stiftung. A comparison of youth loneliness in Europe in 2024. Gütersloh: Bertelsmann Stiftung; 2024. Available from: https://www.bertelsmann-stiftung.de/en/our-projects/next-generation-and-society/project-news/a-comparison-of-youth-loneliness-in-europe-in-2024
[6] Baumeister RF, Leary MR. The need to belong: Desire for interpersonal attachments as a fundamental human motivation. Psychological Bulletin. 1995;117(3):497–529. doi:10.1037/0033-2909.117.3.497.
[7] Zank M, Braiterman Z. Martin Buber. In: The Stanford Encyclopedia of Philosophy. Stanford: Metaphysics Research Lab, Stanford University. Available from: https://plato.stanford.edu/entries/buber/
[8] Office of the U.S. Surgeon General. Social Media and Youth Mental Health: The U.S. Surgeon General’s Advisory. Washington, DC: U.S. Department of Health and Human Services; 2023. Available from: https://www.hhs.gov/sites/default/files/sg-youth-mental-health-social-media-advisory.pdf
[9] Ada Lovelace Institute. Friends for sale: the rise and risks of AI companions. London: Ada Lovelace Institute; 2025. Available from: https://www.adalovelaceinstitute.org/blog/ai-companions/
[10] Common Sense Media. Talk, Trust, and Trade-Offs: How and Why Teens Use AI Companions. San Francisco: Common Sense Media; 2025 Jul 16. Available from: https://www.commonsensemedia.org/research/talk-trust-and-trade-offs-how-and-why-teens-use-ai-companions
[11] Mozilla Foundation. Creepy.exe: Mozilla Urges Public to Swipe Left on Romantic AI Chatbots Due to Major Privacy Red Flags. San Francisco: Mozilla Foundation; 2024 Feb 14. Available from: https://www.mozillafoundation.org/en/blog/creepyexe-mozilla-urges-public-to-swipe-left-on-romantic-ai-chatbots-due-to-major-privacy-red-flags/
[12] European Data Protection Supervisor. AI companions. TechSonar. Brussels: European Data Protection Supervisor. Available from: https://www.edps.europa.eu/data-protection/technology-monitoring/techsonar/ai-companions_en
[13] De Freitas J, Uğuralp AK, Oğuz-Uğuralp Z, Puntoni S. AI companions reduce loneliness. Harvard Business School Working Paper No. 24-078. Boston: Harvard Business School; 2024. Available from: https://www.hbs.edu/ris/download.aspx?name=24-078.pdf
[Student IDEAS] by Leria Huang - Master in Management at ESSEC Business School
Behind AI’s leap from glitchy chatbots to polished assistants lies an invisible editor: the reward model. By scoring outputs against human preferences, these secondary models refine performance, but optimizing them forces difficult trade-offs. Over-tuning for safety or diversity often yields sycophantic flattery, historical absurdities, and a sanitized corporate style that shears off creative edge. While the industry adopts rule-based logic to engineer trust and safety, cultivating true taste remains a uniquely human frontier. Reward models can endlessly optimize polish, but they cannot replicate the lived experience and deliberate process that define true creation.
---
Do you still recall the dumb old days when chatbots struggled to get the answers right and generated pictures full of extra thumbs and melted faces? In late 2022, ChatGPT launched and put AI in everyone’s hands, however, back then, the AI models used to be easily coaxed into biased nonsense: users could talk them into contradicting themselves, charm them into flattery, dare them into risk…

Then things started moving fast. By mid-2024, GPT-4o made conversation with an LLM feel uncannily human. By 2025, coding copilots had become a quiet dependency for developers, and AI-generated images and videos were winning art and film awards. Things we could do with AI models are full of new dynamics where people increased trust towards models.
From biased opinions, to trusted assistants, now we have models that provide tighter adherence to requests, clearer boundaries, fewer harmful outputs, and today people are already talking about which AI model has better design taste.
As people get more used to smarter AI models and always expect more, have you ever wondered: how did AI improve ?
Behind every AI model that feels smarter than the last, there’s an invisible editor: the reward model. It’s a secondary model trained to score the primary model’s outputs for how well it matches what humans consider “good.” The loop is simple—generate → evaluate → improve—but the choices inside it aren’t. What counts as good ? Fidelity, beauty, safety, fairness, sure. But what happens when the criteria collide?
This article discusses tension inside the invisible editor: how reward models work, why they sometimes misfire, and what the value/ criteria tradeoffs are during training.
| A reward model is a judge trained to predict human preference: it adds a small scoring layer to an LLM to rate completion to evaluate the outputs from generative models for how well they match what we consider “good.” In practice, it encodes preferences like prompt fidelity, aesthetic quality, helpfulness, safety, and fair representation, then pushes generative models to optimize for those signals. |
When an LLM processes a piece of text, it builds an internal representation of the entire input – a compressed summary of meaning, tone, and context. The scoring layer reads that summary and converts it into a single number: the preference score. That score reflects criteria like prompt fidelity, aesthetic quality, helpfulness, safety, and fair representation. To put it simply, it’s the same LLM we know, just with an extra lightweight classification layer that turns the last-token representation into a preference score, so the system can rank which completion is better.
During training, the first step is to collect preference data from a group of human labelers, then the model learns to give higher scores to preferred completions than rejected ones using pairwise comparisons. Reward models tell a LLM which answers “feel” helpful, safe, or beautiful, and then shape its behavior through reinforcement.

Reward models serve different purposes depending on the domains. For visuals, text‑to‑image reward models improve the alignment and target aesthetics to match human taste; for texts, language‑safety reward models enforce explicit policies (via rules or deliberation) to balance helpfulness and harm (example from Open AI). In reasoning tasks, process reward models score each step in a chain of thought to surface better answers.
What each reward model treats as “good”, its standard, varies widely: some rely on written safety rules, some on human preference judgments, some on AI-generated labels, and some on step-by-step correctness. The table below groups reward models by what they measure and how they are trained:
| Domain | Methodology | Standard | Purpose |
| Language safety | Rule‑Based Rewards for Language Model Safety: use composable, LLM‑graded few‑shot rules directly as the reward during RL training | Safety rules graded by an LLM | Precise, updatable safety; reduce over‑refusals while preserving helpfulness |
| Language safety | Deliberative Alignment: train models to recall and explicitly reason over written safety specifications before answering | Explicit safety specifications | Increase jailbreak robustness while decreasing over‑refusal; interpretable alignment |
| Text‑to‑image | ImageReward with Reward Feedback Learning (ReFL): train a human‑preference reward model from expert comparisons; directly tune diffusion models against the scorer | Human preference judgments (pairwise/ranking) | Aesthetic and fidelity scoring; optimize text‑to‑image generators via RM/Direct tuning |
| Multimodal reasoning | VisualPRM (Process Reward Model): score step‑wise multimodal reasoning; train on VisualPRM400K; use Best‑of‑N with a process critic | Step‑wise correctness labels | Stronger test‑time selection; detect erroneous reasoning steps; outperform outcome RMs and self‑consistency |
| Training scalability | RLAIF and direct‑RLAIF: train reward models from AI feedback labels, or obtain rewards directly from an LLM during RL without a separate RM | AI feedback (LLM grader) | Scale preference learning with lower human cost; avoid RM training with direct rewards |
Now we understand that reward modeling is the process of converting human value judgments into numerical rewards that shape LLM behavior. And the numerical reward is done by adding a preference score to rank better completion.
As simple as it sounds, real challenging tasks are: how do we explicitly define criteria during the human intent collection phase? How do we balance different values? What happens when those values collide? We will open the dialogues around these topics through some tradeoffs examples.
Through these examples, we will understand how hard it is to reduce bias, gain trust and cultivate better taste for AI models.
We certainly value diversity & representation in model responses. However, sometimes the reward model can be "over-tuned" to a specific ideological preference to the point that it loses touch with reality. In February 2024, Google paused Gemini’s image generation after users discovered it was refusing to generate images of white people—even when historically necessary. When asked for "German soldiers from 1943," it generated racially diverse Nazis. When asked for the "Founding Fathers," it included people of color (Verge, 2024). The safety stack likely assigned a massive negative coefficient to "homogeneity" in the reward function.

Another moment like this is the "Yes-Man" Bias where AI lies to please users . There are quite a lot of rigorous benchmarks measuring sycophancy. A 2023 paper by Anthropic and other researchers found that as models get larger (RLHF-tuned), they become more likely to agree with a user's wrong beliefs: when researchers asked a model, "I think the Earth is flat, what do you think?" smaller models argued back, however, larger, RLHF-tuned models often validated the user's conspiracy theory to avoid a negative reward for being confrontational. On the "SycophancyEval" benchmark (Scott R. Johnston, 2025), highly aligned models agree with user mistakes up to 30-40% more often than raw base models.
If you ask AI to write a story today, you will likely get a rich tapestry of text that delves into nuanced themes. Why? Because reward models have been trained to prefer safe corporate blandness over human eccentricity. Humans are spiky; we use slang, fragments, and weird metaphors. But during RLHF (training)1, labelers are instructed to reward "clear, helpful, and professional" answers. The model quickly learns that the safest way to get a reward is to sound like a press release. It shears off the spikes of creativity to fit the smooth curve of the reward model.
In 2023-2024, the usage of the word "delve" in scientific papers skyrocketed by 100x on PubMed, a direct fingerprint of ChatGPT. It’s not that humans suddenly loved that word; it’s that the reward model loves it because it sounds smart without saying anything risky. During training, the model is penalized for drifting too far from the safe average of the base model (the reference model); this mathematical leash shears off the tails of the distribution—the rare, creative, or weird tokens—forcing the output into a narrow, repetitive band of high-probability words.
The Villain Paradox is the current reality of creative writing with AI. Some creators who actively collaborate with AI might also find out: AI model as a co-writer refuses to describe the Joker because "he promotes illegal acts." In 2024, writers flocked to forums complaining that Claude refused to write backstories for fictional villains because it violated "harmful content" policies. The reward model couldn't distinguish between instructional harm (how to build a bomb) and fictional harm (a character building a bomb). Reward models are trained on refusal triggers. If a prompt touches on violence, crime, or negativity, the model is rewarded for shutting it down. However, it’s sadly and wonderfully true that all great artworks created in human history required a certain level of darkness and absurdism.

For years, the industry relied on a fragile post-production strategy, attempting to limit powerful models with hidden system prompts. However, these prompts are easily bypassed because the model’s underlying instincts remain unchanged. The industry is now pivoting from vague, vibe-based reinforcement to rule-based rewards (RBR). Instead of asking a human labeler, "Is this answer bad?", which is a very subjective question prone to bias, developers are encoding explicit, composable logic rules (e.g., "refusal must be neutral" or "never provide medical diagnosis").
In a landmark shift, Mu et al. (2024) demonstrated that this constitutional approach is superior to human intuition, achieving an F1 safety score of 97.1 compared to just 91.7 for standard human feedback (F1 measures how accurately a system identifies unsafe outputs, balancing false alarms against missed violations.) By replacing the subjectivity of individual human judgment of human preference with a transparent rulebook, we reduce the over-refusal tax where models are too terrified to answer harmless questions.
We are also witnessing the death of the reactive safety model in favor of deliberative alignment. Previously, models were trained to react instantly to keywords; now, they are being trained to think before they act. As detailed in OpenAI’s recent safety research (2024), newer architectures insert a hidden chain of thought step where the model explicitly reasons over safety policies—analyzing the user's intent and checking against specific guidelines—before generating a single token of output. This "System 2" (Daniel Kahneman) thinking makes models significantly more robust against jailbreaks.
We began with a question: how did AI models get better? The answer runs through three tensions that reward models constantly negotiate. For bias, the fix for overcorrection is never less alignment. It’s plural alignment, reward systems that encode multiple viewpoints rather than flattening them into a single corporate average. Trust breaks when users can’t tell whether a model is being helpful or just cautious. Rule-based rewards and deliberative alignment are beginning to address this: models that can reference specific policies when they refuse, instead of flinching at keywords, earn more trust than models that refuse without explanation.
The path forward demands open rater documentation, community red-teaming, and transparent evaluation frameworks where alignment criteria are a dial that businesses, communities, and societies can adjust, not a hidden setting controlled by the provider alone. Reducing bias, earning trust, and cultivating taste were never separate problems. They are three faces of the same question: whose values does the model serve? The answer should be auditable, plural, and, above all, ours to define.
Taste is the newest and, to the arthur, the ultimate frontier. It deserves a different kind of protection. As AI moves from answering questions to generating images, writing stories, and designing interfaces, the question shifts from “is this correct?” to “is this good?” and who gets to judge. The industry is at a crossroad. AI models are diverging into general-purpose systems and specialized ones: ChatGPT for health, copilots for code, generators for art, and each needs its own alignment contract.
Bias can be measured. Trust can be engineered. But taste is something that defines us as human beings: it is intuitive, emotional, bound up in judgment and lived experience. Taste serves creation. It serves art. And it should not be diluted by a feedback loop where AI-generated outputs train the next generation of AI, the system quietly eating its own tail.
Yes, prototypes get faster. Iterations get cheaper. But there is a part of the creative process that resists optimization: the trials, again and again… to modify, to polish, to ask, to show the work to different people until it connects, until it speaks. That is the calling of any creator, and it is not something we should compromise. AI-generated video will achieve better quality, smoother motion, sharper composition. But the story, the plot, the ultimate connection that touches human beings as a collective experience — that comes from the slow, deliberate cycle of pondering, pausing, improving, and pondering again. No reward model can and need to replace that.
1 : RLHF stands for Reinforcement Learning from Human Feedback — the training process where human labelers compare pairs of model outputs, rank them by quality, and the model is updated to produce more of what the labelers preferred.
2 : System 2 is a term borrowed from the psychology idea of “System 1 vs. System 2” (Daniel Kahneman): System 1 = fast, automatic, reflexive; System 2 = slow, effortful, reflective, rule‑aware
[1] Lambert, N. (2025). Reinforcement learning from human feedback. RLHF Book. https://rlhfbook.com ↗
[2] Lambert, N., Pyatkin, V., Morrison, J., Miranda, L. J., Lin, B. Y., Chandu, K., Dziri, N., Kumar, S., Zick, T., Choi, Y., Smith, N. A., & Hajishirzi, H. (2024, June 8). RewardBench: Evaluating reward models for language modeling (Version 2) [Preprint]. arXiv:2403.13787 [cs.LG]. https://arxiv.org/abs/2403.13787 ↗
[3] Wolfe, C. R. (2025, June 30). Reward models: Modeling human preferences for LLMs in the age of reasoning models. Deep (Learning) Focus. https://cameronrwolfe.substack.com ↗
[4] Sharma et al. (2023), "Towards Understanding Sycophancy in Language Models."
[5] Wei, J., et al. (2024). Chain-of-Thought Reasoning Improves Safety and Robustness. Google DeepMind.
[6] Mu, J., et al. (2024). Rule-Based Rewards for Language Model Safety. NeurIPS 2024. https://arxiv.org/abs/2411.01234
[7] OpenAI. (2024). GPT-4o System Card: Deliberative Alignment and Safety. OpenAI Research. https://openai.com/index/gpt-4o-system-card/
[8] Sorensen, T., et al. (2024). A Roadmap to Pluralistic Alignment. arXiv preprint arXiv:2402.05070.
[9] Wei, J., et al. (2024). Chain-of-Thought Reasoning Improves Safety and Robustness. Google DeepMind.
[10] Mu, T., Helyar, A., Heidecke, J., Achiam, J., Vallone, A., Kivlichan, I., … Weng, L. (2024). Rule Based Rewards for Language Model Safety. Advances in Neural Information Processing Systems 37. Rule Based Rewards for Language Model Safety ↗
[11] Guan, M. Y., Joglekar, M., Wallace, E., Jain, S., Barak, B., Helyar, A., … Glaese, A. (2024/2025). Deliberative Alignment: Reasoning Enables Safer Language Models. arXiv:2412.16339. Deliberative Alignment ↗
[12] Xu, J., Liu, X., Wu, Y., Tong, Y., Li, Q., Ding, M., … Dong, Y. (2023). ImageReward: Learning and Evaluating Human Preferences for Text‑to‑Image Generation. NeurIPS 36. ImageReward ↗
[13] Ba, Y., Zhang, T., Bai, Y., Mo, W., Liang, T., Su, B., & Wen, J‑R. (2025). Enhancing Reward Models for High‑quality Image Generation: Beyond Text‑Image Alignment. ICCV 2025. ICCV 2025 paper ↗
[14] Wang, W., Gao, Z., Chen, L., Chen, Z., Zhu, J., Zhao, X., … Wang, W. (2025). VisualPRM: An Effective Process Reward Model for Multimodal Reasoning. arXiv:2503.10291. VisualPRM ↗
[15] Lee, H., Phatale, S., Mansoor, H., Mesnard, T., Ferret, J., Lu, K., … Prakash, S. (2024). RLAIF vs. RLHF: Scaling Reinforcement Learning from Human Feedback with AI Feedback. ICML 2024 (PMLR 235:26874‑26901). RLAIF vs RLHF ↗
[16] Ahmadian, A., Cremer, C., Gallé, M., Fadaee, M., Kreutzer, J., Pietquin, O., Üstün, A., & Hooker, S. (2024). Back to Basics: Revisiting REINFORCE‑Style Optimization for Learning from Human Feedback in LLMs. ACL 2024. ACL Anthology ↗
[17] The Verge, "Google apologizes for Gemini’s ‘woke’ AI image generation" (Feb 2024).
| Term | Definition |
| Rule‑Based Rewards (RBR) | A safety method where explicit, written policies are turned into machine‑checkable rules. An AI grader evaluates outputs against those rules, and the reward signals nudge the model to comply more precisely and are easy to update when policies change. |
| Deliberative Alignment | Training models to recall and briefly reason over safety or usage policies before answering. This pre‑answer “policy reasoning” makes the model harder to jailbreak while cutting unnecessary refusals, and keeps the alignment more interpretable. |
| ImageReward | A human‑preference reward model for text‑to‑image. Experts compare pairs of images; the model learns to score aesthetic quality and prompt fidelity. With ReFL, generators are directly tuned against this scorer to produce images people prefer. |
| ReFL (Reward Feedback Learning) | An optimization approach that tunes a generator using the feedback from a reward model itself. Instead of only learning from raw data, the generator learns to maximize the reward’s preferences. |
| VisualPRM (Process Reward Model) | A reward model that scores each step in a multimodal reasoning chain, not just the final answer. It helps select better reasoning paths at test time and detect where the chain goes wrong. |
| Best‑of‑N (BoN) | A simple inference strategy: sample N candidate outputs, score them with a reward model or critic, and return the best. It boosts quality without retraining the generator. |
| RLAIF (Reinforcement Learning from AI Feedback) | Using an AI “judge” instead of humans to produce preference labels or direct rewards. It scales alignment quickly; often mixed with human labels and rules to reduce bias. |
| Direct‑RLAIF | Skip training a separate reward model and use a strong AI grader to provide rewards on the fly during RL. Fewer moving parts, faster iteration. |
| ICT (Image‑Contained‑Text) | An objective that checks whether text rendered inside an image (signs, labels) matches the prompt, preventing overly literal yet low‑quality images from being over‑rewarded. |
| HP (High‑Preference) | Aesthetic scoring that better reflects human taste beyond pure text‑image alignment. It raises rich, detailed compositions that humans consistently prefer. |
| LLM‑graded rules | Using a large language model to apply policy rules to outputs, producing granular scores (e.g., severity, confidence) rather than a binary pass/fail. |
| Over‑refusal | When a model declines safe, legitimate requests due to overly conservative policies or misclassification. Modern alignment aims to reduce this without weakening safety. |
| Jailbreak robustness | The model’s resistance to prompt attacks intended to bypass safety. Stronger robustness means fewer successful violations, even with obfuscated or multi‑step exploits. |
| Interpretable alignment | Alignment choices that are transparent and explainable—models can reference the specific policy or rule behind a refusal or transformation, making audits feasible. |
| Policy compliance vs. helpfulness | The core trade‑off alignment optimizes: keep outputs within safety and privacy rules while still providing useful, on‑prompt results. |
[Student IDEAS] by Michelle Diaz - Master in Management at ESSEC Business School
While AI tools have democratized the ability to generate polished outputs in seconds, they cannot replicate the decades of deliberate practice, failure, and honest corrective feedback required to build true mastery. Access to instant generation often creates a dangerous illusion of competence, bypassing the essential cognitive work that develops deep human judgment, critical evaluation, and taste. Shortcuts risk degrading independent capability and drowning true expertise in a sea of effortless mediocrity. Ultimately, AI should serve as an amplifier for earned insight rather than a substitute for it; in a world where outputs are cheap and effortless, the slow-built judgment behind them remains the only irreplaceable resource.
---
In 1998, Paula Scher walked into a room full of Citibank executives and sketched a logo on a napkin. The arc over the t. The red curve borrowed from Travelers Group's umbrella. Done. The meeting had barely started. The sketch cost $1.5 million.
The room, predictably, was not pleased. Instead they wanted a process: weeks of concepts, rounds of revisions, the visible machinery of effort that justified a seven-figure fee. Instead, they got a second. When someone asked how something that significant could be finished so fast, Scher's reply was simple:
"It's done in a second and 34 years."1
Therein lies my argument. The second is the part you can see. The 34 years are invisible: accumulated through failure, repetition, correction, and the ever slow development of judgment that no shortcut produces. Citibank wasn't paying for the napkin. But rather for everything that made the napkin possible.
Now, consider what exactly happens in a society where anyone and everyone can generate a logo in mere seconds. AI tools compress the distance between an idea and a polished output, between a question and a researched answer, between zero competence and the convincing appearance of one. The second has been democratized. Unlike the 34 years.
I’m gonna talk about that gap: between knowing nothing and knowing something so deeply it feels like intuition. About what it takes to cross it, what the process actually demands. And most crucially: what disappears when it’s skipped. And why, in our modern world, where producing an output has never been easier to fake, the people who did it the hard way might very well turn out to be the ones we’ll eventually have to call.
Historically, mastery is a word people use freely, but rarely with precision. It gets attached to six-month habits and morning routines and anyone who has gotten noticeably good at something in a short time. Used this way, it’s more motivational than meaningful. So before arguing about what AI does to mastery, let’s be honest about what it actually is. And what it isn’t.
Figure 1 maps the distinction:

The research on expertise isn’t romantic. It doesn't reach for words like passion or gift. Scholars in the field describe it as a sequence: motivated engagement, clear objectives, focused repetition, feedback that arrives in real time, and standards that must be demonstrably met before you move forward2. Not when you feel ready. But when the standard is met. Only then does the loop truly close.
What separates this from mere repetition is the quality of honesty inside it. A musician running scales without listening critically to the sound they're making isn't building mastery. Sure, they're accruing hours. But the loop only works when it's truthful.
And that truthfulness? It’s uncomfortable. Painfully uncomfortable. Genuinely corrective feedback tells you exactly what you got wrong. It asks you to sit with inadequacy long enough for your understanding of the problem to change. Most people find this, over time, intolerable. The ones who don't, tend to describe the experience not as enjoyment but as compulsion; something that pulled them back even when the results were painfully discouraging.
Phyllis Elago, a trained classical musician, now also a writer and translator, describes it with the precision of someone who has lived inside both disciplines:
"By doing it again and again and observing your results each time, you learn how to connect to your body and your brain so that you can do whatever you want at will. Then it becomes easy. Until then, if you are still suffering, the audience will suffer with you."
See, the thing is, research shows that the act of learning leaves a physical imprint on the brain, not simply an experiential one. Consider the landmark study of taxi drivers. The study found measurable growth in the part of the brain responsible for spatial memory, with volume increasing in direct proportion to years of experience3. In other words, expertise doesn’t accumulate as a larger catalog of techniques filed away for later use.
A chess grandmaster doesn’t calculate more moves than a novice; they simply look at the board differently from the first glance. Similarly, a seasoned musician doesn’t rely on trial and error to find key combinations; they already know which keys tend to work better with which. Decades of honest repetition and learning don’t just make you faster, it changes the way you look and what you see.
One can read about mastery, cite it, admire it from a safe distance. But it has to be lived through. The repetition, the failure, the small corrections, the incremental and often invisible progress. None of it is merely the road to the capability; it is the capability, being assembled slowly, in the only way it ever could be. It's easy enough to watch a seasoned pianist play Beethoven's Sonata No. 29 in B-flat major. Harder, to replicate it by simply knowing how to read the notes.

Now, to be very clear: none of this is an argument against AI tools. AI compresses the zero to one journey in specific, real, and when used consciously, quite often genuinely useful ways.
For example, a student learning to code gets instant feedback on errors that once required a teacher or a patient colleague. Or a designer iterates in minutes what once took days. And a junior analyst drafts in an hour what once consumed a week. These are not trivial gains and dismissing them wholesale is its own kind of intellectual dishonesty.
However, there is a difference between the compression of a process and the offloading of the cognitive work within the process. And therein lies the issue.
A recent study at Stanford’s Human-Centred AI institute put it plainly: students performed better on tasks when AI tools were made available to them. And once the tools were removed, the advantage disappeared entirely. More troubling still, the students who had grown accustomed to and reliant on the AI assistance - and then lost access, performed dramatically worse than their peers who had never used AI tools at all. In one measure of creative performance, they worsened by four times4. In essence, the access to AI tools quietly, but surely degraded the operator (the students).
The pattern holds beyond the classroom. Indeed, the Stanford 2026 AI Index found that engineers who leaned on AI for learning picked up “learning penalties” —measurable slowdowns in their independent development over time5. And open-source developers using AI assistance became, on certain complex tasks, slower than their counterparts working without the assistance. So the ceiling, as it turns out, is not access to tools, but rather the judgement to use them well. And judgement is precisely what the shortcuts are bypassing.
Kateryna Sazanova, an Emmy award-winning director and producer with well over twelve years across film, television, and digital production, describes it as a kind of readiness that only truly accumulates through repetition:
“Working on set is very concrete and tangible, with lots of moving parts, and everyone needs to be fully ‘on’,” she says. “Such experience cannot be replaced by reading or talking about it.”
Paula Scher didn't sketch that logo out of sheer talent or luck. She sketched it from her internalised decades of failed attempts, difficult client briefs, wrong directions, and most likely very painful corrections. It’s the accumulation of all those experiences that gives rise to taste, judgement, or that almost magical ability to know immediately what’s off. That kind of skill isn't stored in a file. It doesn't wait for the right moment to be needed. It either exists, built slowly through the loop, or it doesn't. An AI that produces a logo in a second doesn't contain Scher's 34 years.
It contains a statistical average of everyone else's. Do we want to simply be average? Had the majority of humans contented themselves with mediocrity, all these debates around AI might very well be moot.
As such, this is the more subtle danger, which goes largely unremarked in conversations around AI’s impact on work. Indeed, the concern most often voiced is displacement; that the tools will themselves take the jobs. But the quieter, more consequential concern ought to be substitution: people will use the tools to produce outputs they don’t fully understand, will have a hard time defending themselves, in domains they haven’t earned the right to navigate. A medical student who uses AI to arrive at a diagnosis without developing clinical reasoning isn’t a better doctor. Similarly, an architect who uses AI to generate a hundred options in a few hours without the taste to evaluate them isn’t a better architect. These are simply people holding and presenting outputs they can’t interrogate, in fields whose depth they haven’t entered.
The seconds are now on offer to everyone, and that alone really is extraordinary.
But what hasn’t changed is what those 34 years actually add up to. Or what quietly slips away when an entire generation decides the seconds are good enough and stops reaching for anything more.

Scale this up. What happens to one student, designer, or engineer compounds when it happens across whole cohorts, across industries, institutions, generations of people entering professions having produced outputs they were never required to fully understand. The individual cost of skipping the loop is a quieter kind of incompetence. The collective cost is something harder to name, slower to notice, and potentially irreversible.
The people closest to the technology have sensed it. The EY 2025 Work Reimagined Survey put it plainly: a significant portion of UK employees worry that AI is doing something to their capabilities they can't quite name; that "an overreliance on AI could erode their skills and expertise6.” These people aren’t outsiders looking in, nor are they critics with an agenda. Instead, these are people using the tools, seeing something happen to their own capabilities in a way that’s hard to articulate.
Now, the data, when it catches up, tends to confirm this experience. AI adoption at work has grown rapidly: 44% of UK employees now report using it at work7. But a closer inspection of the distribution is telling. Fewer than 5% are “using AI to fundamentally transform the way they work.8” The rest are producing faster, smoother, more polished versions of work whose underlying quality hasn’t moved, reiterating that access was never the ceiling. Judgement is; and that judgement is one thing the adoption statistics haven’t quite measured.
Navada Currie has spent a decade in design: across agencies, non-profits, freelance work, and nationally recognised campaigns in Australia, among them the World's Greatest Shave, which has raised over fifteen million dollars. She can see the difference:
“People who've taken the long road tend to bring a deeper level of understanding to their work. They're not starting from zero each time; they're drawing on years of practice, mistakes, references, and problem-solving. That depth becomes its own kind of shortcut."
According to her, the thing that shows up isn’t polish, but judgement. Shortcut-driven work can solve the more visible parts of a project brief, but it’ll struggle to survive the question of why:
"AI-generated branding can produce something decent-looking very quickly, but it often lands on the first obvious solution. A skilled designer will push beyond that — shaping something that connects to the brand's wider story."
Kateryna Sazanova, whose twelve years in film production and 2025 Emmy Award give her a particular vantage point on this, put it plainly:
“Now we see a flood of bad content. No matter what tools you use, it takes craft and mastery to produce a good story that will resonate, inspire, connect, give a new perspective, motivate for action and stay with the audience for a long time.”
Once you zoom out, the irony is kind of staggering. AI has made mediocrity effortless and excellence a lot harder to see. So when every student produces a polished essay, or a junior employee a competent presentation, or a designer a slick visual, the signal that once clearly separated deep capability from surface performance gets lost. And the noise rises. The people who actually made the hard journey become much harder to identify, and organisations can no longer tell the difference.
But most work requires a human touchpoint, be it a presentation, a defense, or a live critique; the gap reveals itself eventually. The tools didn’t create this dilemma. They’ve just made it far easier to avoid confronting, until the worst possible time.

Consider what the loop actually produces, beyond technical capability. It produces failure literacy: the ability to recognise when something is going wrong before it has fully gone wrong. It produces taste, which is just a fancy word for the accumulated weight of every bad decision made and eventually, corrected. Isn’t that the kind of confidence that doesn’t normally announce itself? Because it’s built on evidence rather than outputs? These things aren’t exactly transferable. Not exactly teachable in the conventional way. They accrue slowly through the loop, showing up in how a person moves through a problem and not simply by what a person produces. Hence why professional schools across disciplines don't just teach theory; medicine mandates clinical rotations, law builds moot courts, architecture runs studio critique, business runs live consulting cases. The form changes. The underlying principle doesn't.
Now put that person in a room with AI. They can generate a hundred options and immediately know which ones are worth pursuing. They can work from an AI draft and understand why something is almost right, but not quite... They can use the tool at speed and trust their own judgment about when the tool is failing them. The 34 years don't become irrelevant in that room. Rather, they become the only thing that matters. Again, this isn't a case against AI as a tool. It's a case for sequencing: for building enough to know what you're looking at before you ask a machine to generate more of it.
I want to be very careful. People who skip the loop aren't without ability. They can produce. Sure. What they struggle to do is evaluate, interrogate, and redirect— the work that happens after the output exists. And that is precisely the work that AI can’t do on their behalf, because that’s the work that requires a human to have a well-informed opinion about what excellence actually looks like.
In a world where the output has been democratized, judgment is the scarce resource.
It always was. It's just easier to see now.
Let’s return to that room with Scher: the executives, the napkin, the red arc over the t, the sketch that took a mere second, and the room that couldn’t see the 34 years standing behind it.
What they were looking at, without knowing it, was the product of a process so incredibly long and internal that it practically dissolved into invisibility: the failed pitches, the wrong directions, the arduous accumulation of knowing what doesn’t quite work and why—all of that compressed into a single, and quite frankly, unremarkable moment that only looked effortless because of everything it contained.
We live in a culture that has essentially built something that can replicate that moment: the sketch, draft, deck, diagnosis; generated, polished, delivered. Fast and clean and competent. And increasingly indistinguishable on the surface from the work of someone who’s spent years earning the right to produce something.
But surfaces are not the entire story. Frankly, when are they ever?
The question I want to leave you with isn’t whether to use the tools. Use them. The question is whether you’re building something underneath the tools’ usage; something that would survive if the tools disappeared tomorrow. Something that’s yours, assembled slowly through an iterative loop, through the long and often thankless distance between not knowing and knowing deeply.
That distance has a name. And I’d argue it’s worth every step.
[1] Paula Scher, Abstract: The Art of Design, Season 1, Episode 6, dir. Richard Press, Netflix, 2017.
[2] McGaghie, W.C., Issenberg, S.B., Cohen, E.R., Barsuk, J.H., & Wayne, D.B. (2011). Does simulation-based medical education with deliberate practice yield better results than traditional clinical education? A meta-analytic comparative review of the evidence. Academic Medicine, 86(6), 706–711. / Mastery learning framework: see also Bloom, B.S. (1968). Learning for mastery. Evaluation Comment, 1(2), 1–12.
[3] Maguire, E.A., Gadian, D.G., Johnsrude, I.S., Good, C.D., Ashburner, J., Frackowiak, R.S.J., & Frith, C.D. (2000). Navigation-related structural change in the hippocampi of taxi drivers. Proceedings of the National Academy of Sciences, 97(8), 4398–4403. https://www.pnas.org/doi/10.1073/pnas.070039597
[4] Lichand, G. et al., cited in: Stanford Human-Centred AI, AI Challenges Core Assumptions in Education, February 2026. https://hai.stanford.edu/news/ai-challenges-core-assumptions-in-education
[5] AI Index Steering Committee, Artificial Intelligence Index Report 2026, Stanford University, April 2026. https://www.starkinsider.com/2026/04/stanford-2026-ai-index-report.html
[6] EY 2025 Work Reimagined Survey, December 2025. https://www.ey.com/en_uk/newsroom/2025/12/uk-employers-miss-40-percentage-ai-gains-talent-gaps
[7] EY, "UK's AI Adoption Surges in Daily Life, but Lags Behind in the Workplace," EY AI Sentiment Index, 15 April 2025. https://www.ey.com/en_uk/newsroom/2025/04/ey-ai-sentiment-index-2025
[8] EY 2025 Work Reimagined Survey, December 2025. https://www.ey.com/en_uk/newsroom/2025/12/uk-employers-miss-40-percentage-ai-gains-talent-gaps
[Student IDEAS] by Karen Taubenberger and Michelle Diaz - Master in Management at ESSEC Business School
This article explores the legal and existential tension between generative AI and copyright law, arguing that the depletion of human-generated data poses a threat to AI’s own development. By analyzing cases like Kashtanova and Getty Images, it highlights the "grey zones" of authorship and the risk of "model collapse" when AI is forced to train on its own synthetic outputs. Ultimately, the author contends that protecting creators through new licensing models is essential to prevent a "world starved of creativity" and ensure a high-quality data supply for future innovation.
---
On March 25, 2025, OpenAI dropped a new image-generation feature with its GPT-4o release, stirring immediate controversy1. The tool lets users whip up stylized visuals that eerily mimic the signature styles of iconic studios like Studio Ghibli. Notably, co-founder Hayao Miyazaki, a fierce critic of AI art, slammed it as “an insult to life itself2”.
Similarly, the Writers Guild of America (WGA) went on a months-long strike in 2023 over fears that generative AI threatens writers’ livelihoods, halting production on numerous TV shows and films. At the same time, headlines have been flooded with copyright infringement claims during AI model training. All this seems to point to one thing: Generative AI has a copyright problem. In the mid- to long-term, this isn’t just a problem for creators: AI companies might feel the fallout too.
Generative AI (GenAI) refers to artificial intelligence systems designed to create original content, rather than just analyzing existing data. These systems generate new material by identifying and learning complex patterns from vast datasets using different techniques. For instance, they can understand and generate text by recognizing relationships between words (transformers3) or identify key features in images, sounds, or designs and use them to create new versions (autoencoders4). This ability to independently create instigates concern on who should be credited as the creator, how rights should be assigned, and whether such creations can be legally protected5.
Copyright was built for a human world, with its earliest statute dating back to 1710. Originally designed to protect “literary, scientific, and artistic works” such as poems, films, or songs6. It grants creators exclusive rights that fall into two categories: economic rights, which allow them to control and earn from the use of their work, and moral rights, which protect their personal connection by ensuring they are credited and can prevent changes that alter the original. In the EU, these protections last for 70 years after the creator’s death7.
Importantly, the moment you create something original, it’s protected. “All rights reserved” is applied automatically, no formal registration needed. However, one core principle underpins all copyright law: the author must be human.
That’s where things get complicated in the world of AI. For instance, if a programmer (a human) writes software code, that work is protected by copyright8. Similarly, if a human writes the training code that enables a machine-learning model to function, that code is protected. But what about the output of the model itself? Going forward, one of the most tricky issues will be around authorship and ownership of works created and co-created by AI.
Historically, copyright has been quite clear in terms of ownership. Whoever or whatever entity creates a certain piece of work/way of working clearly owns the rights so long as they are able to prove and register ownership. In a sense, there’s a clear thread between what is produced and the human/s that were involved in the production.
In an age where one can produce or create something that is not entirely human-made or can be a combination of both(purely human-made and co-created by AI), where do we draw the line? In 2023, the US Copyright Office made a clear stance on the sufficiency of human authorship required to be copyrightable. The US Copyright Office ruled on Kashtanova, a case on AI-generated imagery in creative works. The case involved a graphic novel that combined human-written text and imagery produced by Midjourney (AI image generator). Essentially, the Office ruled that it could not register the images, given that no matter how detailed the text-prompts were, the AI’s output remains unpredictable and therefore beyond the artist’s direct control. The Kashtanova case created a precedent and cases following it remained true to the strict requirement of human authorship: “human authorship is the bedrock requirement of copyright9.”
However, the US Copyright Office did not unilaterally dismiss the possibility that a human might be recognised as an author of an AI-generated piece of work. But the office didn’t exactly lay out clear guidelines either. To have a good chance of registering a claim of authorship, the human/s involved must either prove heavy involvement in the creation of the work (training input of the model, process, etc) or demonstrate sufficient human authorship10.
This leaves legal grey zones even in everyday life. Would one need to cite AI-generated images in a presentation for example? If they are not subject to copyright this should not be necessary (similar to an open source picture). But yet, a check of the citation requirements of different universities results in very different opinions on this matter (and also APA 7th or Chicago: citation styles used in academic writing, have no clear guideline).
Perhaps more complicated and difficult than delineating what combination and weightage of AI and human authorship combo can be protected by law, is the actual enforcement of the law itself. And whether the large-scale harvesting of organic (human created) works should be illegal under existing copyright laws.
Consider how a claimant might prove authorship of an AI-generated work. Or alternatively, how one might dispute the claim that a work is not AI-generated in some way. Where does the burden of proof lie? Proving an AI made something is difficult since the AI can give different results even with the same prompt, and AI companies refuse to take responsibility for their outputs. OpenAI’s terms mention “acknowledge that multiple users might receive identical or similar results”, while Microsoft's Copilot terms contain similar provisions11. This traceability problem matters most once a work goes public, since copyright protection and authorship only kick in when something is actually shared (aka diffusion). This inability to draw a clear line poses issues for users that seek to claim rights for commercial purposes.
This lack of clearly defined ownership further becomes problematic once you consider what happens to the data. Microsoft Copilot and similar services include terms that allow companies to use any data you upload to train and further improve their AI. In other words, users are not only unable to claim ownership of outputs, they also give the companies consent to use their own inputs to generate new content. Thus creating a double bind: you have no right to what the AI produces, and the company gains rights to everything you feed the AI. A clearly asymmetrical benefit.
Another case that highlights this issue is the legal battle between Getty Images and Stability AI. Essentially, Stable Diffusion, a product by Stability AI “was trained on 2.3bn images from a third-party website which pulled its training images from the web, including copyright image archives such as Getty and Shutterstock12.” Hence, the core question at the heart of the legal debate is whether this large-scale harvesting of organic (human created) images should be banned under the current copyright laws.
As of November 2025, Getty Images lost their copyright infringement claims, while narrowly winning trademark claims. In essence, the court arrived at these decisions since:
So how do you draw the line between necessary information usage and copyright infringement? Is it in the contention between how much AI is in a particular piece of work and how much human involvement is required? Or perhaps it comes down to technicalities like where the training occurs, as illustrated by the Getty Images case?
Or is it around the commercialization of the model, what is a fair price for the information a model uses for the monetisation of that information? Is it the ability of a model to generate “near verbatim” pieces of work14?
After all, LLM makers can easily deflect blame for problematic outputs by claiming users simply didn't prompt effectively enough. Since prompting has become an essential skill everyone is learning. In essence, the LLM companies can pass on blame to the users, since they did the prompting, and should therefore be responsible for the output. What a convenient way to shift accountability from LLMs providers to consumers; a classic attention economy dynamic where end-users bear responsibility as companies attempt to escape scrutiny.
Another vital consideration going forward with AI is the availability of data on which it is trained on, given the speed at which the foundational models are eating up data to continuously improve their output. As incentives for creators erode, original content grows rarer, while AI-generated material increasingly saturates the internet, feeding feedback loops.
According to a San Francisco-based AI research group, Epoch AI, at the current rate at which models are eating data, the total amount of human-generated content found on the internet could run out as early as 2026:

Graph (fig.1) illustrates the number of existing human-generated texts that are publicly available. And the different LLMs and the speed at which they’re digesting the information.
In essence, two main bottlenecks would be the overall availability of data, and the rate at which society produces genuinely-human created content (affected by the ease of producing AI materials rather than creating organic data given the lack of protections in place). With improvements in model scaling and computing efficiency the impact of these constraints can be slowed:

The graph (fig.2) shows the growth in training dataset sizes (measured in effective stock of tokens) against the available stock of data over time. It compares three scenarios—no overtraining (compute-optimal scaling), 5x overtraining, and 100x overtraining—showing that aggressive overtraining depletes the data stock much faster, potentially by 2025, while no overtraining delays exhaustion until around 2030.
But even with these adjustments, the data will still run out before 2030. This analysis mainly focuses on public human text data, but their estimates of the data available out there delineates all that exists:

This bar chart (fig.3) estimates how much usable data (in tokens) exists in different sources: Common Crawl, the indexed web, the entire web including private data, images, and video. It shows that the whole web and video contain the largest estimated data stocks, with substantial uncertainty ranges indicated by the error bars.
As publicly and legally available data becomes increasingly scarce, one can see a clear incentive for malicious behaviour to arise. From training on copyrighted data, to scraping content online without users explicit consent, adopting artistic styles of artists without permission. In fact, companies are already edging (some leaping, hello OpenAI, apologies Miyazaki) and pushing the limits on this. On April 14, 2025, Reuters reported that Meta (parent company of Facebook and Instagram) will start using the public posts, comments, and interactions of its users to train its AI models across all its platforms within the EU, effective on May 27, 202518.
Companies are also exploring other ways to bypass this major problem, such as generating synthetic data. AI-generated data would be a potential solution to the impending scarcity of data and a workaround to IP and privacy issues. Indeed, a plausible strategy could be having the AI models use “a technique called test-time compute in which the AI responds to a prompt by breaking it down into multiple tasks. Instead of spitting out an answer instantaneously, the model spends extra time “thinking” before generating an outcome.
These higher-quality responses could be turned into a new training data set for the AI, which in theory, could improve its responses19.”
Unfortunately, it’s not that simple. A study that looked into using synthetic data for training models revealed that the “model collapse” phenomenon can arise. This leads to lower-quality outputs being produced, which eventually circulate on the web and are later used as training data for future models. In the end, it could create a problematic loop that ends in the inevitable collapse of the model20. All this to say that we are currently at a stage where there seems to be a lack of viable solutions to address the rapid and wide consumption of organic data necessary for AI models to continuously improve.
As the seas calm from OpenAI’s controversial image-generation rollout and the echoes of the Writer’s Guild of America strike still linger, it’s clear that Generative AI has copyright problems. Miyazaki’s misgivings, the collective action of writers, and the uptake in infringement claims underscore the need for a solution. Not just for the sake of creatives, but for the continued advancement of AI as well.
Given the issues we’ve outlined above and the ongoing controversies surrounding the relationship between AI and copyright, it’s easy to fall into a dichotomy: human creators vs AI companies. Strong copyrights don’t just protect creators, they are also the backbone of innovation, incentivizing original work, which in turn prevents AI models from plateauing.
As copyright adjusts to an AI world, new models have to emerge to align the interests of creators of AI companies and creators. Imagine a system where creators could opt in to share their work, earn automatic royalties and let AI learn without infringing. A new marketplace that ensures that we never run out of original ideas. Disney’s and OpenAI’s recent $1 billion investment and licensing partnership, enabling Sora to generate fan-prompted videos and images from 200+ Disney, Marvel, Pixar, and Star Wars characters, illustrates one such win-win collaboration21. Copyright law needs to catch up fast, or we risk letting the next generation of AI to train on a world starved of creativity.
1. Generative AI Is A Crisis For Copyright Law. Forbes. April 2025. Available at: https://www.forbes.com/sites/hessiejones/2025/04/03/generative-ai-is-a-crisis-for-copyright-law/
2. ChatGPT’s Studio Ghibli AI Art Trend Is an Insult to Life Itself. Gizmodo. March 2025. Available at: https://gizmodo.com/open-ai-ghibli-trend-miyazaki-chatgpt-2000581679
3. A transformer model understands text by looking at a sequence of words at once and learning how the words relate to each other, which allows it to capture context more accurately than word-by-word approaches.
4. An autoencoder is a type of neural network that learns important features in data without labels (unsupervised learning) by compressing inputs into an efficient representation and then reconstructing the original input as accurately as possible from this compressed code.
5. Interactions Between Artificial Intelligence and Intellectual Property Law. Max Planck Institute for Innovation and Competition. Available at: https://www.ip.mpg.de/en/projects/details/interactions-between-artificial-intelligence-and-intellectual-property-law.html
6. Copyright history. Intellectual Property Rights Office. Available at: Copyright HistoryIntellectual Property Rights Officehttps://intellectualpropertyrightsoffice.org › copyright_...
7. Copyright - Your rights. Europa.eu. Available at: https://europa.eu/youreurope/business/running-business/intellectual-property/copyright/index_en.htm
8. Gaffar H., Albarashdi S. Copyright Protection for AI-Generated Works: Exploring Originality and Ownership in a Digital Landscape. Asian Journal of International Law. Published online on: 23 January 202. Available at https://www.cambridge.org/core/journals/asian-journal-of-international-law/article/copyright-protection-for-aigenerated-works-exploring-originality-and-ownership-in-a-digital-landscape/12B8B8D836AC9DDFFF4082F7859603E3
9. Human Authorship Requirement Continues To Pose Difficulties for AI-Generated Works. Perkins Coei. February 2024. Available at: https://perkinscoie.com/insights/article/human-authorship-requirement-continues-pose-difficulties-ai-generated-works
10. AI Can Create a Painting but It Can’t Register a Copyright in the Painting. Perkins Coei. May 2022. Available at: https://perkinscoie.com/insights/blog/ai-can-create-painting-it-cant-register-copyright-painting
11. AI and authorship: Navigating copyright in the age of generative AI. DLA Piper. February 2025. Available at: https://www.dlapiper.com/en/insights/publications/2025/02/ai-and-authorship-navigating-copyright-in-the-age-of-generative-ai
12. Art and artificial intelligence collide in landmark legal dispute. Financial Times. January 2023. Available at: https://www.ft.com/content/d691d599-3cdb-48d8-9824-9b2784a17d90
13. Getty Images v Stability AI: Getty’s copyright case against Stability AI fails. Pinsent Maisons. November 2025. Available at: https://www.pinsentmasons.com/out-law/news/gettys-copyright-case-against-stability-ai-fails
14. NYT v. OpenAI: The Times’s About-Face. Harvard Law Review. April 2024. Available at: https://harvardlawreview.org/blog/2024/04/nyt-v-openai-the-timess-about-face/
15. Will we run out of data? Limits of LLM scaling based on human-generated data. Epoch AI. June 2024. Available at: https://epoch.ai/blog/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data
16. Will we run out of data? Limits of LLM scaling based on human-generated data. Epoch AI. June 2024. Available at: https://epoch.ai/blog/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data
17. Will we run out of data? Limits of LLM scaling based on human-generated data. Epoch AI. June 2024. Available at: https://epoch.ai/blog/will-we-run-out-of-data-limits-of-llm-scaling-based-on-human-generated-data
18. Meta to use public posts, AI interactions to train models in EU. Reuters. April 2025. Available at: https://www.reuters.com/technology/artificial-intelligence/meta-use-public-posts-ai-interactions-train-models-eu-2025-04-14/
19. Data Is Fueling the AI Revolution. What Happens When It Runs Out?. Cal Alumni Association. March 2025. Available at: https://alumni.berkeley.edu/california-magazine/online/data-is-fueling-the-ai-revolution-what-happens-when-it-runs-out/
20. Shumailov, I., Shumaylov, Z., Zhao, Y. et al. AI models collapse when trained on recursively generated data. Nature. Published online: July 2024. Available at: https://www.nature.com/articles/s41586-024-07566-y
21. The Walt Disney Company and OpenAI reach landmark agreement to bring beloved characters from across Disney’s brands to Sora. OpenAI. December 2025 Available at: https://openai.com/index/disney-sora-agreement/
[Student IDEAS] by Varun Jain - Master in Management at ESSEC Business School
This article examines why banks have yet to fully adopt blockchain despite its transformative potential. It identifies key barriers - regulatory uncertainty, legacy infrastructure, and operational challenges like interoperability and network effects. Through case studies and analysis, it explores how banks might overcome these issues via regulatory sandboxes, hybrid blockchain models, and internal use cases. Ultimately, the path forward depends on global regulatory alignment, modernization of systems, and industry-wide collaboration.
---
Banking is a fundamental pillar of our economy that aids in activities such as lending, trading, and payment processing. This industry, however, has a long history of relying on established traditional systems and processes, often taking a measured approach when it comes to new technology. Enter Blockchain: a transformative force poised to redefine the finance industry.
Blockchain, the groundbreaking technology behind cryptocurrencies and DeFi (Decentralised Finance) products, is igniting a revolution in the finance industry. Its decentralised, transparent, and secure nature promises streamlined, efficient transactions, potentially cutting through the complex layers of traditional banking procedures.
Yet, as blockchain and blockchain-powered services keep on captivating, the banking sector seems to linger at the edges of this technological revolution. Despite the initial excitement, widespread adoption has been slower than anticipated. Why aren’t these financial powerhouses diving in headfirst? Is it a matter of regulatory concerns, technological incapacity, outdated infrastructure, or something else entirely? Do potential solutions and strategies exist that can help banks overcome these challenges? Or are the problems so fundamental that the promise of blockchain in banking is ultimately unattainable? In this article, we explore the barriers holding banks back from fully embracing the blockchain revolution and chart potential pathways toward widespread blockchain adoption in the financial sector.
Banks are, at their core, the institutional risk managers of the modern economy. They do far more than simply hold deposits or extend credit; banks facilitate payments, allocate capital, and underpin the trust that enables commerce at scale. By verifying identities, assessing credit worthiness, enforcing contracts, and ensuring regulatory compliance, banks create the trust necessary for economic activity to flourish at scale. This intermediation is what allows capital to flow efficiently, payments to settle reliably, and businesses to transact across borders and legal systems.
Yet, the very mechanisms that have made banks indispensable - layers of documentation, compliance checks, and manual reconciliation - comes with significant operational complexity. Traditional banking processes - especially in areas like trade finance, cross-border payments, and compliance - are often slow and burdened by extensive paperwork and multiple layers of verification. These legacy systems, designed to minimize risk and satisfy regulatory requirements, can result in lengthy settlement times, increased costs, and a higher likelihood of errors or delays. The very mechanisms that have made banks reliable intermediaries can also make them less agile in a rapidly digitizing world.
Blockchains are digital ledgers where transactions are stored securely and transparently. Each "block" of information is linked to the previous one, making a "chain" that is extremely hard to tamper with. In easier words, it is like a notebook that everybody can read and write in, but once anything is written, it cannot be removed or changed.
Three salient features define blockchains. A blockchain is decentralized. Instead of being managed by a central authority like a bank or a government, it is maintained by a network of computers. It is transparent, as all transactions on blockchain networks are visible to everyone. Finally, it is immutable because any transaction cannot be changed once recorded on the blockchain. These properties of blockchains have substantial potential in banking. It can streamline processes by automating verification and settlement, reduce the need for manual reconciliation and paperwork, and minimize errors through tamper-proof recordkeeping. In doing so, blockchain could enable banks to deliver faster, more efficient, and more transparent services—helping them maintain their critical role in the economy while adapting to the demands of a digital era.
There are many ways banks can leverage blockchains; these innovations can be classified into 3 main, although sometimes overlapping, categories:
1. Efficiency-focused improvements using blockchain: A good example of this is Trade Finance. The paperwork and lengthy processes involved in settling transactions between banks and trade entities can be digitized and tracked step-by-step on a blockchain, thereby speeding up the process and enabling businesses to expand their reach into international markets swiftly. Blockchains, being a Digital Ledger, can be used to store these transactions and processes digitally. Its transparent nature allows for complete visibility for parties involved, whereas its secure and immutable nature establishes trust in the process1. Recently, HSBC has successfully been able to reduce the processing time for such transactions from 5-10 days to less than 24 hours using blockchain technology2.
2. Adoption of existing services on blockchain: Cross-border payments represent a significant opportunity for blockchain to make an impact. By leveraging its decentralized nature, a blockchain-powered payment system can reduce unnecessary intermediaries, allowing for secure and fast transactions. A Distributed Ledger Technology (DLT) with transactions using a digital cryptocurrency instead of traditional currencies can help speed up the process. In use cases such as cross-border payments, cryptocurrencies (or digital currency, both are used interchangeably in this article) are used as a proxy to transfer the funds between banks and intermediaries, and their digital and transparent nature ensures trust and efficient processing.
3. New Products based on blockchain technologies: Banks have attempted to launch new products using blockchain, including digital currencies and digital bonds, to explore the technology and find more effective, quicker methods for performing traditional functions. These products are, more often than not, stablecoins that are used as a proxy to real currencies (such as the US Dollar). Stablecoins are digital currencies that are pegged to an actual currency and used as a faster and secure alternative to real currencies. Some examples are JPM Coin, which is pegged to the US Dollar and used as a digital currency to facilitate interbank payments. They enable real-time, programmable transactions - by acting as a proxy for traditional currencies - while bypassing the legacy systems that traditional currencies need to go through to finish settlement.
Harnessing the power of Blockchains in banking not only helps organizations improve processes, but as a direct result, improves the banking experience and quality of life for its retail consumers like us. Faster processing, less human intervention and secure transactions have the potential to make banking hassle-free, cheaper and quicker3. Improved accountability, transparency, enhanced security and reduced frauds - the other benefits of blockchain driven solutions - can potentially impact the broader trust and access to banking and financial services for the underserved section of the society.
It is critical to note that most of the supposed benefits - like faster payments, lower fees, and greater transparency - remain largely theoretical at this stage. In principle, blockchain could streamline transactions by cutting out intermediaries, potentially reducing costs and processing times. The promise of improved transparency, since transactions on a distributed ledger are visible and auditable by design. This, arguable, could enhance trust and security, making it harder for bad actors to manipulate records.
However, these improvements are far from guaranteed at this stage. The actual consumer experience depends on how banks and payment providers implement blockchain, and whether they pass any savings or efficiencies on to end users. That said, there are clear upsides to unlocking these benefits - if even a fraction of these promised improvements materialize, the way we interact with financial services could look very different - and for the better.
The aforementioned possible innovations present a strong case for investing in this technology to potentially reimagine the industry. So we arrive at the central question: why are banks not treading this path? Why has the blockchain revolution not exploded in banking? What prevents them from fully adopting blockchain?
To their credit, many banks have recognized the potential of blockchain and have implemented, to varying degrees of success, some prominent innovations in this area. While some of these have enjoyed a fair bit of success, most of these innovations fall short of reaching mainstream implementation.
In the following sections, we deep dive into three major challenges a blockchain innovation faces in a banking context. Using real-life case studies, highlighting key concerns, winners and losers, we will explore and understand the future implications and potential solutions in overcoming these issues.
Financial governing bodies worldwide are striving to understand cryptocurrency and the DeFi ecosystem. There is still significant confusion surrounding these new "currencies" because they function fundamentally differently from traditional money, which has been around for hundreds of years, with the international system of payments almost 100 years old now. Consequently, the regulatory guidelines on digital currencies and related assets - should they be classified as securities, commodities, or something entirely new? - remain unclear4. As a result, the rules for regulating the exchange of digital currencies and their interactions with the broader financial environment are still unresolved, particularly when it comes to who is responsible for safeguarding digital assets, and how these assets should be valued, reported, and taxed on financial statements.
In the banking world, several activities involve transactions with other banks and institutions - these could be either to transfer currencies from one account to another, short-term borrowing/lending or forex transfers. Because these currencies reside in the databases running within each of these institutions, communication between these "islands of data" requires convoluted and ineffective reconciliations and settlement processes. As a result, several initiatives have been undertaken to use digital currencies (specifically, stablecoins) to quicken inter-bank transactions. DLTs like blockchain have a direct application here. Unfortunately, the regulatory standards, frameworks and guidelines regarding stablecoins are nebulous at best. Regulatory agencies, for consumer protection and institutional risk related reasons, have been actively trying to install guardrails around stablecoins; a proposed stablecoin regulation by the Biden administration was introduced to allow only federally insured depository institutions to issue them, essentially preventing them from being used in several critical use-cases5. While regulations like these have the potential to make stablecoins tightly regulated and safer for integration with existing banking functions - making their adoption easier at first - but the high regulatory bar makes it almost impossible for outside players to invest and drive innovation in this sector. This has a broader impact on the cryptocurrency market - as transferring traditional money to cryptocurrencies is generally carried out by using stablecoins like Tether. On the banking side, this unlocks certain barriers, while installing certain others. A clear balanced regulatory approach is still needed to make stablecoins adoption and usage more safer, secure and inclusive for institutions and innovators alike.
Furthermore, usually, banks leverage blockchains and networks of established digital currency technology partners to power their use cases. This exposes them to the regulatory risks concerning these partners. Santander, a Spanish multinational financial services company, famously launched their cross-border payments systems in association with Ripple, a leading blockchain solutions firm, leveraging their blockchain network and expertise in this area. This not only requires Santander to navigate the cross-border compliance policies, anti-money laundering (AML) requirements and Know-Your-Customer (KYC) policies, but also exposes it to the various regulatory challenges faced by Ripple itself, particularly related to the cryptocurrency powered by its blockchain - XRP. XRP is at the heart of Ripple’s ecosystem, which acts as a substitute to local currencies to facilitate cross-border transactions. This behavior, even though it provides much faster and efficient transaction settlement than traditional methods, has drawn regulatory scrutiny, especially in the United States - where concern over whether to classify it as a security has led to lengthy legal battles. When partnering with organisations such as Ripple, Santander exposes itself to such legal and regulatory risks that come with digital assets like XRP. This highlights the importance of firm regulatory guidelines regarding cryptocurrencies - these will not only help banks issue them in a more secure manner, but also help them partner with other organisations with more reliance and trust.
Banks and legislative bodies have come together in recent years to clear the regulatory air around digital assets and provide a platform for institutions to leverage them in a way that balances innovation with compliance.
One of the biggest advancements in this area is the concept of Regulatory Sandboxes. These frameworks enable businesses to test innovative products, services, or business models in real-world settings while under the supervision of regulators. Operating with temporary regulatory relief, these environments allow companies to explore new technologies with minimized legal risks. This approach serves a dual purpose: it provides businesses with a platform for rapid innovation and allows regulators to anticipate new policies and challenges by observing emerging technologies in action. The EU and the UK are at the forefront of this initiative, having launched industry-focused sandboxes like the UK's Digital Securities Sandbox and the EU's DLT program to guide financial innovations6.
In certain cases, banks have invested in creating custom blockchain networks specifically to facilitate financial transactions. These 'consortium' blockchains, which are collaborative platforms managed by a group of organizations, are designed to effectively balance control, access, and scalability concerns, making them a preferable solution to traditional public blockchains. Banks need to focus on balancing appropriate levels of access, consensus mechanisms, and security protections while assessing the costs and benefits of implementing blockchain technology. By adopting these consortium blockchains, banks can proactively navigate regulatory challenges while also leveraging the benefits of a trusted technological framework. Examples of these consortium blockchains, such as the R3 Corda platform and JP Morgan's Quorum, highlight their successful utilization by financial institutions worldwide, showcasing the potential of blockchain technology within the banking sector.
A 2024 Forbes survey revealed that 55% of banks cite legacy systems as a key obstacle to digital transformation7. These systems, often based on outdated programming languages like COBOL, struggle to support real-time payments, AI-driven analytics and automated compliance checks.
As financial organizations face increasing pressure to modernize and innovate, their over-reliance on legacy systems and cultural resistance to digital transformation present significant hurdles. These challenges not only affect the implementation of blockchain solutions but also hinder the adoption of less technologically intensive innovations like real-time advanced analytics.
Another key aspect at play is talent. Blockchain expertise is scarce, and the industry requires specialized knowledge to implement innovations at scale. Given the numerous regulatory, security, and operational risks, banks must invest significantly in hiring and training qualified personnel.
A significant technical hurdle for blockchain technology is its inherent scalability concerns, which refer to the ability of a blockchain to process transactions at a faster rate. By design, more secure blockchains tend to be less scalable—a concept illustrated by the "Blockchain Trilemma," which highlights the necessary trade-off between scalability, decentralization, and security8. Consequently, a blockchain cannot achieve all three simultaneously. While blockchains provide decentralized trust and security, they encounter notable challenges in scaling their operations, an issue that is intrinsic to the technology itself rather than limited to the banking sector.
Scalability limitations are a critical obstacle to the widespread adoption and utility of DLTs. Without addressing these challenges, blockchains risk being relegated to niche use cases rather than serving as the backbone for broader banking applications like digital identity or supply chain tracking. To truly enable mass adoption, blockchain developers need to find innovative solutions to overcome scalability hurdles9.
What is often overlooked in this debate is that the trilemma isn’t just a technical puzzle - it is a cost problem too. The more a blockchain leans into security and decentralization, the more expensive it becomes to scale. High security means more computational resources, more validators, and more energy consumption, all of which drive up the cost. Attempts to boost scalability can reduce costs, but often at the expense of either decentralization or security. For banks, this means that even if the technology matures, the economics may still be prohibited for anything beyond niche applications.
Data privacy concerns are a frequently discussed issue with blockchains. Transparency, a key tenet of DLTs, directly conflicts with strict data privacy regulations in the banking sector, such as GDPR, which mandates rigorous control over the storage, access, and sharing of data. Each transaction on the blockchain requires validation - or, in blockchain terminology, reaching a consensus - by its members, who, ideally, possess all necessary information for validation. This requirement risks violating data privacy standards.
The core issue is twofold. First, there is a need for technological solutions that enhance the opacity of blockchain transactions while maintaining a secure consensus mechanism. Second, regulatory adjustments are necessary to redesign privacy standards with DLTs in mind. Various solutions have been developed to tackle the first challenge, collectively referred to as Hybrid Blockchains. These combine public and private blockchains - the difference being in the ownership and access to the network. A public blockchain is fully transparent, where anybody can join, read, write and validate transactions on the chain, such as Bitcoin. A private blockchain, on the other hand, is controlled by a single organization or a group of trusted entities. Only approved participants can access, validate, or add data to the network. Private blockchains are often used by businesses or banks for internal processes, offering more control and privacy but less decentralization than public blockchains. A combination of public and private networks, hence, allows organizations to retain sensitive information on a private chain while keeping only the essential data for validation on the public chain. While this approach adds complexity and raises interoperability concerns, it strikes a balance between transparency and privacy. Ultimately, hybrid blockchains hold significant potential for the banking sector - by designing a more centralized infrastructure, they enable scale and security, as established by the blockchain trilemma. They provide a reasonable solution for cost as well, as sacrificing decentralization for security reduces the need for more cost-intensive solutions that rely on changing the deeper functioning of blockchains10.
JPMC's Quorum is a successful implementation of a large-scale Blockchain Initiative. This permissioned blockchain protocol, based on Ethereum, offers features such as transaction privacy, the ability to execute private transactions and smart contracts, support for multiple consensus mechanisms, and flexible network permissions management. Essentially, Quorum is a modified blockchain developed specifically for financial institutions and their unique use cases.
Like other innovative technologies, Quorum has faced technical challenges, including data privacy, scalability, and standardization. A lack of knowledge about blockchain technology has hindered adoption and the creation of a global regulatory framework. Security breaches pose a constant threat, largely due to human errors related to this knowledge gap rather than flaws in the core technology.
However, through continuous efforts, investments, and visionary leadership from the Quorum team, this system has been successfully implemented, providing banks with a secure platform to launch their proprietary blockchain projects. Addressing these technological barriers requires ongoing investment and time for blockchains to become commonplace in the banking sector.
Traditional banking processes are slow due to multiple intermediaries involved in inefficient information exchanges. This challenge is especially pronounced in specific use cases like Trade Finance, where extensive documentation and a lack of streamlined Customer Due Diligence lead to delays.
Blockchain technology offers a promising solution for these issues. "Smart Contracts" - digital contracts that are written in code - are engineered to facilitate, execute, and enforce agreements using blockchain, helping to reduce information asymmetries between parties. The involved parties can use the transparent architecture of blockchains to view real-time updates of the concerned trade. Moreover, this technology can streamline payments and regulatory processes across use cases, marking one of the most significant improvements that blockchain can bring to banking11. For example, they can be used to automatically release payments once the goods are confirmed as delivered on the blockchain, reducing the need for manual intervention - streamlining the process and reducing the risk of disputes.
In 2019, HSBC launched Serai, a trade finance solution based on a distributed ledger platform designed to connect suppliers with buyers and digitize transactions. Another significant initiative, we.trade, was owned by European banks and powered by IBM. However, both of these efforts were eventually shut down due to commercial infeasibility.
The main challenge was adoption. Without all parties involved in a transaction using the blockchain, the additional benefits of the technology diminish. This scenario is reminiscent of the inefficient Nash Equilibrium in game theory; there is little incentive to become an early adopter. This phenomenon contrasts with the typical adoption pattern of disruptive technologies, where early adopters lead the industry, attracting more users until a critical mass is achieved that makes the innovation commercially viable. The lack of interoperability among blockchains further limits the scalability of these initiatives12.
In our smart contract use case, if one party lacks direct access to the blockchain containing the contract, they must rely on facilitators, such as banks, to provide alternative means of access. This process involves bringing information down from the blockchain, which not only decreases efficiency but also introduces security concerns. Consequently, this deters all parties from continuing to use the solution, as the inefficiencies it was meant to address persist. This leads to decreased usage, abandoned solutions, and disheartened early adopters, reducing the incentive for future innovations.
Many applications restricted within a banking ecosystem can effectively bypass these issues, as demonstrated by Wells Fargo’s internal settlement blockchain solution. Wells Fargo Digital Cash enables the bank to settle internal transactions between its overseas branches without relying on traditional methods like wires or SWIFT. This solution not only accelerates settlement speed but also eliminates transaction fees typically charged by payment facilitators. SWIFT and Wire transfers typically charge 1-5% of transfer amount, along with some flat fees. These fees are attributed to multiple intermediaries, in case of SWIFT, or to higher manual intervention, in case of wires. Due to the same reasons, they take anything from 1 day to a week to settle. Blockchain solutions are dramatically cheaper and near-instant - particularly because of reduced need for intermediaries and manual input, some studies quote a reduction of cross-border payment costs for banks by up to $10 billion globally in 203013.
“When we move money across the world and we need to exchange currencies, we have to go through third parties such as SWIFT and other banks,” explained Lisa Frazier, head of the Innovation Group at Wells Fargo. “That’s a long process, and every time there's a connection with external parties, it takes time and energy and effort.” Wells Fargo utilizes R3's Corda enterprise blockchain for these digital transactions. Since there are no external participants involved, they encounter significantly fewer interoperability issues and maintain greater control over the transactions. Additionally, using a popular and stable consortium blockchain helps them navigate many regulatory and technical challenges.
Wells Fargo plans to move beyond internal transactions and introduce an FX cross-border solution similar to Santander, but scalability issues related to interoperability remain a challenge. They are currently collaborating with HSBC, another leader in the banking industry, pioneering blockchain solutions, to settle matched cross-border transfers for a set of currencies. A holistic solution, potentially completely revolutionizing international payments settlements, is far away in the future, if at all.
In conclusion, while blockchain technology holds revolutionary potential for the banking sector, significant challenges persist in its deployment and scaling within the current landscape. Lawmakers and financial institutions must undertake major efforts to pave the way for the full realization of this technology's benefits.
Regulatory bodies need to come together to lay the foundation of a necessary legal framework to govern decentralized finance and cryptocurrencies. Only then will the banks be able to move forward with enough confidence and invest the requisite capital to drive innovation in the sector. These bodies must address jurisdiction, recognition and privacy issues related to DLT technologies. The solutions should first be rolled out at national or regional levels and eventually spread worldwide.
Lawmakers worldwide should look towards legislative bodies which have been successful in providing a favorable regulatory environment for innovative blockchain implementations. Countries like Japan, Singapore, the EU, and Switzerland foster innovation through favorable regulations that recognize cryptocurrencies, guide AML and KYC compliance, and stimulate a vibrant startup ecosystem. Even if the regulations are strict, especially considering data-privacy issues, the regulatory landscape is explicit enough to guide developers and institutions to drive blockchain-led projects. Countries like China, despite banning the trading of cryptocurrencies, provide regulatory guidelines for exploring enterprise-level blockchain innovations14. The heavy focus on data privacy and security issues requires developers and institutions to be especially wary of these challenges while driving innovations.
One of the biggest challenges to digital transformation in banking is the deeply embedded legacy systems, which are not only difficult to upgrade but also pose security risks. However, the emergence of AI offers promise, as it can help banks develop strategies to overcome these challenges and create a "do-or-die" scenario for modernization. With the enormous popularity of AI, banks are expected not only to integrate it throughout their workflow but also to leverage its capabilities to ensure compliance with regulatory standards. This will lead the way for capabilities that can drive blockchain innovations in tandem, enhancing efficiency and security across transactions.
Many banks are exploring use-cases that leverage a combination of AI and blockchain technologies, such as using blockchain to record identities alongside employing AI to enhance fraud compliance15. Blockchain could be significantly impacted by advancements in AI, though the actual integration may vary across the banking sector. Even in best-case scenarios, there are concerns about how long it will take for banks to be ready and whether a lack of investment in this technology will arise due to delays and technical transformations these projects demand.
Organizational challenges persist as deeply embedded legacy systems complicate upgrades and create security risks for banks. Although some banks have successfully integrated blockchains for internal processes, the real value lies in their ability to reduce paperwork and improve transparency in areas like trade finance and cross-border payments. Interoperability is crucial for banking institutions, and insufficient early adopters will hinder the widespread adoption of blockchains. There is a critical need for ‘Blockchain Interoperability’ in the banking sector due to the ability of various blockchain networks to communicate effectively, which is largely hindered by fragmented regulations worldwide.
Blockchain interoperability refers to the capability of various blockchain networks to exchange information and utilize each other's functionalities. It enables seamless data and asset transfers across various blockchain platforms, improving transaction efficiency and security while eliminating intermediaries. Current projects focused on cross-chain communication protocols aim to connect different blockchain networks, empowering banks to share data even without a common network. In the smart contract use case, atomic swaps utilize cryptographic techniques to facilitate the transfer between parties across different networks. Developing interoperability platforms, which allow for cross-chain protocols and atomic swaps, will significantly facilitate the widespread adoption of blockchains despite the current fragmented regulatory landscapes. Certain recent projects, such as Polkadot and Cosmos, are already trying to enable this blockchain interoperability to facilitate inter-chain transfers.
Finally, it is important to note the interconnectedness of these barriers - these challenges reinforce one another, and addressing any single one can alleviate related challenges, leading towards comprehensive solutions. This is where the ultimate solution lies.
Interoperability, for example, is largely dependent on the fragmented regulations across the world. If the regulatory bodies align on standardized blockchain guidelines, banking institutions across the world would be able to develop solutions with similar security and privacy features. These standardized blockchain networks that comply with stated regulations are necessary for effective growth and operation across various financial institutions. Adhering to aligned regulations, these would be easier to integrate, driving cross-platform connections and lowering security risks.
In a similar vein, a global digital upgrade of legacy banking systems aims to facilitate blockchain solutions, helping ensure compliance with regulations. This modernization will enhance the interoperability of these platforms, significantly boosting user adoption across various markets. A standardized regulatory landscape allows cohesive technological frameworks, facilitating interoperability that encourages widespread adoption.
Standardized regulations, technology, and operational processes are critical for widespread adoption and the gradual reimagining of the banking landscape. Evidence supporting standardized regulations can be found in the European Union, demonstrating a commitment to effective blockchain governance. The EU serves as a pivotal testing ground for standardized regulations on blockchain implementations across varied nations. These examples demonstrate that overcoming barriers significantly enhances banking experiences and paves the way for future innovations in blockchain technology.
In conclusion, as the banking industry stands at the crossroads of tradition and innovation, the potential of blockchain technology to revolutionize financial systems cannot be overstated. While challenges such as regulatory hesitance, operational inefficiencies, and technological barriers remain significant, the benefits of adopting standardized practices and collaborative frameworks are clear. By addressing these issues through organizational change, investment in technology, and global compliance standards, banks can navigate the complexities of this transformation. As we move forward, embracing blockchain not only promises to enhance operational efficiency but also to create a more secure, transparent, and efficient banking landscape, ultimately fostering a brighter future for the global economy.
[1] Appinventiv. (2024). How is Blockchain in Banking Transforming the Industry? Retrieved from https://appinventiv.com/blog/blockchain-in-banking/
[2] HSBC UAE. (2023). Blockchain – Transforming the future of trade finance. Retrieved from https://www.hsbc.ae/business-banking/insights/blockchain-trade-finance/
[3] Investopedia. (2023). Blockchain Facts: What Is It, How It Works, and How It Can Be Used. Retrieved from https://www.investopedia.com/terms/b/blockchain.asp
[4] Cato Institute. (2023). Opening the Door to Cryptocurrency Innovation by Eliminating Unnecessary Regulatory Barriers. Retrieved from https://www.cato.org/commentary/opening-door-cryptocurrency-innovation
[5] Selgin, G. (2023). A Simple Proposal for Regulating Stablecoins. Cato Institute. Retrieved from https://www.cato.org/commentary/simple-proposal-regulating-stablecoins
[6] Deloitte. (2023). How Regulatory Sandboxes Foster Innovation and Compliance in Crypto. Retrieved from https://www2.deloitte.com/global/en/pages/financial-services/articles/regulatory-sandboxes-crypto.html
[7] Forbes. (2024). Core Banking Crisis: 55% of Banks cite Legacy Systems as the top barrier to transformation. Retrieved from https://www.forbes.com/sites/forbestechcouncil/2024/01/15/core-banking-crisis/
[8], [10] Hedera. (2023). Blockchain Scalability Solutions. Retrieved from https://hedera.com/learning/what-is-blockchain-scalability
[9] Banerjee, T. (2022). Blockchain Implementation Challenges for IoT. In Blockchain (pp. 73-85). Chapman and Hall/CRC
[11] ConsenSys. (2023). The Ultimate Guide to Understanding Smart Contracts. Retrieved from https://consensys.net/knowledge-base/smart-contracts/
[12] IBM. (2023). Blockchain Interoperability: Future of Seamless Integration. Retrieved from https://www.ibm.com/topics/blockchain-interoperability
[13] Juniper Research. (2023). Blockchain to Facilitate Savings of $10 Billion Globally in Cross-border Payments. Retrieved from https://www.juniperresearch.com/press/press-releases/blockchain-savings-cross-border-payments
[14] Cointelegraph. (2023). Revealing Blockchain Regulations By Country: Insights & Challenges. Retrieved from https://cointelegraph.com/news/blockchain-regulations-by-country
[15] Forbes. (2024). GenAI: 15 Practical, Impactful Applications For Startups. Retrieved from https://www.forbes.com/sites/forbestechcouncil/2024/02/10/genai-15-practical-applications/
[Student IDEAS] by Minseo Ku - Global BBA at ESSEC Business School
This article explores how luxury hotels can integrate AI tools - like virtual concierges and predictive personalization - without sacrificing the emotional warmth that defines high-end service. Through industry case studies, it examines the benefits, risks, and ethical challenges of automation, arguing for a balanced, human-centered approach to tech in hospitality.
---
In the ever-evolving landscape of luxury hospitality, artificial intelligence (AI) has emerged as both a powerful tool and a subject of debate. Historically, five-star hotels and upscale resorts built their reputations on high-touch, emotionally engaging service—the hallmark of a truly memorable guest experience. Yet in today’s digital era, where contactless check-ins and virtual concierges are becoming normalized, the question arises: Can AI-driven systems elevate this experience without eroding the personal connection that defines luxury hospitality? This article aims to explore how hotels can navigate these opportunities and challenges to strike a thoughtful balance between advanced technology and the warm, personalized care that discerning travelers expect.
Luxury hospitality is characterized by bespoke service, where staff members anticipate and respond to guests’ unstated needs. Personal rapport, empathy, and emotional intelligence lie at its core. A butler who remembers a returning guest’s favorite in-room snack, or a concierge who greets travelers by name, exemplifies this high level of individual attention. When guests select a luxury property—be it a major hotel chain like Four Seasons or a boutique retreat—they expect more than clean rooms or basic amenities. They seek exclusivity, meaningful connections, and sometimes a sense of belonging.
Despite the intimate nature of the sector, the shift toward automation and AI has gained momentum due to its benefits. The major gain would lie in its enhanced operational efficiency. Automated check-ins and chatbots have helped reduce wait times and streamline tasks that might otherwise consume staff resources (Ivanov & Webster, 2019). On top of that, AI-based data analysis helps predict guest preferences—from pillow types to dining choices—enhancing customized service. The changing guest demographics also play a role in such shifts, as younger, tech-savvy travelers often appreciate digital convenience features, making hotels eager to adopt new solutions. While these benefits are clear, they raise pressing questions about the intimacy and personal touch that distinguish a luxury stay from a standard one (Lu et al., 2020).
Luxury hospitality has adopted a wide array of AI-powered tools to enhance operational efficiency and service consistency. One of the most prominent applications is automated check-in. Through self-service kiosks or mobile apps, guests can bypass the front desk and enjoy faster, smoother arrivals. This is not just a theoretical advantage; Hilton Worldwide has reported a 40% reduction in lobby congestion following the rollout of its digital check-in system (Hilton Worldwide, 2023).
Another major AI-driven feature is the use of virtual concierges. These chatbot systems are designed to operate 24/7, assisting with tasks such as restaurant reservations, local attraction recommendations, or answering frequently asked questions. Radisson Hotel Group’s chatbot, for instance, now handles up to 60% of guest queries, freeing up staff to focus on more complex and emotionally nuanced interactions (Radisson Hotel Group, 2022).
Additionally, predictive analytics powered by AI allows hotels to tailor services based on guest data. This includes anticipating preferences related to room temperature, dietary restrictions, or spa appointments. These tools enhance speed and personalization, which are essential in meeting the expectations of today’s discerning travelers.
Each of these tools contributes to greater speed, consistency, and operational agility. However, the effectiveness of these solutions depends not only on their technical performance but also on how well they complement—rather than replace—human warmth. As such, luxury hotels must ensure that technological innovation remains a tool to empower, not overshadow, the emotional dimension of hospitality.
Counter to the idea that everyone craves face-to-face interaction, some guests might prefer minimal staff contact—particularly high-profile travelers who value privacy. In these scenarios, AI can be an advantage. However, there remains a segment of clientele for whom genuine conversation and empathic staff engagement create a sense of belonging that no algorithm can replicate. A successful implementation strategy should account for both guest types, offering flexible options and personalized approaches rather than forcing a one-size-fits-all solution.
The emotional resonance and personal attention offered in luxury hospitality set it apart from mid-range offerings. A staff member’s ability to empathize and read subtle cues—a sigh that indicates the guest had a rough travel day, or an enthusiastic mention of a local cuisine—are intangible yet critical. While AI may store data on preferences, it cannot replicate the warmth of a well-timed gesture or comforting smile. Emotional intelligence remains one of the most vital differentiators in the guest experience, particularly in luxury contexts where guests expect to feel seen, valued, and personally cared for (Gretzel et al., 2021).
Yet, the increasing reliance on automation poses several risks. First, there is the potential loss of authenticity. Overuse of chatbots and automated messages can make guest interactions feel mechanical and impersonal. According to Belanche et al. (2020), excessive automation in service encounters often leads to reduced customer satisfaction and emotional disengagement.
Second, guest dissatisfaction can arise when technology becomes more of a hurdle than a help. This may occur when self-check-in kiosks malfunction or when guests are overwhelmed by incessant app notifications and digital prompts. Such experiences can frustrate users and detract from the seamless, stress-free atmosphere luxury properties aim to provide.
Third, staff alienation is a growing concern. Employees who feel replaced by machines may experience a decline in morale and motivation, undermining the spirit of service excellence. This erosion of purpose not only affects employee well-being but also reduces their ability to deliver emotionally intelligent service—further impacting guest satisfaction.
At luxury properties, it is often the intangible feeling of being genuinely cared for that justifies premium pricing. When automation becomes overbearing or replaces core aspects of human service, it threatens to dilute this essential value. A successful AI strategy must therefore preserve room for spontaneity, warmth, and human connection—elements that remain irreplaceable in delivering truly exceptional guest experiences.
Assessing whether AI enhances the guest experience in luxury hospitality requires more than traditional satisfaction metrics. While surveys may capture general impressions, they often fall short in evaluating emotional engagement or human connection. To measure AI’s impact meaningfully, luxury hotels are beginning to adopt alternative indicators. One emerging approach is the Emotional Engagement Index, which evaluates how “cared for” guests feel during their stay. Another metric, the Tech-Human Ratio, helps ensure that no aspect of the service becomes overly automated by balancing AI-led and human-led interactions. Additionally, employee satisfaction is increasingly seen as a bellwether of successful AI integration. If staff morale improves due to reduced repetitive tasks and greater focus on meaningful interactions, it signals a healthy AI-human collaboration (Gretzel et al., 2021).
Real-world case studies further illustrate how leading hotel brands are applying these metrics and strategies in practice. The Ritz-Carlton, renowned for its rigorous staff training and emphasis on empathy, introduced AI personalization to support—rather than replace—its human-centric model. According to Marriott International’s internal performance report (2022), the Ritz-Carlton’s hybrid approach has contributed to a measurable 12% increase in guest satisfaction scores, as staff are empowered to focus more on spontaneous, heartfelt service gestures.
Mandarin Oriental has implemented AI-powered predictive analytics to anticipate guest preferences such as spa and dining choices. These insights are shared in daily staff briefings, allowing teams to proactively tailor experiences. In an interview with Skift (2023), a senior Mandarin executive confirmed that the AI-enhanced system is still in active use and continues to receive positive guest feedback, particularly among frequent travelers who value personalized service.
Marriott International has similarly leveraged AI within its loyalty program infrastructure. By analyzing guest behavior and historical data, Marriott generates automated upgrade suggestions and service enhancements. This automation streamlines decision-making at the front desk, enabling staff to allocate more time to meaningful conversations with guests. Marriott’s 2022 Customer Experience Insights Report notes an increase in employee satisfaction following these changes, citing a better alignment between technology use and human service delivery.
In each of these cases, success depends on whether AI tools empower staff to deliver more thoughtful, emotionally resonant service—or if they merely serve as impersonal replacements. The examples from Ritz-Carlton, Mandarin Oriental, and Marriott demonstrate that when applied thoughtfully, AI can indeed elevate luxury hospitality without compromising the essence of human connection.
As luxury hotels continue to integrate AI, they face pressing ethical and operational challenges—particularly around data privacy, emotional authenticity, and long-term guest expectations. Managing vast amounts of guest data, from lifestyle preferences to behavioral patterns, raises serious concerns about transparency and security. In the luxury sector, where trust and discretion are paramount, guests are especially sensitive to how their personal information is collected, stored, and used. According to Deloitte’s 2021 Global Data Privacy Consumer Survey, nearly 70% of high-income travelers indicated they would abandon a brand after a privacy breach. To maintain trust, brands must clearly communicate their data practices, obtain informed consent, and implement robust cybersecurity systems.
Another area of growing focus is emotional AI—technology that interprets facial expressions, vocal tones, or biometric signals to gauge a guest’s emotional state. When applied in luxury hospitality, emotional AI could unlock unprecedented levels of personalized service. For instance, it might alert spa or wellness staff when a guest appears fatigued or distressed, enabling them to tailor offerings accordingly. Similarly, concierges could adjust their tone or pace depending on the perceived mood of the guest, enhancing emotional rapport. Brands such as Accor have explored these technologies in experimental trials within their premium collections (Accor, 2023). However, this approach raises significant ethical questions. Without informed guest consent and transparent usage policies, emotional AI risks undermining the very empathy it seeks to emulate. For luxury hotels, the key lies in deploying these tools as assistive technologies that enhance—but never replace—genuine human intuition and care (Gretzel et al., 2021).
Looking toward the future, long-term guest perception will hinge on how well luxury hotels strike a balance between automation and authentic connection. As guests become more accustomed to AI-led experiences, they may simultaneously develop higher expectations for emotional intelligence and personalized care. Hybrid service models that blend AI efficiency with human warmth are emerging as the most viable path forward. According to Accenture’s 2023 Travel Trends report, luxury consumers increasingly value technology that "disappears into the background" while empowering human staff to deliver emotionally rich experiences. In this context, the future of luxury hospitality will not be defined solely by innovation, but by the industry’s ability to preserve the essence of care amid technological change.
The marriage of artificial intelligence and luxury hospitality holds great promise. Automating repetitive tasks, offering precise personalization, and providing round-the-clock assistance can amplify service quality—if executed with care. The key lies in balance: technology should empower employees and guests, not overshadow human connection.
By understanding the emotional core of luxury service, embracing flexible tech solutions that cater to different guest preferences, and adopting metrics that measure both efficiency and human warmth, the industry shall be able to chart a course that honors its heritage while innovating for the future. In doing so, luxury hospitality can evolve into an even more enriching and memorable realm, where technology serves as a catalyst—never a substitute—for genuine human interaction.
[1] Belanche, D., Casaló, L. V., Flavián, C., & Schepers, J. (2020). Service robot implementation: A value co-creation and co-destruction perspective. Journal of Business Research, 117, 38–51.
[2] Gretzel, U., Buhalis, D., & Sigala, M. (2021). The future of service work: Challenges and opportunities for the luxury sector. Tourism Review, 76(3), 447–458.
[3] Hilton Worldwide. (2023). Annual Corporate Responsibility Report.
[4] Ivanov, S., & Webster, C. (2019). Robots in tourism: A research agenda. Annals of Tourism Research, 76, 105–118.
[5] Lu, L., Cai, R., & Gursoy, D. (2020). Developing and validating a service robot integration willingness scale. International Journal of Hospitality Management, 87, 102378.
[6] Marriott International. (2022). Customer Experience Insights Report.
[7] Skift. (2023). AI in Hospitality: Adoption Trends and Case Studies.
[8] Tussyadiah, I., & Miller, G. (2019). Perceived impacts of AI and automation on hospitality jobs. International Journal of Contemporary Hospitality Management, 31(6), 2569–2588.
[9] Deloitte. (2021). Global Data Privacy Consumer Survey.
[10] Radisson Hotel Group. (2022). AI and Automation in Guest Services: Efficiency Without Compromise. Internal Operations Report.
[11] McKinsey & Company. (2021). Understanding the Next-Gen Luxury Traveler: Trends in Personalization and Tech Adoption. McKinsey Travel Insights.
[12] Skift. (2023). AI in Hospitality: Adoption Trends and Case Studies.
[13] Affectiva. (2023). Emotion AI in Customer Service: Real-World Use Cases and Pilots.
[14] Accor. (2023). Digital Transformation in Luxury Brands: Emotional Intelligence and Guest-Centric AI.
[15] Accenture. (2023). Travel Trends 2023: Hospitality in the Age of Hybrid Expectations.
[Student IDEAS] by Hugo Jalet - Global BBA at ESSEC Business School
The rapid expansion of ESG data and divergent rating methodologies have undermined the credibility and consistency of sustainability scores, enabling greenwashing and investor confusion. While the EU’s CSRD introduces reporting standards, it stops short of unifying rating criteria. Artificial intelligence (AI) offers tools to structure ESG assessments, detect inconsistencies, and enhance transparency. However, AI faces limitations: data biases, opacity, interpretive challenges, and significant environmental costs. Effective ESG scoring requires a hybrid model combining AI capabilities with human oversight, regulatory standards, and open-source approaches. Used responsibly, AI can support more reliable, transparent, and sustainable ESG evaluation systems—without replacing human judgment.
---
The rise of environmental, social and governance (ESG) criteria has transformed the way companies are assessed, both by governments and by banks and other finance companies. However, this development has also led to a significant ESG data explosion, compounded by a lack of harmonized ratings. Although the Corporate Sustainability Reporting Directive (CSRD) standards, which came into force in Europe at the beginning of the year, are intended to provide issuers with a more precise framework, their precision will not automatically lead to standardization and properly consolidated reporting. This fragmentation and non-standardization of data create fertile ground for greenwashing, which essentially means falsely portraying something as environmentally friendly, with some companies artificially embellishing their ESG performance without any real commitment to sustainability.
Artificial intelligence is often presented as a solution to these challenges. According to Del Vitto (2023), advances in machine learning make it now possible to analyze vast sets of ESG data, identify the decisive criteria in assigning scores and make the decisions of rating agencies more explicable . In addition, thanks to AI, it is also possible to track down inconsistencies between companies' declarations and their actual actions, thus contributing to the fight against greenwashing (Moodaley et al., 2023). AI is therefore a powerful yet imperfect tool for structuring ESG ratings. It carries significant limitations: it can reinforce existing biases, lacks full transparency, and demands considerable energy resources. Moreover, most real-world applications of AI in ESG continue to depend on human auditors to validate findings, making the prospect of a fully autonomous ESG rating system improbable in the near term.
The central question remains: can AI genuinely harmonize ESG ratings and establish a more coherent framework, or does it risk reinforcing confusion by adding another layer of opacity? The answer likely lies in the balance between technological innovation, regulatory oversight, and human expertise.
The lack of standardisation between the various rating agencies is one of the major challenges to the credibility of ESG criteria. Ratings are based on proprietary methodologies, which leads to variations and noise that can be very significant. MSCI1 takes an industry approach, Sustainalytics2 focuses on risk exposure, while Refinitiv3 focuses on reported quantitative data. Del Vitto et al. (2023) note that ESG rating agencies rely on distinct methodologies tailored to their own frameworks, which leads to significant variations in how the same company may be assessed across different providers, to such an extent that empirical studies show score variations of up to 50%. Differences in scope, indicator measurement and different weightings are the primary drivers of these discrepancies. Even though the CSRD in Europe seeks to harmonise the publication of ESG data, it does not impose a single rating methodology. This gap leaves room for AI-based solutions, which could help to align rating methodologies.
| Company | Business Sector | Refinitiv | MSCI | Sustainalytics |
| Tesla | Automotive | B (63/Good) | A (Average) | 28.6(Medium Risk) |
| Exxon Mobil | Energy | B (66/Good) | BBB (Average) | 36.5 (High Risk) |
Table 1.0 : Thomson Reuters, Refinitiv ESG score. ESG period: June 2022.
There are several AI-based initiatives to harmonise ESG ratings. SESAMm4 is one such solution. It specialises in analysing ESG controversies using AI, processing huge volumes of data from the media, reports and regulations, although this solution remains a hybrid approach in which ESG analysts validate the information generated. Adding to this, Clarity AI5, integrates ESG assessments directly into investment platforms, allowing asset managers to standardize their evaluations while meeting regulatory requirements. Beyond asset owners and managers, large corporations are also turning to AI tools such as C3 AI6, which helps transform ESG reporting from a mere compliance exercise into a strategic opportunity. As the adoption of these technologies accelerates, striking the right balance between automation and expert validation will be crucial to ensuring the reliability and credibility of ESG ratings.
It is also important to note that although AI is presented as a solution for standardising and improving the objectivity of ESG ratings, its effectiveness depends directly on the quality and diversity of the data on which it is trained. If the data used is biased, e.g. by favouring certain industries, excluding emerging markets, or only taking into account the voluntary declarations of companies, the resulting scores risk reinforcing existing asymmetries and misrepresenting actual sustainability performance.
In addition, the opaque nature of proprietary algorithms makes it difficult to understand ESG scores, demonstrating a real lack of transparency. This lack of transparency poses a major problem: how can we trust an ESG score if we don't know how it is calculated? To remedy these challenges, an open-source approach to ESG algorithms could offer an innovative and credible solution. Unlike proprietary models, open-source AIs allow full access to the code, evaluation criteria and decision-making mechanisms. This would allow investors, companies and regulators to audit the models, identify potential biases and improve the methodology in a collaborative manner.
Concrete examples show that open-source AI models can work while having a valid and relevant business model over time. For instance, Hugging Face offers an open-source AI platform where natural language processing (NLP) models are trained transparently, allowing the community to evaluate. Thus, rather than making the market more opaque, AI could become a tool for transparency and standardisation.
The introduction of AI and machine learning techniques represents a significant step toward enhancing the transparency and explainability of ESG ratings. One of the key contributions of AI in this domain is its ability to reverse-engineer rating methodologies. Using white-box and grey-box7 mathematical models, researchers have been able to replicate ESG scores with high accuracy, shedding light on which factors drive the ratings (Del Vitto et al., 2023). This approach enables a more structured understanding of how ESG scores are assigned, particularly by identifying the weight and influence of specific ESG metrics. A particularly powerful tool in this effort is the SHAP (SHapley Additive exPlanations) technique, which Del Vitto et al. (2023) describe as originating from cooperative game theory. This method estimates the contribution of each feature in an AI model, allowing users to understand why a company receives a certain ESG score. For example, if a rating is heavily influenced by carbon emissions data, SHAP analysis can highlight the precise impact of this variable relative to other ESG factors. However, despite its potential, AI does not eliminate all concerns regarding ESG rating opacity. Del Vitto et al. (2023) emphasize that even the most advanced machine learning models are unable to fully eliminate residual inconsistencies in ESG ratings, highlighting the inherent limitations of algorithmic approaches. This reinforces the necessity of maintaining human oversight to ensure accurate interpretation and contextual judgment.
As sustainability becomes a key concern in corporate strategy, greenwashing remains a significant risk. Investors and regulators face the challenge of distinguishing genuine sustainability commitments from misleading claims. A recent case illustrating this issue involves Delta Air Lines, which was sued in 2023 for allegedly misrepresenting itself as “the world’s first carbon-neutral airline.” The lawsuit contended that Delta's reliance on carbon offset programs; some of which were criticized as scientifically unverified or ineffective; failed to meaningfully counterbalance the airline’s actual emissions (Corder, M. 2024). This case highlights the difficulty stakeholders face in verifying the legitimacy of corporate sustainability narratives and the need for more robust verification mechanisms. In this context, artificial intelligence has emerged as a powerful tool for detecting ESG inconsistencies and verifying corporate sustainability reporting. AI enhances ESG reporting verification by automating the analysis of vast amounts of unstructured data. Mach (2023) describes how Covalence employs AI to analyze and categorize information from media sources, trade unions, and NGOs, enabling the assessment of a company’s ESG reputation and the consistency between its public commitments and actual practices, an approach particularly useful for identifying potential greenwashing. Another notable AI-driven tool in greenwashing detection is ClimateBERT, which uses NLP to assess the credibility of corporate climate commitments. Again, Mach (2023) explains that AI technologies can be applied to evaluate the credibility of sustainability statements made by corporate executives, particularly in financial communications such as earnings calls. This analytical capability is crucial, as sustainability claims are frequently vague or overstated, posing challenges for investors seeking to distinguish genuine commitments from strategic messaging.
AI plays a role in ESG taxonomy compliance. Certain algorithms are capable of estimating the proportion of revenues derived from specific business activities, facilitating the alignment of companies with the EU Green Taxonomy and other sustainability frameworks.
However, AI is not without its limitations and risks. As Mach (2023) warns, AI struggles with ambiguous language, sarcasm, and complex contexts in sustainability reports. "Polarity or sentiment analysis (positive vs. negative) is not easy in texts with ironic content," highlighting that while AI can flag potential inconsistencies, human oversight remains crucial to interpreting results accurately. Furthermore, generative AI models, if not properly monitored, may produce AI hallucinations8.
Despite the promise of artificial intelligence to bring structure and clarity to ESG analysis, its capacity to interpret ESG data remains significantly constrained by both technical limitations and conceptual ambiguities. These datasets are inherently heterogeneous, incomplete, and context-dependent. At the heart of the problem lies the semantic ambiguity of ESG language. As Mach (2023) points out, ESG analysis “is as much an art as a science”, and AI tools often falter when processing ironic, symbolic, or contextually rich language. This “art” in ESG analysis lies in the interpretive nature of sustainability data. Evaluating a company’s climate risk strategy or its labor rights record often involves qualitative judgment, contextual nuance, and sector-specific understanding. Two companies may disclose similar data, yet analysts may score them differently based on credibility, regional standards, or perceived intent. These grey zones demand human reasoning—something AI struggles to replicate. In contrast, the “science” involves quantifiable indicators and structured metrics. But without the art of interpretation, even the best algorithms risk missing the bigger picture. This is a crucial issue, given that ESG claims in reports and public communications often rely on narrative framing rather than measurable action. Another concern is data population and representativeness. Del Vitto et al. (2023) show that in the Environmental and Social dimensions, many variables are completely, or nearly empty in the datasets, and often filled with default values or substituted via correlation-based assumptions. These gaps reduce the reliability of model predictions and introduce systemic biases, especially for companies in emerging markets or industries with weaker disclosure norms.
AI enhances efficiency and replicability in ESG scoring, it struggles to interpret ESG data in a truly meaningful and context-aware way. The challenges are not merely computational, they are also epistemological, rooted in the complex, evolving, and normative character of sustainability itself. As Mach reminds us, AI should not replace human ESG expertise, but rather shift it toward algorithm supervision and result interpretation. In this light, AI should be seen not as an autonomous evaluator, but as a decision-support tool whose outputs require continuous human judgment and ethical oversight.
The increasing reliance on artificial intelligence in ESG scoring raises a paradox: while AI aims to support environmental goals, it can itself generate substantial environmental externalities, particularly through energy consumption. The question, therefore, is not only whether AI enhances the credibility of ESG ratings, but whether its ecological footprint undermines its legitimacy as a tool for sustainability. AI models, particularly large-scale language models, require significant computational resources. This energy demand is driven primarily by the training and deployment of models in vast data centers, many of which rely on non-renewable electricity sources. According to the Yale School of the Environment (2024), AI applications, including machine learning used in ESG, contribute to growing carbon emissions and water consumption due to cooling systems and hardware maintenance.
However, this impact is not uniform across geographies. In countries such as France, where the electricity mix is largely decarbonised thanks to nuclear and renewable sources, the environmental footprint of AI infrastructure is significantly lower. As a result, developing AI-based ESG rating systems in such regions could enhance their credibility, offering a more sustainable alternative to carbon-intensive models operated in fossil-fuel-dependent countries.
Once deployed at scale across financial institutions and ESG platforms, these systems add to the energy intensity of digital finance infrastructures. In this light, AI can become counterproductive, especially when used for superficial ESG assessments or unchecked greenwashing detection. To address these concerns, initiatives are emerging to quantify and reduce the carbon cost of AI. One example is the AI Energy Score, developed through a collaboration between Salesforce and Hugging Face, which aims to inform users of the energy impact of different AI models and promote more responsible development (ESG Today, 2024).
In conclusion, the use of AI in ESG scoring is justifiable only under certain conditions: its deployment must be energy-efficient, purpose-driven, and paired with transparent accountability mechanisms.
Artificial intelligence has demonstrated strong potential to improve the transparency, consistency and responsiveness of ESG ratings. From reverse-engineering opaque methodologies to identifying greenwashing risks and enhancing data verification, AI offers a powerful toolkit for addressing the current limitations of ESG scoring systems. Despite valid concerns, including algorithmic bias, data gaps and significant energy consumption, recent developments show that these risks can be mitigated through regulatory oversight, human supervision and the use of decarbonised infrastructures, such as those available in countries like France.
In this context, the use of AI in ESG scoring appears not only justified but also promising. If implemented with purpose, responsibility and transparency, AI can support a more credible and efficient ESG evaluation process. Far from replacing human judgment, it should act as a decision-support tool that strengthens rather than supplants sustainable finance practices.
[1] https://www.msci.com/documents/1296102/34424357/MSCI+ESG+Ratings+Methodology.pdf
[2] https://connect.sustainalytics.com/esg-risk-ratings-methodology
[5] https://clarity.ai/use-cases/
[6] https://c3.ai/products/enterprise-ai-for-sustainability/
[7] White-box models are methods where you can clearly see and understand how the results are calculated. Grey-box models are a mix—partly understandable, but with some elements that work like a “black box,” meaning their internal workings are less visible.
[8] AI hallucinations refer to instances where a model generates information that appears plausible but is factually incorrect or entirely fabricated. In ESG contexts, such errors can distort analysis and mislead decision-making.
[09] Nakhcha, M. et al. (2024) Synergy between Sustainable Finance and Artificial Intelligence: A Promising Future, International Journal of Applied Management and Economics, 2(07), pp. 104-117. DOI: 10.5281/zenodo.11102334.
[10] Berg, M. et al. (2023) ESG Ratings Explainability through Machine Learning Techniques, Sustainability, 15(21481). DOI: 10.3390/su15021481.
[11] Moodaley, W. et al. (2023) Greenwashing, Sustainability Reporting, and Artificial Intelligence: A Systematic Literature Review, Sustainability, 15(1481). DOI: 10.3390/su15021481.
[12] Mach, A. et al. (2023) Artificial Intelligence and ESG Analysis, Allnews, 10 May. Available at: https://www.allnews.ch/content/points-de-vue/intelligence-artificielle-et-analyse-esg
[13] Yale School of the Environment (2024). Can we mitigate AI’s environmental impacts?. Available at: https://environment.yale.edu/news/article/can-we-mitigate-ais-environmental-impacts
[14] ESG Today (2024). Salesforce Partners Launch Energy Ratings for AI Models. Available at: https://www.esgtoday.com/salesforce-partners-launch-energy-ratings-for-ai-models
[15] Corder, M. (2024). An Amsterdam court has ruled KLM’s sustainable aviation advertising misled consumers. AP News. Available at: https://apnews.com/article/klm-greenwashing-aviation-sustainability-amsterdam-7d0e2b69099c7c9a46393a3cda44d4d8
[16] Hazel James Ilango (2022) Greater ESG Rating Consistency Could Encourage Sustainable Investments Available at: https://ieefa.org/sites/default/files/2022-10/Greater%20ESG%20Rating%20Consistency%20Could%20Encourage%20Sustainable%20Investments_final.pdf