Stanford GEDI Programme AY2025/26
Mechanical Engineering &
Business Management
A0255359U
Industrial Systems Engineering
A0253086A
Biomedical Engineering &
Innovation and Design Programme
A0255216J
Computer Engineering &
Business Administration
A0255302R
NUS CDE
NUS CDE
We would like to express our sincere gratitude to Dr Elliot Law and Mr Royston Shieh for their guidance, support and encouragement throughout this project. Their weekly check-ins provided us with clarity, direction and valuable feedback on where to focus our efforts. Their advice was instrumental in helping us identify our target users and refine the scope of our work.
We would also like to extend our thanks to all the hotels that worked with us, especially the staff who generously made time to share their experiences. We are humbled by the amount of work that goes into delivering service that meets the expectations of modern day luxury, and we are grateful for the rich insights they offered from their years in the industry. We are equally appreciative of the guests who participated in our interviews for giving us a deeper understanding of the hospitality experience from their perspective.
Finally, we are thankful to the Innovation and Design Department for the opportunity to be part of the Global Engineering Design Innovation programme, and for enabling this meaningful collaboration with Stanford.
The collective support of everyone involved has made this an extraordinarily enriching experience. The insights we have gained from each stakeholder have deepened our understanding in ways that go well beyond the technical scope of this project, and the skills we have developed would not have been possible without their generosity and involvement.
This project was undertaken as part of the Stanford Global Engineering Design Innovation (GEDI) programme, a collaborative initiative that brings together graduate engineering students from Stanford University and undergraduate engineering students from international partner institutions. Under this programme, NUS students are enrolled in CDE4301 Innovation & Design Capstone while their Stanford counterparts take ME310 Global Engineering Design Innovation. ME310 is structured around a rigorous design process that moves teams from problem investigation through prototyping to a final showcase, exposing NUS students to Stanford’s human-centred design methodology. The programme is designed to foster cross-cultural, interdisciplinary collaboration, equipping students with the practical skills and design mindset to tackle real-world engineering challenges.
The programme spans approximately 10 months, from August 2024 to June 2025, and is structured around three academic quarters at Stanford and two semesters at NUS. The programme timeline is illustrated in Figure 1 below.
Figure 1: Programme Timeline
The programme culminates in two showcases: the EDIC Project Showcase in April 2026, where the NUS team presents independently, and the EXPE Showcase at Stanford University in June 2026, where the NUS and Stanford teams jointly present their final integrated prototype to an audience of industry professionals, faculty, and investors.
Collaboration across the NUS and Stanford teams was conducted primarily online through Zoom for weekly check-ins and WhatsApp/Telegram for day-to-day updates, keeping both teams aligned on progress and design decisions across different time zones.
The programme incorporates structured in-person exchanges as a core feature of the academic year. Each team visits the partner university once, with a final joint visit to Stanford for the EXPE Showcase in June. These in-person periods function as intensive design sprints, enabling rapid co-creation, prototyping, and iteration. Industry partners are engaged throughout the year through virtual calls and in-person sessions.
The industry partner our project is Venture Corporation Ltd, which presented us with the following design challenge:
“Reimagining a Premium Automated Hotel Check-In Experience”
The brief identified that while hotel guests increasingly expect seamless, efficient, and contactless interactions, current automated check-in solutions often lack the sophistication and elevated service quality expected in premium hotels. Traditional check-in processes are time-consuming and impersonal, yet existing automation falls short of delivering the luxury experience that discerning guests anticipate. Venture challenged our team to rethink this touchpoint by combining cutting-edge technology with elevated service design.
The objective of this project is to design and prototype a premium automated hotel check-in experience that addresses the limitations of both traditional counter check-in and existing self-service kiosks, specifically within the context of premium hospitality.
The scope covers the arrival stage of the guest journey, from the moment a guest arrives to the hotel lobby through to receiving room access. Both guest-facing and staff-facing dimensions were considered, though the primary focus remains on reimagining the guest’s first physical interaction with the hotel.
The meaning of luxury hotels has evolved beyond extravagance, expansive spaces or high-quality amenities. It now centres on crafting meaningful, emotionally resonant experiences that create a deep sense of connection and personal value for each guest.
This shift is being driven by intensifying competition and changing guest expectations. As luxury features are increasingly adopted by non-luxury hotels, their power as differentiators has eroded (Mann et al., 2024). Affluent travellers have responded by prioritising unique experiences and vibrant atmospheres over opulent formality or material products (Mann et al., 2024). Research shows that the top factor influencing brand choice is not value, convenience, or quality, but the positive emotional experiences guests have had with a brand in the past (Mann et al., 2024). Personalisation has emerged as the clearest expression of this shift where 65% of customers consider it essential and would pay up to 25% more for it (EHL Insights, 2025), a preference that is even more pronounced among younger luxury consumers who expect experiences that feel authentically tailored rather than transactional (EHL Insights, 2023). True luxury today is therefore rooted more in thoughtful, carefully executed service, where staff anticipate needs, deliver beyond expectations, and create moments that guests carry with them long after checkout (Mann et al., 2024).
Through our literature review, we have identified five key dimensions that capture these characteristics of contemporary luxury hospitality.
| Exclusivity | Exclusivity refers to a feeling of rarity that enhances the perceived value of an experience (Wang et al., 2024). For guests, this may be reflected in features such as a private check-in suite or the presence of a dedicated host who welcomes them by name, creating a seamless arrival experience that begins the moment they step out of the car. Ultimately, exclusivity is about making guests feel that the moment has been crafted specifically for them, reinforcing their sense of distinction and personal importance. |
| Genuineness & Sincerity | Genuineness and sincerity represent the human element that makes guests feel truly welcomed. Every interaction with hotel staff should appear natural and heartfelt rather than scripted or rehearsed. When expressed with warmth and care, such interactions foster emotional connection and trust between guests and the hotel. |
| Hyper-Personalisation | Modern luxury is characterised by hyper-personalisation, which highlights the hotel's ability to remember and anticipate its guests' preferences in ways that transform a stay into a deeply personal and special experience. From preferred room temperatures to favourite drinks and pillow choices, thoughtful use of guest information creates a sense of familiarity that makes the hotel feel like a second home. |
| High-Touch Service | Another defining element of contemporary luxury is the high-touch approach, where every interaction and gesture is intentional and deliberate. For the hotel, it is not about doing more but about doing it better — with names remembered, needs anticipated, and gestures timed with care. Often, one thoughtful moment means more than three generic ones. |
| Authenticity | Authenticity ties these elements together. Modern travellers increasingly seek experiences that reflect the local culture and story rather than uniform or standardised hotel designs. Authenticity has therefore become a cornerstone of brand loyalty within the luxury hospitality sector (Accenture, 2026). |
Table 1: Our Definitions of Modern Luxury Hospitality
Collectively, these five dimensions form the foundation of modern luxury hospitality and serve as our guiding principles for reimagining the luxury hotel check-in journey.
Demand for luxury tourism is rising faster than any other travel segment, driven by a growing population of wealthy individuals and younger aspiring luxury travellers willing to spend more on upscale experiences (Tufft et al., 2024). McKinsey & Company projects that the luxury segment will grow around 6% CAGR, outpacing all other chain-scale hotel classes (Bartman et al., 2025), with momentum further reinforced by a post-2023 surge in demand for high-end travel that has continued to expand (EHL Insights, 2025). Many travellers are also willing to stretch their budgets for additional activities, supported by AMEX findings that 77% of travelers value the right experience over cost (Frost & Sullivan, 2025). Reflecting this strong demand, the global luxury hotel market continues to grow significantly, as shown in Figure 2, with personalised and unique experiences now firmly displacing traditional material forms of luxury as the primary driver of consumer preference.
Figure 2: Global Luxury Hotel Market Growth (Mordor Intelligence, 2026b)
Singapore reflects and amplifies these global trends. International visitor arrivals grew 2.3% year-on-year to 16.9 million in 2025, with the Singapore Tourism Board (STB) projecting 17 to 18 million arrivals in 2026, generating approximately SGD 31.0 to 32.5 billion in tourism receipts (STB, 2026). This momentum is underpinned by a calendar of international events, new attractions, and continued investment in tourism infrastructure. Hotels serve as the key pillar of this growth, contributing approximately 20% of total tourism receipts (STB, 2026). Luxury properties captured 47.65% of the Singapore hospitality market in 2025, anchored by integrated resorts and iconic brands attracting high-net-worth travellers seeking premium experiences (Mordor Intelligence, 2026a).
The hospitality industry faces a deepening structural workforce crisis that extends well beyond post-pandemic recovery. Global travel has largely rebounded, approximately 1.4 billion tourists travelled internationally in 2024, representing 99% of pre-pandemic levels (UN Tourism, 2025), yet the labour market has not recovered in parallel. Demographic and structural shifts are projected to leave the global hospitality workforce roughly 18% below required staffing levels by 2035, as many workers who left during the pandemic have not returned, working-age populations shrink, and unemployment levels remain low across competing industries (World Travel & Tourism Council, 2025; Frost & Sullivan, 2025). Recruitment has become increasingly difficult as hospitality competes for talent against industries offering flexible and remote work options. The demanding nature of the work: long hours, irregular scheduling, and high-stress customer interactions, deters entry and accelerates exit (Lüthy, 2025). Hotel workers in physically demanding roles, including bellmen and porters, face elevated rates of musculoskeletal disorders from heavy lifting (Park et al., 2013). Younger workers under 30 are especially reluctant to enter or remain in these roles, prioritising work-life balance and flexibility, and increasingly do not view hospitality as a stable long-term career (World Travel & Tourism Council, 2025).
Singapore reflects and amplifies these global pressures. The accommodation industry recorded a high job-vacancy rate across all industries at 6.5% as of June 2025, (MOM, 2025). Rising labour costs, high turnover, and persistent difficulty attracting locals signal a structural rather than temporary problem (jonng, 2025). Perceptions of low wages, long working hours, and the physically and mentally demanding nature of hospitality work continue to deter local talent (Choo, 2022; Seah, 2022). Additionally, lack of appreciation, low occupational status, and exposure to verbal abuse from guests further undermine front-line retention, particularly within luxury settings (Cayla, 2023). Employers report that replacing foreign workers with locals has been difficult, as locals often show low interest in service jobs despite offering higher wages (Seah, 2022). Foreign-worker quotas have been progressively tightened from 50% in 2011 to 35% in 2021, limiting the sector’s traditional fallback of supplementing local shortfalls with overseas hires (Seah, 2022; Choo, 2022).
The pressure to rebuild the hospitality talent pipeline is therefore becoming critical to sustaining long-term operations and guest satisfaction (Ernst & Young, 2023; Jonng, 2025). Understaffing reduces service speed and quality, increases inconsistency, and erodes brand reputation and profitability in Singapore’s competitive hospitality landscape (Jonng, 2025).
Figure 3 illustrates the top challenges and priorities identified by the hospitality industry, highlighting how manpower constraints continue to be a central concern.
Figure 3: Top Challenges and Priorities in Singapore Hospitality Industry
Looking ahead, sustainable progress will depend on meaningful job redesign supported by labour-saving technologies to boost productivity and make hospitality careers more attractive (Workforce Singapore, 2023; Seah, 2022).
To build a grounded and multi-perspectival understanding of the problem space, we conducted primary research across three complementary methods: semi-structured interviews with luxury hotels, direct field observations, and a two-round guest review analysis. Together, these methods triangulate the problem from the perspectives of staff, operators, and guests, forming the evidential foundation for the design directions and solution development that follow.
To gain a holistic understanding of the current luxury hotel check-in experience, we conducted semi-structured interviews with hospitality professionals across five prominent hotels and organisations in Singapore: Shangri-La, Banyan Tree Headquarters, Mandai Rainforest Resort by Banyan Tree, Raffles Hotel, and Amara Hotel (See Appendix A).
Participants represented a diverse range of roles within the hotel ecosystem, including Rooms Director, Front Desk Manager, Front Desk Staff, General Manager, Head of Technology, and Business Development leads, selected for their ability to offer operational, managerial, and technological perspectives on the check-in experience.
The full interview protocol and preparation document is included in Appendix B.
| # | Theme |
|---|---|
| 1 |
Tech Stack and Integration Reality
|
| 2 |
Human Touch vs Automation
|
| 3 |
Staff Tools and Empowerment
|
| 4 |
Pre-arrival Data and Personalisation
|
| 5 |
Manpower and Role Design of Staff
|
| 6 |
Service Recovery and "Wow" Moments
|
| 7 |
Physical Arrival and Guest Escort Experience
|
Table 2: Key Themes and Insights from On-Site Hotel Interviews
Figure 4: Summary of Key Insights from Hotel Interviews
Key findings from the interim reviews with detailed analysis can be found in Appendix C.
To validate and build upon the insights gathered through staff interviews, we conducted direct field observations, during peak check-in periods, at three luxury properties in Singapore: Marina Bay Sands, Fullerton Bay Hotel, and The Fullerton Hotel. Rather than relying solely on staff accounts, on-site observation allowed us to witness the arrival experience from the guest’s perspective and surface operational realities that interviews alone could not capture.
Raw field notes were collected across all properties and organised into three thematic clusters. Methodologies and clustering are included in Appendix D.
|
1. Check-In Flow & Queue Dynamics
Figure 5: Guests at the Check-in Counter |
Validates:
Manpower and Role Design of Staff
Human Touch vs Automation
|
|
2. Physical Labour Intensity & Luggage Handling
Figure 6 & 7: Luggage being tagged manually by bellboy (left) and luggage left unattended on the lobby floor (right) |
Validates:
Physical Arrival and Guest Escort Experience
|
|
3. Service Coverage Inconsistency
Figure 8: Guests being left to Self-Serve |
Validates:
Staff Empowerment & Resource Allocation
|
Table 3: Thematic Clusters from Hotel Observations
Field observations independently confirmed four interview themes on-site. Observation also surfaced one blind spot not captured in interviews, guest behaviour, specifically the preference to keep belonging with them at all times, and placement of personal items on lobby floors, as a contributing factor to visual clutter and diminished luxury perception.
Data from Reviews
To complement the interview and observational research with the guest perspective at scale, we conducted two rounds of review analysis across major online travel platforms.
| Study | Findings | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| One-Star Reviews |
A dataset of 60+ one-star reviews from five-star properties in Singapore was collected, cleaned, and structured. Each review was coded and categorised into sub-themes, which were then consolidated into 9 higher-level themes across 34 categories through affinity clustering. The most frequently cited theme was Staff & Service Quality, appearing in 95.8% of reviews, followed by Value-for-Money (65.55%). Critically for this project, Check-In & Check-Out Process was the fourth most cited theme at 53.78%, with the dominant sub-categories being poor service (32.77% of all reviews) and long wait times (24.37%). These findings confirm that the check-in experience is a significant and recurring driver of guest dissatisfaction at luxury properties, and that its failure is rooted not in physical infrastructure but in service quality and process efficiency.
A full interactive dashboard of the Round 1 findings is included in Appendix E. |
||||||||||||||||||
| Broader Sentiment Study |
Another round of analysis was conducted across 109 reviews spanning a full rating range (one to five stars) across four Singapore luxury properties: Capella, Marina Bay Sands, Raffles, and Fullerton. Reviews were coded across five service sentiment dimensions: luggage handling, high-touch service, staff availability, staff competency, and staff attitude, each scored out of 5.
A full interactive dashboard of the broader sentiment findings is included in Appendix F. |
Table: 4: Review Analysis across Major Online Travel Platforms
Across the research conducted, five cross-cutting insights emerged that collectively define the problem space and motivate the design of a new solution.
| # | Key Insight |
|---|---|
| 1 |
The Check-In Process Is a High-Stakes, Time-Sensitive Touchpoint
The check-in experience consistently emerged as one of the most consequential moments in the guest journey. Guest satisfaction declines by approximately 50% when check-in exceeds five minutes (Cornell University, 2013), and the Check-In & Check-Out Process was the fourth most cited theme in one-star reviews at 53.78%, with poor service and long wait times as the dominant sub-categories.
|
| 2 |
Luggage Handling Is a Significant, Underaddressed Pain Point
Luggage handling was one of the most consistently flagged pain points across all research methods. Observations revealed manual handling to be physically demanding, inconvenient, and spatially disruptive. Review data provided the strongest quantitative signal: across 109 reviews from four Singapore luxury properties, luggage handling was at 3.37 out of 5.0, against staff attitude at 3.67, confirming the friction is operational rather than attitudinal. Despite its visibility, it remains largely unaddressed by existing hotel technology.
|
| 3 |
Existing Automation Fails the Luxury Standard
Self-service kiosks are widely deployed but consistently underutilised in luxury settings, with usage rates below 1% at Shangri-La. Across interviews and observations, kiosks were described as transactional, emotionless, and misaligned with luxury price points. The failure lies in the experience.
|
| 4 |
Staff Are Overloaded and the Workforce Is Shrinking
Manpower shortage was cited as the single most pressing operational challenge across all hotel visits and research. Frontline staff simultaneously manage data entry, guest rapport, payment processing, and room allocation, creating significant cognitive overload that directly contributes to service errors. Bellboys and porters face additional physical strain from luggage handling across peak periods. Together, these pressures produce inconsistent guest experiences.
|
| 5 |
Guests Want Efficiency Without Losing the Feeling of Being Hosted
Guests did not reject technology. They rejected technology that felt cold, impersonal, or required effort from them. The desire articulated consistently was for an arrival experience that is fast and frictionless, but still feels warm, guided, and personal.
|
Table: 5: Key Insights from Primary and Secondary Research
A review of existing market solutions was conducted to understand what has already been attempted across each of the five problem areas identified in Section 3.5, and to identify where meaningful gaps remain.
| Problem Area 1: The Check-In Process Is a High-Stakes, Time-Sensitive Touchpoint | |
|---|---|
| Self-service kiosks are the most common attempt to address check-in speed, observed directly at Amara Hotel. While faster for straightforward check-ins, kiosk adoption at luxury properties was mentioned to be below 1% at a property visited. Guests consistently bypassed them in favour of human staff, negating the intended efficiency benefit. |
Figure 9: Amara Hotel Self-Service Kiosk
|
| Mobile and digital pre-check-in apps, such as those offered by Hilton and Marriott, allow members to indicate preferences and room selection before arrival. While these reduce time at the front desk, guests must still present physical identification and collect key cards at the desk in certain countries, including Singapore, preserving a friction point at arrival. |
Figure 10: Hilton Honors and Marriott Bonvoy Mobile App
|
| Gap: Existing solutions optimise for speed but sacrifice warmth. None successfully deliver both within a single guest-facing interaction that meets the emotional expectations of luxury hospitality. | |
Table: 6: Problem Area 1
| Problem Area 2: Luggage Handling Is a Significant, Underaddressed Pain Point | |
|---|---|
| YOTEL Yobot (New York) automates luggage storage via a robotic arm handling approximately 300 items per day, but is purely a storage system. It does not transport luggage to the guest's room and is too slow for peak arrival periods. |
Figure 11: YOTEL Yobot
|
| Piaggio Fast Forward Kilo is a four-wheeled robotic flatbed that follows a staff member while carrying heavy loads of up to 130 kg, relieving physical strain. While it addresses the occupational health burden of manual work, it was designed for industrial environments and is only now exploring hotel integration. It requires a human operator to lead it, follows rather than guides, and functions as a staff tool rather than a guest-facing autonomous system. |
Figure 12: Piaggio Kilo following staff
|
| Gap: Some guests preferred to keep their luggage with them throughout the arrival journey rather than handing it off to staff for separate delivery. No existing solution accommodates this preference: current options either store luggage out of sight, require staff operation, or play no role in the arrival journey at all. | |
Table: 7: Problem Area 2
| Problem Area 3: Existing Automation Fails the Luxury Standard | |
|---|---|
| Henn-na Hotel in Japan deployed over 240 robots at its peak but retired more than half by 2019 due to technical glitches and guest complaints (Hertzfeld, 2019). Guests reacted negatively to the humanoid robots' appearance, describing them as creepy and unsettling rather than premium — a textbook example of the "uncanny valley" effect (Nelson, 2025). |
Figure 13: Henn-na Hotel Japan Humanoid Robots
|
| Hilton Connie is a robot concierge that answers guest questions about local attractions, hotel amenities, and dining options. However, Connie's interactions are stilted and robotic, limited to scripted factual responses with no natural conversational flow. It has no check-in capability, cannot handle physical tasks, and does not form part of the arrival journey. |
Figure 14: Hilton Connie
|
| Gap: Existing automation solutions either over-automate at the cost of warmth, or under-deliver on conversational quality. None successfully replicate the emotional experience of being genuinely welcomed and guided. | |
Table: 8: Problem Area 3
| Problem Area 4: Staff Are Overloaded and the Workforce Is Shrinking | |
|---|---|
| The Citadines delivery robot, observed during our site visit to Citadines Rochester, demonstrates the operational viability of autonomous robot deployment in a hotel environment. The robot calls and rides lifts independently, navigates hallways, and completes amenities delivery without staff assistance, confirming that robot deployment can meaningfully reduce operational load in hotel environments. |
Figure 15: Citadines Autonomous Delivery Robot
|
| Amazon Alexa for Hospitality handles in-room guest requests at properties including Marriott and Westin, reducing call volume to the front desk, but its function is limited entirely to the in-room experience. |
Figure 16: Hospitality Alexa
|
| Gap: Existing solutions reduce operational load at the margins — in-room requests, back-of-house logistics — but none address the concentration of physical and cognitive demand at the point of arrival. | |
Table: 9: Problem Area 4
| Problem Area 5: Guests Want Efficiency Without Losing the Feeling of Being Hosted | |
|---|---|
| Four Seasons Chat and Ritz-Carlton ChatGenie deliver fast, personalised guest communication through messaging channels backed by human staff. Both reduce neither headcount nor reliance on human availability — rather, they shift the medium from face-to-face to digital. Critically, both are absent at the point of physical arrival and cannot replicate the embodied experience of being greeted and guided from the moment a guest steps out of their vehicle. |
Figure 17: ChatGenie
|
| Gap: No existing solution delivers the combination of speed, warmth, physical presence, and personalised guidance at the point of arrival. | |
Table: 10: Problem Area 5
Table 11: Summary of Existing Solutions
Physical Arrival refers to the end-to-end guest journey from vehicle drop-off at the hotel entrance through luggage handling, lobby navigation, and room escort.
The table reveals two structural gaps:
The pattern across all reviewed solutions confirms that the market has not yet produced a system capable of simultaneously delivering speed, warmth, physical presence, and operational efficiency at the point of arrival.
The hospitality industry is undergoing a rapid technological shift, with robotics and conversational AI emerging as two of the most significant forces reshaping hotel operations and guest experience. While industry-wide adoption data spans all hotel segments, early signals from luxury operators specifically suggest the segment is moving toward AI-augmented guest interactions.
Figure 18: Hospitality Robots Market Growth
The hospitality robots market reached USD 0.76 billion in 2026 and is projected to grow to USD 2.23 billion by 2030 (Mordor, 2026), as illustrated in Figure 18 This growth is underpinned by both falling costs and rising guest acceptance: humanoid robot costs dropped approximately 40% between 2022 and 2024 (Hanbury et al., 2025), while a meta-analytic review of 56 studies confirmed that consumers are increasingly receptive to hotel service robots, with performance expectancy and customer attitude emerging as the strongest drivers of acceptance (Begum et al., 2024). Major chains including Marriott, Hilton, and IHG have active robot deployments, with Asia-Pacific properties accounting for the highest density globally (AI, 2025). Over 45% of luxury hotels have already deployed service robots to enhance guest safety and operational efficiency (Intel Market Research, 2026).
The luxury segment has learned from earlier missteps. The Henn-na Hotel experience demonstrated that wholesale automation without warmth or reliability undermines the premium experience. The industry has consequently shifted toward using robots for physically demanding tasks while preserving human presence for high-touch interactions.
Figure 19: AI in Hospitality Market Growth
The global AI in the hospitality and tourism market was valued at USD 26.53 billion in 2026 and is projected to reach USD 75.66 billion by 2030, growing at a CAGR of 29.9% (researchandmarkets, 2026), as illustrated in Figure 19 Within hotels, 71% of hospitality professionals view AI as having a significant or transformative impact, 82% expect AI usage to increase within the next year, and 85% plan to allocate at least 5% of their IT budget to AI tools in 2026 (Canary Technologies, 2026). 45% of hotels are already running AI-powered webchat agents and 92% have adopted or plan to adopt AI-assisted guest communications (Canary Technologies, 2026). 94% of regional tourism and hospitality leaders are already experimenting with AI and 89% will prioritise Generative AI within the next one to two years (pwc, 2025).
Within luxury specifically, the most viable deployment model blends AI efficiency with human warmth. High-profile guests often prefer AI interaction for reasons of privacy and discretion (Editeur Metalab, 2025), and AI-powered virtual concierges are enabling service continuity at a scale unachievable through human staffing alone (Harkison, 2025). Regional operators are investing accordingly: CapitaLand, parent company of The Ascott Limited, established a SGD 50 million Innovation Fund to support the testbedding of high-tech innovations across its portfolio (CapitaLand, 2021).
The research conducted across Sections 3.1 to 3.6 converges on three distinct but interconnected opportunity areas. Each opportunity directly motivated a corresponding design direction and How Might We statement that guided the first phase of concept development.
| # | Opportunity & Design Direction |
|---|---|
| 1 |
Reinventing the Check-In Experience Through Human-Centric Automation
With self-service options underperforming, automation that feels transactional has already been tried and rejected by the luxury segment. The gap lies in designing a guest-facing system that retains the warmth and conversational quality of a human interaction while delivering the speed and consistency of automation — and critically, one that extends beyond the front desk to cover the full physical arrival journey.
Design statement: Human-Centric Automation for Enhanced Hospitality — shaping automation so that it supports the overall hospitality experience and aligns with the emotional expectations of luxury guests, rather than reducing the interaction to a purely transactional process. HMW: How might we make automated systems encapsulate human touch? |
| 2 |
Unlocking Real-Time Hyper-Personalisation
Although hotels collect extensive guest data, it is often underutilised at the point of arrival. Personalisation remains largely reserved for VIP guests and relies on prior checks on data base rather than systematic data activation. The opportunity lies in designing systems that surface this data in real time.
Design statement: Personalisation and Guest Preference Intelligence — transforming fragmented guest data into meaningful, timely personalisation across the check-in journey. HMW: How might we enable hotels to provide genuinely personalised and tailored experiences? |
| 3 |
Supporting and Empowering Frontline Staff
Frontline staff managing multiple systems simultaneously creates cognitive overload, limiting their ability to deliver high-touch service. With manpower shortages worsening, the opportunity lies in redesigning tools and workflows so that technology handles operational complexity, freeing staff to focus on meaningful guest interactions.
Design statement: Empowering Staff Consistency and Confidence — designing processes and tools that reduce variability in performance, support clear decision-making under pressure, and enable staff to remain composed, attentive, and guest-facing even during peak periods. HMW: How might we help hotel staff perform at their best even in high-pressure guest interactions? |
Table 11: Opportunity Areas
Figure 20: Summary of opportunities, design direction, and HMW statements
To ground the design process in real guest experience, we mapped four current-state journeys based on hotel interviews, walkthroughs, and observations conducted across multiple Singapore luxury properties. The maps cover three key touchpoints of the guest arrival experience: pre-arrival, check-in, spanning both traditional counter and self-service kiosk modes, and the luggage handling journey.
Figure 21: Pre-Arrival Flow
Figure 22: Counter Check-In Flow
Figure 23: Kiosk Check-in Flow (Modelled from Amara Hotel's Kiosk Check-In)
Figure 24: Luggage Handling Journey Map (modelled from Marina Bay Sands)
Detailed stage-by-stage breakdowns of each journey are included in Appendix G.
The luxury hotel check-in ecosystem involves a complex network of stakeholders whose roles, expectations, and challenges directly shape the arrival experience. Four primary stakeholder groups were identified: guests, front-office staff, hotel management, and technology departments. Their needs and pain points serve as the basis for our three design pillars: Empowering Staff, Personalisation Intelligence, and Human-Centric Automation.Guests
Detailed profiles covering core expectations, pain points, and needs for each group are included in Appendix H.
| Stakeholder | Role & Context |
|---|---|
| Guests | The primary users of the check-in process and ultimate beneficiaries of service excellence — spanning diverse profiles (business travellers, honeymooners, families) each with distinct priorities but a consistent expectation: to feel welcomed, recognised, and cared for from the moment of arrival. |
| Front-of-house Staff | Execute the end-to-end check-in process while simultaneously managing complex systems, verifying identities, processing payments, and handling real-time guest inquiries — all while maintaining warmth, composure, and attentiveness. Bellmen and porters form a distinct sub-role, responsible for the physically demanding handling and transport of guest luggage. |
| Hotel Management | Oversees front office performance, coordinating manpower, monitoring service quality, resolving escalations, and making technology adoption decisions at the intersection of guest experience and operational efficiency. |
| Technology Departments | Maintain the hotel's digital ecosystem: PMS, kiosk systems, CRM, and keycard infrastructure. Responsible for evaluating new technologies for feasibility, integration compatibility, and return on investment. |
Table 12: Stakeholder Needs
Building on the three design directions and the pain points identified through primary research, four initial prototypes were developed during the interim phase. Rather than converging on a single concept, we deliberately explored multiple directions across different stages of the guest journey, covering pre-arrival personalisation, guest-facing check-in, and staff support tools. Each prototype addressed a distinct dimension of the problem space.
Figure 25: Overview of the solutions prototyped across the guest journey
Alluvio addressed the personalisation gap that exists when guests book through Online Travel Agencies, which dominate hotel bookings across Asia, Europe, and the United States but frequently fail to pass accurate guest preference data to hotels. The concept was a web and mobile platform combining OTA-like discovery with a direct, personalised data relationship between guest and hotel. Guests could build dynamic preference profiles through a swipe-based interface, store travel documents securely, and share this information with onboarded hotels ahead of arrival. Hotels in turn could use this data to personalise the stay from the moment of booking rather than relying on staff memory or incomplete PMS records. Click the videos below to watch the demonstrations.
Video 1: Alluvio - Web Platform
Video 2: Alluvio - Mobile App Platform
Figure 26: Alluvio Web Platform — Interface Overview
Figure 27: The preference analytics dashboard provides guests with a visual overview of their evolving profile. This data is shared with onboarded hotels, enabling personalised service before arrival.
Figure 28: The mobile app mirrors the web platform's preference analytics. Guests can review, update, and refine their profiles at any time, ensuring preferences remain current
Figure 29: Based on the guest's preference profile, Alluvio surfaces personalised luxury hotel recommendations ranked by compatibility, making discovery feel intuitive and tailored.
User testing was conducted through engagements with hotel directors and front-office staff. In parallel, sessions were held with members of the public who were invited to interact with Alluvio’s prototype interface, followed by a short structured feedback session.
Guest Feedback:
Hotel Staff Feedback:
The full design rationale, value proposition, and prototype documentation for Alluvio are included in Appendix I.
The AI Kiosk Assistant was a complementary device designed to work alongside existing kiosk hardware, adding conversational warmth and guidance without requiring a full system overhaul. It used a natural voice interface to welcome guests, walk them through each step of the check-in process, answer simple questions, and escalate exceptions to staff when needed. Unlike a standard kiosk, it could pick up basic preferences during conversation and respond with an emotionally aware tone aligned with luxury expectations. Click the video below to watch a demonstration.
Video 3: AI Kiosk Assistant Demo
Figure 30: The assistant initiates the interaction with a personalised greeting, setting a warm, conversational tone before guiding the guest into the check-in flow.
Figure 31 The assistant directs the guest through passport scanning and photo capture using natural language cues such as "*Please face the camera squarely*”.
Figure 32: The assistant walks the guest through each stage in real time, escalating exceptions to nearby staff when needed without disrupting the experience.
Figure 33: After dispensing the key card, the assistant continues the conversation to confirm room details and capture guest preferences, turning it into a personalisation moment.
User testing was conducted through engagements with hotel directors and front-office staff. In parallel, sessions were held with approximately 10 members of the public, who were invited to interact with a simulation of the Amara Hotel kiosk check-in flow alongside the AI Kiosk Assistant without prompts, followed by a short structured feedback session to capture unguided first impressions and usability concerns.
Four key concerns were raised following feedback from hotel staff, industry partners, and potential guests:
The full design rationale, value proposition, and prototype documentation for AI Kiosk Assistant are included in Appendix J.
Hotelly was a real-time AI overlay system designed to support front desk staff during guest interactions without replacing them. Operating as a discreet, desktop-based interface, it surfaced contextual prompts, guest profile information, policy references, and local recommendations at the relevant moment in a conversation, reducing the cognitive load of simultaneously managing data entry, guest rapport, and question-handling. It also automated the capture and summarisation of guest preferences and interaction notes, improving shift handover continuity. Click the video below to watch a demonstration.
Video 4: Hotelly Demo
Figure 34: The Hotelly interface operates as a discreet desktop overlay alongside existing PMS systems
Figure 35: At the close of each interaction, Hotelly generates a summarised recap of guest preferences, requests, and key conversation points
User testing was conducted through engagements with hotel directors and front-office staff. To evaluate functional accuracy, simulated role-play sessions were conducted in which participants acted as guests interacting with Hotelly, while team members took on the role of hotel staff, allowing us to assess the system’s real-time prompting accuracy, note summarisation, and usability under realistic conversational conditions.
Four key themes emerged from user testing with front desk staff and hospitality trainees:
The full design rationale, value proposition, and prototype documentation for Hotelly are included in Appendix K.
Aria addressed the specific tension between conversation and data entry at the front desk. Rather than prompting staff with information, Aria listened to guest conversations, transcribed key details in real time, and automatically populated relevant fields in the PMS without requiring staff to type. Staff could verify, edit, and approve all captured information before it was saved, maintaining accuracy and accountability. Aria could also surface relevant answers to guest questions, suggest follow-up prompts, and reference hotel policies, FAQs, and room availability in real time. Click the video below to watch a demonstration.
Video 5: Aria Demo
Figure 36: Aria requires explicit guest consent before activation, with transcripts retained briefly for verification
Figure 37: Throughout the conversation, Aria does transcription and highlights key extracted information, while surfacing AI-generated prompts and answers to guest questions
Figure 38: Aria surfaces actionable guest requests and captured preferences for staff to review, edit, and approve
Feedback was gathered through a structured discussion with a front office manager and an IT director, conducted using a video demonstration of the Aria prototype. Three key themes emerged:
The full design rationale, value proposition, and prototype documentation for Aria are included in Appendix L.
These four prototypes collectively explored the pre-arrival, check-in, and staff support dimensions of the problem space. While each addressed a genuine and well-evidenced pain point, none resolved the physical arrival experience. This gap, consistently surfaced across primary research but left unaddressed by all four prototypes, became the central question we brought to Stanford.
During the one-week visit to Stanford, we adopted a Dark Horse Prototyping approach to deliberately explore a radical future-state concept and surface deeper insights about what luxury means in an automated hospitality context. Instead of refining existing assumptions incrementally. We specifically delved further into our design direction 3 (Human-Centric Automation for Enhanced Hospitality), as we continued to think more about how we could solve key pain points highlighted in our primary research section: thus we explored a radical concept of a floating AI hologram robot guiding guests.
Figure 39: Aerohost and Luggage-Carrying Robot (Wizard-of-Oz Prototypes)
The prototype, named AeroHost, reimagined check-in as a hosted journey led by a small flying drone with a holographic character that greeted guests, coordinated luggage handling with another luggage-carrying robot, supported identity verification, and escorted guests through the arrival process. We used a Wizard-of-Oz setup combining a phone-based conversational AI, iPad-based visual prompts, a manually operated luggage bot, and projected navigation cues.
Live user testing generated both structured ratings and qualitative reactions. The prototype scored well on social comfort, security and trust, and cognitive clarity, but lower on luxury, indicating that novelty alone does not translate into a premium experience.
Four key insights emerged from the Stanford week:
Luxury requires effortlessness, not novelty. The most consistent breakdown point was the luggage handoff. Participants reacted negatively when required to lift and place their own bags onto the robot. Automation that transfers effort from staff to guest, however innovative in appearance, fails the luxury standard.
Digital interactions require physical grounding. Users were confused about where to scan passports and present cards when instructions were not coupled to clear physical cues. High-technology interfaces require low-technology anchors (e.g. lights, markers, and spatial placement to be immediately legible).
Hospitality must be designed as continuity, not transaction. Participants responded negatively when the interaction ended at key issuance. The arrival experience must extend beyond identity verification to navigation, room entry, and ongoing reassurance.
Conversational AI enables technology to deliver a personalised touch. The Stanford Dark Horse experience did not produce a final solution, but it fundamentally changed the team’s confidence in AI-driven avatar interaction as a design direction. Prior to the Stanford visit, the idea of an AI virtual avatar as a guest-facing hospitality interface had been considered but set aside, as its viability and appropriateness within a luxury hotel context remained uncertain. During live user testing, participants engaged with the conversational AI component more naturally and receptively than anticipated, suggesting that guest comfort with AI interaction had matured significantly, driven both by the novelty and the normalisation of AI tools in everyday life.
The Stanford findings shifted the team’s design direction in three ways: from automation as efficiency to automation as service augmentation, from isolated check-in touchpoints to an end-to-end arrival journey, and from novelty-driven to grounded, legible interaction.
These shifts were captured in 2 more in-depth How Might We statements, building off all our previous insights and prototypes:
As such, two new concept directions emerged in parallel, each attempting to address the gaps the AeroHost prototype had exposed.
The first was a low-profile luggage robot capable of flattening itself to ground level so that guests could load their baggage without lifting which would directly resolve the handoff friction that had been among the most criticised moments in the Dark Horse testing. In its standard operating form, the robot would rise to its full height and function as a mobile amenity, guide and AI recommendation platform. We briefly explored an alternative mechanical approach using a forklift-style system to hook and drag luggage autonomously, but this too was set aside as impractical. More fundamentally, the team recognised the need to first validate whether guests actually wanted an autonomous luggage companion at all before committing to complex hardware, and the Autonomous Mobile Robot (AMR) platform available at the University did not readily support the flattening mechanism in any case.
Figure 40: Luggage Bot Conceptual Design
The second concept was a digital room key embedded with a live AI avatar, a handheld interface that could answer guest questions, provide navigation guidance, and personalise the arrival experience beyond the check-in counter. While conceptually appealing, this direction was ultimately paused. Without a more distinct interaction model, the concept risked being too close to simply repackaging an existing large language model interface and would not represent a meaningful design advancement.
Figure 41: Hotel Digital Key Conceptual Design
Drawing on the field observations documented in Section 3.3.2, the team identified a stronger use case for the luggage robot: not to replace the bellhop trolley, but to offer guests an alternative that kept their belongings with them throughout the check-in journey, eliminating the friction of either handing luggage off upon arrival or managing it unassisted while waiting to check in.
Before consolidating the final concept, the team mapped out the complete guest arrival journey from the moment a guest reaches the hotel entrance through to settling into their room, as illustrated in Figure 42 This exercise served to identify every touchpoint where the solution could intervene, and more importantly, where it should not — ensuring that the concept enhanced the arrival experience rather than disrupting moments where human interaction remained valuable.
Figure 42: Guest Arrival Journey Map — Identifying Key Touchpoints and System Requirements
Mapping the journey surfaced several key considerations. First, the solution had to slot naturally into an existing hotel workflow without requiring the property to restructure its operations around the technology. Second, it had to account for variability in guest behaviour — guests arriving with different amounts of luggage, first-time guests unfamiliar with the property layout, and guests arriving at off-peak hours when staffing is reduced. Third, any automation introduced had to feel intentional and premium rather than transactional, consistent with the expectations of a luxury hotel guest.
From this exercise, four core capabilities were identified as necessary for the concept to deliver a complete and self-sufficient arrival experience: autonomous navigation to escort the guest from the lobby to their room, luggage transport so the guest arrives hands-free, conversational AI check-in to handle identity verification and reservation confirmation, and payment processing to complete the check-in without requiring a separate interaction at the front desk. These four functions formed the basis of the concept.
With the robot already accompanying the guest, integrating a self check-in process and an AI concierge becomes a natural extension rather than a separate system. The concepts of a physical luggage companion and a conversational AI interface were therefore consolidated into a single integrated platform, forming the foundation of ELEVIA.
ELEVIA is an AI-powered concierge system that unifies autonomous mobility, luggage transport, conversational check-in, and identity verification and payment into a single, continuous arrival experience, as first conceptualised in the early sketches shown in Figures 43 and 44 Rather than digitising individual touchpoints in isolation, the concept embeds every check-in function into one physically present, conversationally intelligent system that accompanies the guest from the lobby through to their room. The underlying design principle is that luxury automation must reduce effort for the guest, not transfer it — eliminating the fragmented handoffs between arrival, luggage management, check-in processing, and room navigation that characterise the conventional hotel arrival sequence, and replacing them with a single uninterrupted interaction.
Figure 43: Conceptual Design Sketch of the ELEVIA System
Figure 44: Conceptual Design Sketch of the ELEVIA System
ELEVIA is realised through the integration of 6 main components, which together form the full functionality of the system.
At the heart of the ELEVIA concept is an autonomous mobile robot that serves as the physical embodiment of the system. Unlike a fixed kiosk or a purely digital interface, the AMR gives ELEVIA a tangible presence, meeting the guest at arrival, accompanying them through the check-in process, and escorting them to their room. This physical continuity is what distinguishes ELEVIA from existing self-service check-in solutions, which complete a transaction but leave the guest to navigate the rest of the arrival journey independently.
For the AMR to fulfil this role, it must be capable of navigating hotel environments autonomously, detecting and avoiding obstacles in real time, and operating safely alongside guests and staff without requiring dedicated pathways or infrastructure modifications. Equally important is its form factor. The robot must be compact and low-profile enough to move unobtrusively through lobbies and corridors, and refined enough in appearance to sit comfortably within a luxury hotel aesthetic. A robot that appears industrial or bulky would undermine the very experience it is designed to elevate.
A defining feature of the ELEVIA experience is the luggage porter function, in which the AMR physically carries guest luggage from the point of arrival through to the guest’s room. This capability is central to the core design principle of reducing guest effort. By taking ownership of the luggage from the moment the guest is greeted, ELEVIA eliminates the need for the guest to manage, monitor, or handle their bags at any point during the arrival journey.
Conceptually, the luggage porter function transforms the AMR from a navigation aid into a physical companion. Rather than the guest following a robot to their room while still managing their own bags, the luggage travels with the robot and the guest travels with the luggage, arriving at their room hands-free and without interruption. The value of the function lies not just in the physical transport of luggage, but in the sense of effortlessness it creates throughout the entire arrival sequence.
For this function to work effectively, the AMR platform must offer sufficient deck space to accommodate a realistic guest luggage load, enough payload capacity to carry that load safely, and the ability to navigate hotel corridors at a pace that feels natural alongside a walking guest. These requirements informed the evaluation of any platform considered for realising the ELEVIA concept.
Apart from the physical device, the other design challenge was the check-in interaction itself: how the guest would identify themselves, complete payment, and receive their room key, all while being conversed with by an intelligent system that felt warm rather than mechanical. Three core capabilities were designed to address this: a passport reader for identity verification, an NFC module for contactless payment, and an AI concierge agent to orchestrate the entire experience.
The AI concierge is the most consequential design decision in the check-in system. It determines not just how the guest completes administrative steps, but how the entire arrival feels.
The central question was whether to use a traditional state machine (a fixed sequence of screens and button presses) or a conversational agent capable of adapting in real time. Our research made this clear: guests consistently rejected interactions that felt transactional or rigid, and the Stanford prototype revealed that guests respond positively to conversational AI when grounded, clear, and hospitable.
We designed the AI concierge as an LLM-driven agent with function-calling capabilities. We envisioned the agent having a professional concierge persona and being equipped with data tools that query live hotel information (reservations, availability, amenities) and UI action tools that control the screen (triggering the passport scanner, initiating payment, issuing a digital key, etc). The LLM decides which tools to call based on what the guest says, allowing check-in to unfold as natural dialogue.
Figure 45: AI Concierge Persona
This architecture addresses three core considerations. First, automation as service augmentation: responses are short and tuned for spoken delivery, replicating the warmth of a human concierge. Second, grounded interaction: the agent never fabricates hotel data, as every factual answer is retrieved through tool calls. Third, continuity beyond the transaction: after check-in, the agent continues conversing during the robot escort, maintaining the feeling of being hosted throughout arrival.
In a traditional setting, the guest hands their passport to a staff member who either then slots it into passport scanners, image capture machines or manually keys in the details. Self-service kiosks allow guests to scan their passports themselves through dedicated passport scanner modules, and we wanted to bring this into our solution as well. Our approach was thus to embed a passport scanner, positioned at a natural angle for the guest to simply slide their passport in flat. This approach would allow identity verification to happen mid-conversation with minimal disruption.
Payment processing in luxury hotels typically involves handing over a credit card to staff or navigating a payment terminal on a kiosk, both of which introduce friction where the guest must pause and engage with a separate device. We chose contactless NFC over alternatives such as QR code scanning or on-screen card entry for two reasons. First, it is the fastest physical payment interaction available that is also the most common and intuitive, requiring only a single tap lasting less than a second. Second, and more importantly from a hospitality design perspective, a tap requires no visual attention or manual input, allowing the guest to maintain eye contact with the avatar and stay within the conversational experience rather than shifting focus to a separate payment interface.
These 4 performance dimensions shaped how the check-in subsystem was designed and iterated throughout development.
Speed and responsiveness: the full voice loop, from the guest finishing a sentence to the avatar replying, needed to feel conversational. The pipeline was designed with streaming text-to-speech and barge-in support so the guest can interrupt mid-sentence, mirroring natural turn-taking.
Accuracy and trustworthiness: every piece of hotel information must be factually correct. The tool-calling architecture ensures this by grounding responses in database queries. Fuzzy name matching handles misspellings gracefully, suggesting corrections conversationally rather than returning a hard failure.
Graceful degradation: no single failure should prevent check-in from completing. If the passport camera fails, the guest provides their name verbally. If NFC is unavailable, payment proceeds manually. If the primary AI provider is unreachable, the system falls back to an alternative model.
Hospitality tone: beyond functional performance, the system was evaluated on whether the interaction felt premium, including persona, response pacing, and the ability to handle off-topic questions mid-flow.
Our final prototype, ELEVIA, is a robot-mounted AI concierge that unifies four capabilities into a single, continuous arrival experience: autonomous mobility, luggage transport, conversational AI check-in, and hardware-based identity verification and payment. The design intent was to directly address the core insight that luxury automation must reduce effort for the guest, not transfer it by embedding every check-in function into one physically present, conversationally intelligent system that accompanies the guest from lobby to room.
Figure 46: Full ELEVIA Prototype
Figure 47: Full ELEVIA Sketch with Parts Labelled
The system, built on a SESTO Magnus AMR as the foundation, provides the physical platform for navigation and luggage transport. Mounted on the AMR is a display connected to an NVIDIA Jetson, which runs a custom React frontend that presents a life-sized AI avatar, a conversation panel, and step-by-step check-in overlays. The robot also carries a USB webcam packaged into a passport scanner, and an ESP32-based NFC reader for contactless payment. These subsystems are coordinated through a Node.js backend that acts as the central orchestrator. Audio input and output are handled through a Jabra speakerphone mounted alongside the display, selected for its omnidirectional microphone pickup and noise cancellation suitable for a hotel lobby environment.
Figure 48: Labelled System Diagram
The integrated check-in flow works as follows. The robot travels to the guest upon arrival, and a staff member assists the guest in loading luggage onto the robot platform, before introducing the AI Concierge Agent (also referred to as the AI avatar). The AI avatar is able to greet the guest by voice and asks for his/her name. Through natural conversation, the agent retrieves the guest’s reservation, prompts them to scan their passport on the robot-mounted camera, confirms booking details, offers a room upgrade if available, and processes payment via NFC card tap. Upon completion, the guest receives a digital room key by email (with Apple Wallet support), and the robot autonomously navigates to escort them to their room, continuing to converse along the way.
Watch the full prototype showcase: ELEVIA, our all-in-one premium autonomous check-in robot—delivering seamless guest arrival, AI-powered concierge, and effortless luggage transport.
Critically, the AI agent drives all screen transitions. Rather than a fixed sequence of button presses, the LLM decides what the screen displays next based on the conversation, keeping the interaction natural and responsive. If the guest asks an off-topic question mid-flow, wants to skip the upgrade offer, or gives a misspelled name, the system adapts without breaking. This conversational flexibility was a deliberate design response to the finding that rigid kiosk workflows feel transactional and impersonal.
This final prototype involved iterative enhancements of multiple subsystems, namely the (1) Robot Body, (2) Peripheral housing, (3) AI Agent, (4) Passport Scanner & NFC which will be further expounded upon.
For the purpose of prototyping and validating the ELEVIA concept, the team utilised the SESTO Magnus AMR available through EDIC’s lab, as shown in Figure 49, rather than fabricating a bespoke platform. This decision allowed development effort to be concentrated on the components unique to the concept, namely the AI avatar capabilities and system integration, while still realising a fully functional end-to-end prototype.
Figure 49: SESTO Magnus AMR
The SESTO Magnus was evaluated against the functional requirements established in section 6 and proved well-suited for prototyping purposes. Its relatively compact, low-profile form factor (743 × 627 × 350 mm) aligned with the sleek aesthetic central to the luxury hotel context. Its open cargo deck supported a payload of up to 300 kg, comfortably exceeding typical guest luggage loads, and its footprint was confirmed to accommodate at least two large suitcases without requiring modification or the addition of retractable extenders. Its maximum operating speed of 1.2 m/s was compatible with a comfortable average human walking pace of approximately 1.3 m/s (Cronkleton, 2025), satisfying the requirement for the robot to travel naturally alongside a guest. Navigation was handled by dual Safety LiDARs with a range of 40 m each and 360° combined coverage, providing the real-time obstacle detection and rerouting capability needed for safe deployment in a live, high-footfall environment.
Together, these characteristics confirmed that the SESTO Magnus was not merely a convenient available platform, but one that genuinely met the functional requirements of the luggage porter use case without compromise.
We mounted a dedicated WiFi router with a SIM card onto the SESTO Magnus to serve as the shared network between the AMR and our development laptop. This allowed both devices to operate on the same IP address, establishing a wireless connection to the SESTO Fleet UI and enabling access to the system configuration interface.
We mapped the EDIC Hub by manually driving the SESTO Magnus around the space using a wired remote controller, as shown in Figure 50, tracing the perimeter first before covering all navigable internal paths. This allowed the system to register fixed obstacles such as tables, chairs, and couches throughout the space. The completed floor map as rendered in the Fleet UI is shown in Figure 51.
Figure 50: Remote Controller of the SESTO Magnus AMR
Figure 51: Rendered Mapping of EDIC Hub on the SESTO Magnus AMR Fleet UI
After mapping, we initialised the AMR by physically pushing it to the designated recovery waypoint, establishing its positional awareness within the active map and enabling autonomous navigation.
We plotted waypoints across the EDIC Hub to simulate a hotel environment, defining a minimum of one recovery point, one park point, and one charging point as required by the system. The recovery point was set as the AMR’s default standby position when idle. Additional waypoints representing hotel locations including the hotel porch, lobby, restaurant, and room destinations such as Rooms 2501, 1501, and 3501 were placed at distinct reference points around the hub as shown in Figure 52. For each destination waypoint, we configured the arrival heading angle to ensure the AMR oriented itself correctly relative to the guest upon reaching its destination, which is important for a natural and intuitive handover moment at the room entrance.
Figure 52: Waypoints plotted based on mapping
We set the obstacle stopping distance to 1 metre, ensuring the AMR decelerates and halts well before entering the personal space of nearby guests during navigation. Selected configuration parameters are shown in Figure 53.
Figure 53: Configuration Parameters of each waypoint and intermediaries
With all waypoints configured, we conducted navigation tests by commanding the AMR to travel to each destination and observing its performance along each route. The key parameters we validated were autonomous obstacle avoidance, route consistency, and whether the AMR’s travel speed matched a comfortable walking pace alongside a guest. These tests were essential given that the SESTO Magnus formed the physical backbone of the ELEVIA prototype and any navigation failures would directly compromise the end-to-end guest experience.
The luggage shelf was designed as a custom structure built directly around the AMR, serving the dual purpose of providing a secure platform to house the check-in hardware and peripherals (NFC scanner and passport reader) and monitor that form the guest-facing interface of ELEVIA.
The design process began with dimensioning the kiosk frame footprint against the SESTO’’s physical profile. A key constraint was preserving access to the AMR’s control panel, including its buttons and key, without the structure exceeding the robot’s outer edge. To resolve this, one side of the bottommost level was left open without a profile, creating a clearance zone around the control panel while keeping the overall footprint within the AMR boundaries. The frame was designed to align with the existing threaded holes on the Sesto platform, allowing it to be screwed directly into the base while sitting flush against the robot body, giving the appearance of an integrated rather than retrofitted structure.
Figure 54: AMR platform threaded hole location referenced onto the T-slot aluminium profile
Figure 55: AMR with the T-slot aluminium profile base
Figure 56: AMR with the fully assembled T-slot aluminium profile
The frame was constructed from 30x30mm aluminium T-slot extrusion profiles, selected for their ready availability, ease of cutting and drilling, and compatibility with the inner corner L-brackets and rhombus nut fasteners used throughout the assembly. Aluminium was preferred over steel for its lower weight, reducing the overall load on the AMR platform while maintaining sufficient structural rigidity for the prototype’s requirements.
The structure is organised into five functional levels, with component placement determined by ergonomic accessibility and spatial requirements, as shown in Figure 56 The first level sits at the base of the frame directly above the AMR platform and is intentionally left without a screwed-on shelf panel to preserve access to the Sesto’s control panel for routine startup and maintenance. The second level houses the Jetson module and the server box, positioned low in the structure as it requires no guest interaction and should only be accessed for maintenance and software updates. The third level is dedicated to the router, which requires the full clearance of that level due to its size and should be covered up for the same reason unless maintenance is required. The fourth level houses the NFC scanner and emergency stop button, positioned at approximately arms-reach height for intuitive guest interaction and accessible operator intervention. The passport reader is mounted at the front of the fifth level, positioned just to the side of the monitor to minimise guest reach distance and improve interaction intuitiveness. The fifth and uppermost level consists of a thick 10mm aluminium plate mounting the monitor stand, selected for the rigidity and load-bearing strength required to hold the monitor securely during robot movement, where acrylic would be insufficient.
Intermediate shelf levels use 5mm white acrylic, chosen for its low cost, low weight, strength, and ease of cutting, while matching the Sesto’s default white body colour. The visible shelf surface is lined with maroon felt to reinforce the premium aesthetic of the overall system.
To ensure the structure integrated visually with the Sesto body, custom interface frames were modelled in PTC Creo and 3D printed in white. These frames sit mostly flush against the curves of the Sesto base, with cutouts aligned to the aluminium profiles for direct fastening via rhombus nuts. As the cutouts reduced the material thickness at the curved edge, a corresponding protrusion was added on the opposite side to compensate, maintaining the structural rigidity of the printed frame. A removable magnetic door provides quick access to the Sesto’s control panel for maintenance without disrupting the exterior appearance of the structure. The following are images of the right bottom level frame.
Figure 57: Computer-Aided Design of the AMR Shelf Panels
Figure 58: Computer-Aided Design of the AMR Shelf Panels assembled
Figure 59: Assembled 3D printed panels with the magnetic panel
Figure 60: Fully Assembled Pheripheral Housing and AI Avatar Eye Height
Figure 61: Monitor Arm Screwed onto the Metal Plate
A monitor was chosen over alternative display types such as tablets or touchscreen panels as it offered the combination of cost-effectiveness, appropriate screen size for the life-sized AI avatar display, and ease of mounting on a height-adjustable stand. The monitor stand was also readily available for purchase and also allows the screen height to be manually adjusted, with the AI avatar’s eyes positioned at approximately 1530mm from the ground. This height was determined using anthropometric data from BS ISO 7250-3:2015, specifically the Asian regional standing eye height ranges, which better represent the expected user demographic in a Singapore hospitality context than worldwide ranges (British Standards Institution, 2015). The midrange value across Asian male and female adults is approximately 1530mm ensuring the avatar’s gaze meets the eyeline of the majority of standing Asian adult guests for a natural face-to-face interaction.
The AI concierge is the central intelligence of the check-in experience. A key design decision was to build it as an LLM-driven conversational agent rather than a rigid state machine. Traditional hotel kiosks follow fixed screen sequences: scan passport → confirm booking → tap card → collect key. This works for efficiency, but as our research showed (Section 4.5), guests perceive such interactions as cold and transactional. Our approach was to use a large language model (GPT-4o) with function-calling capabilities, allowing the dynamic check-in to unfold as a natural dialogue where the AI decides what to do next based on what the guest says, not a button they press.
Figure 62: Example AI Interface Screenshots
All backend software for the AI agent is hosted on the NVIDIA Jetson, which communicates with OpenAI’s API for LLM inference. The agent operates through a tool-calling architecture. It has access to two categories of tools: data tools that query live hotel information (reservation lookups, room availability, hotel amenities), and UI action tools that control what the screen displays (advancing the check-in step, triggering the passport scanner, initiating payment, issuing a digital key, or commanding the robot to navigate). On each conversational turn, the backend sends the full conversation history and current context to the LLM. If the model determines it needs information or wants to trigger an action, it calls the appropriate tool; the backend executes it, feeds the result back, and loops until the model produces a spoken reply. This loop runs up to five iterations per turn to prevent runaway calls.
Figure 63: Simplified diagram of AI System
| Tool Name | Description |
|---|---|
| lookupreservation | Looks up a guest reservation by confirmation code or reservation ID. |
| lookupreservationbyname | Looks up a reservation by the guest’s first and last name, with fuzzy suggestion support. |
| lookupreservationbypassport | Looks up a reservation using the guest’s passport number. |
| gethotelinfo | Retrieves hotel details such as amenities, Wi-Fi, breakfast hours, and contact info. |
| getavailablerooms | Returns a list of currently available rooms with types, prices, and amenities. |
| getroomupgrades | Returns available room upgrade options based on the guest’s current room type. |
Table 13: Data / Query Tools
| Tool Name | Description |
|---|---|
| triggerpassportscan | Displays the passport scanner UI for guest identity verification |
| skippassportscan | Skips the passport scanning step and falls back to manual verification |
| triggerpayment | Displays the payment UI for guest to complete their transaction |
| dispensekeycard | Displays the digital key card dispensing screen after successful payment |
| setcheckinstep | Updates the check-in progress bar on the kiosk UI to the specified step. |
| movetoroom | Fetches the robot waypoint for the guest’s room and navigates the robot to escort them there |
Table 14: Action/UI Control Tools
This pattern gives us conversational flexibility. The guest can say things in any order, ask tangential questions (“What time is breakfast?”), or skip steps (“I don’t want an upgrade”), while keeping all side effects under server-side control. The AI never fabricates hotel data; every factual answer is grounded in a database query through its tools.
The agent’s persona is defined through a carefully engineered system prompt: a warm, professional luxury concierge whose responses are constrained to two to three short sentences of natural spoken language. This constraint was designed specifically for text-to-speech output, as longer or formatted responses (bullet points, markdown) sound unnatural when spoken aloud and increase audio latency.
Voice interaction for the AI agent runs through a real-time pipeline. The frontend captures microphone audio using the Web Audio API with voice activity detection and streams it to the backend, where OpenAI Whisper transcribes the speech to text. The transcript is then processed through the same AI agent tool-calling loop described above, and the resulting reply is synthesised into audio using OpenAI Text-To-Speech (TTS). This audio is streamed back to the frontend and played through the AI avatar powered by Simli, a real-time avatar rendering SDK that synchronises lip movements and facial expressions to the audio stream over WebRTC. The avatar gives the guest a face to speak to rather than a static screen, reinforcing the sense of being hosted by a concierge rather than interacting with a machine.
To ensure the interaction feels natural, we implemented barge-in support. If the guest begins speaking while the avatar is still talking, TTS playback is interrupted immediately and the new utterance enters the pipeline from the start. This mirrors the natural turn-taking of human conversation and avoids the frustration of having to wait for the system to finish before responding, a common complaint with voice-based interfaces.
Testing of the AI agent covered both functional validation (whether intended capabilities work correctly) and performance evaluation (how reliably and effectively they work under varied conditions).
Functional validation was conducted through structured walkthroughs of the full check-in flow, verifying that the agent called the correct tools in the expected sequence and that all screen transitions fired as intended. We tested a range of edge cases including misspelled guest names (triggering Levenshtein fuzzy matching and conversational correction suggestions), missing reservations, passport scan failures with manual fallback, declined room upgrades, and off-topic questions mid-flow such as “What is the Wi-Fi password?” In all cases, the agent was expected to handle the deviation gracefully without breaking the check-in flow.
Performance evaluation focused on three measurable dimensions. First, voice pipeline latency: we profiled the full round-trip from the user finishing a sentence to the avatar beginning its spoken reply across 20 consecutive interactions. The median round-trip time was approximately 5 to 6 seconds, which is still slightly slower than human conversation. Second, tool-call reliability: across all testing sessions, we logged whether the agent selected the correct tool for the conversational context. The agent consistently selected appropriate tools, with the most common deviation being unnecessary repeated lookups when the guest rephrased a request already fulfilled. Third, barge-in responsiveness: we tested whether TTS playback was interrupted within a perceptible timeframe when a user began speaking mid-reply. Interruption was near-instantaneous in all cases tested.
The passport reader was designed to make identity verification feel like a natural part of the conversation rather than a separate administrative step. When the AI agent reaches the identity verification stage, it triggers a scan overlay on the kiosk screen and asks the guest to insert their passport.
Our approach was to embed a passport scanner box directly onto the robot’s kiosk body, positioned at a natural angle for the guest to simply insert their passport biographical data page, facing down. In the passport scanner box is a USB-connected camera facing upwards that captures the image and processes it, allowing us to prototype without spending money on an industry-grade passport scanner. The guest simply scans the passport page on a scanning box mounted on the robot, and no separate scanner device or physical handoff is required.
Figure 64: Guest Scanning Passport
Figure 65: USB Camera in the scanner box
The passport reader hardware went through two main design iterations before reaching its final form, with an additional refinement to the insertion interface.
Figure 66: Initial Passport Cover Design
Figure 67: Second Passport Cover Design
The first passport scanner top frame design iteration established the basic enclosure form but proved to be confusing. A top cover was added to better suggest the correct insertion method for the second iteration. However, it also proved to be unintuitive in user testing. Participants consistently attempted to insert the passport vertically rather than in the intended orientation. The solution came from adding a clear acrylic panel beneath the slot. We also added a passport cover to the mock passport card. This made the flat insertion surface visible and immediately communicated to the guest that the passport should be laid flat and slid in horizontally in a particular orientation, which is further reinforced by visual cues on the screen. The feedback received was that the process is similar to the passport scanner at the airport. A refinement is to redesign the base of the passport scanner housing to better secure the positioning of the LED strip and camera.
Figure 68: Passport Scanner with clear acrylic
Figure 69: Revised Mock Passport Cover
The passport reader is mounted on the shelf structure facing the guest. When the AI agent reaches the identity verification stage, the ESP32, which is in wireless communication with the Jetson compute module through the router, triggers an LED strip positioned along the bottom edge of the flat insertion surface, closest to the guest. Once the guest name has been found in the database, the LED strip on the passport scanner will automatically light up and blink continuously in green as the AI avatar instructs the guest to insert their passport, drawing on the universal association of green with a ready or go signal to intuitively indicate that the slot is ready for use while ensuring visibility even in low-light environments. Once the passport details have been captured, the LED strip automatically turns off. A sticker indicating the correct insertion orientation was also designed to be added to the passport reader surface as a visual cue, further reinforcing the flat insertion direction for guests.
Figure 70: Passport Reader Visual Cue Sticker
Figure 71: Green LED to Enhance User Experience Figure 72: LED flash
Another LED strip connected to the ESP32 also serves a functional role in the Optical Character Recognition (OCR) pipeline. As shown in Figure 73, the illumination provided by the LED flash improves image clarity and MRZ contrast, directly improving OCR accuracy under the varying lighting conditions typical of hotel lobbies.
Figure 73: Lighting enhancements for passport scanning (before and after)
How It Works
Once the passport is presented to the scanner, the system enters a polling loop that repeatedly acquires frames until a successful Machine Readable Zone (MRZ) is obtained from the captured image. The recognition pipeline is built around EasyOCR and is tailored to the ICAO 9303 TD3 passport format, which defines the two-line MRZ used in standard passport booklets. Rather than relying on a single raw capture, the system evaluates candidate frames and applies several preprocessing variants, including sharpening, grayscale conversion, and contrast enhancement. These generate multiple OCR hypotheses, which are merged using a confidence-weighted voting stage to improve robustness.
Figure 74: Machine Readable Zone (Sample)
EasyOCR operates through two underlying neural components: a text detection model to localise text regions and a text recognition model to decode the detected text. In the passport pipeline, the detection stage is first applied to the preprocessed passport image to identify candidate text regions. The pipeline then applies TD3-aware structural heuristics to identify the two MRZ lines based on their expected format. Once identified, their union is cropped into a focused strip, deskewed, and processed across several image variants. EasyOCR’s recognition model is then applied to these variants, and the final passport number and guest name are extracted only from the vote-winning MRZ lines, with checksum validation used to reject invalid readings.
Testing
Passport OCR accuracy was evaluated across three test passports with distinct MRZ layouts and print qualities. Since all test standard passport booklets conform to the same ICAO 9303 TD3 format, the critical variable for OCR performance is not the diversity of passports but the consistency of extraction under varying imaging conditions.
The LED strip provides consistent illumination of the passport surface during scanning. Flash illumination was found to improve MRZ contrast and OCR accuracy compared to ambient lighting alone. Insertion angle was not a variable because the enclosure mechanically constrains the passport to a fixed flat orientation relative to the camera, deliberately reducing the degrees of freedom the pipeline needs to handle. However, occasional slight tilting of the inserted passport is handled through deskewing in the preprocessing pipeline.
EasyOCR’s model initialisation introduced a noticeable cold-start delay, resolved by loading the model at program startup in parallel with the kiosk UI so guests experience no perceptible wait. Occasional OCR substitutions between visually similar characters (e.g. “H” and “M”) are handled downstream through fuzzy string matching against existing guest records, with the AI concierge confirming the closest candidate conversationally.
The NFC payment module was designed to simulate the contactless payment step within the check-in flow. The hardware consists of an ESP32 microcontroller paired with a PN532 NFC module, housed in a custom 3D-printed enclosure mounted on the robot body (Figure 75).
Figure 75: NFC Payment Module
A sticker was designed to be added to the NFC reader surface as a visual cue, allowing guests to immediately identify the tap point without verbal instruction, improving intuitiveness of the interaction.
Figure 76: Visual que sticker for the NFC Payment Module
The enclosure was designed to position the NFC reader at a natural tap height for the guest, with an integrated LED indicator that provides visual feedback when a card is detected.
Figure 77: Guest Making Card Payment
When the AI agent reaches the payment step in the conversation, it triggers a payment overlay on the kiosk screen and verbally invites the guest to tap their card. The ESP32 detects the card’s unique identifier and transmits it to the backend via USB serial, which then maps the identifier to a card’s last four digits for on-screen confirmation. The detection-to-confirmation cycle was measured at under one second during testing, ensuring the payment step does not interrupt the conversational flow.
Figure 78: NFC Flow
It is important to note that the current prototype does not process real transactions. The NFC reader captures card identifiers as a proof of concept to validate the interaction design and the integration of a physical tap gesture within a voice-led check-in flow. The design decision to use contactless NFC over alternative payment methods (such as QR code scanning or on-screen card entry) was driven by minimising guest effort: a single tap requires no visual attention or manual input, allowing the guest to maintain eye contact with the avatar and stay within the conversational experience.
Testing
During development, we explored two communication modes between the ESP32 and the backend. The final prototype uses a direct USB serial connection to the Jetson compute module, which proved more reliable and lower-latency than an earlier WiFi-based approach that transmitted identifiers over the local network. The WiFi mode, which we decided not to go with, included AES-128-CBC encryption to prevent UID spoofing, which was useful but unnecessary once all hardware was co-located on the robot. With all of this said, we recognise that this is ultimately a prototype. A production deployment would replace the ESP32/PN532 setup with an industry-grade payment terminal capable of processing real transactions securely, with full regulatory compliance and integration with hotel payment gateways.
Testing was conducted with multiple NFC-enabled cards and mobile wallets to verify consistent and reliable detection across different card types. We also verified the auto-close behaviour, where the serial listener stops after the first successful tap to prevent duplicate registrations.
With all components — the WiFi router, Jetson Orin Nano, LED monitor, and ESP-32 — set up individually, the next challenge was establishing a common power source that would allow the prototype to operate without any connection to wall sockets, which would otherwise constrain the AMR’s freedom of movement. Opening the SESTO Magnus control panel revealed a user power outlet using a D-Sub type connector, labelled as port 7 in Figure 79, capable of supplying 48V DC at a maximum of 20A. The close-up of this connector is shown in Figure 80
Figure 79: User Interface Panel
Figure 80: Close-up of User Power Connector
To draw power from this outlet, we procured an Amphenol CONEC 302W2CPXX41A10X connector and its corresponding housing (Figures 81 and 82).
Figure 81: Amphenol Connector
Figure 82: Connector Housing
With the source voltage and maximum current established, we identified the input voltage requirements for each component as summarised in Table 15 below.
| Component | Source/ Input Voltage | Current | Step-Down Required |
|---|---|---|---|
| SESTO Magnus AMR (Output) | 48V DC | 20A max | |
| Jetson Orin Nano | 19V DC | 2.37A | 48V to 19V |
| ESP-32 | 5 to 9V DC | 1.5A | 48V to 5V |
| WiFi Router | 12V DC | 2A | 48V to 12V |
| LED Monitor | 19V DC | 240mA | 48V to 19V |
Table 15: Power Requirements of Prototype Components
Since the components required different input voltages stepped down from the 48V source, we procured fixed and variable buck converters accordingly. AWG18 wiring, rated for 5 to 10A, was used throughout as it was more than sufficient for the load requirements. Component-specific input connectors were soldered to the wiring and connected to the respective buck converters, as shown in Figure 83
Figure 83: Wiring of Buck Converter
All wired components were then consolidated using Wago 221 push-in wire clamp terminals, allowing every component to draw power from the single AMR source through one unified connection point. An example of the wiring assembly is shown in Figure 84.
Figure 84: Wago Connections
Each wired connection was tested individually using a DC bench power supply and a multimeter to verify connection stability, solder joint integrity, and output voltage accuracy against each component’s input requirement. Once all connections were confirmed, the full assembly was plugged into the SESTO Magnus AMR and powered on to verify that all components functioned correctly and that no components exhibited abnormal heat buildup.
A key architectural decision was how to handle hotel data. Integrating with a proprietary Property Management System like Oracle Opera would require vendor partnerships and API licensing beyond the scope of this project. Instead, we built our own hotel data layer using Supabase (a hosted PostgreSQL database with REST API), modelling the core entities a PMS would contain: hotel information, guests, rooms, reservations, room upgrades, and check-in logs. This gave us full control over the data model while demonstrating that our system architecture could interface with any PMS through a similar abstraction layer.
Figure 85: Simple entity-relationship diagram showing the hotel data schema
Critically, every service function falls back to comprehensive in-memory mock data when Supabase is not configured. This means the entire system runs fully functional without any external database, a deliberate choice that made testing, demos, and local development frictionless. The mock dataset models a fictional “Grand Azure Hotel” in Singapore with realistic reservations, room types, upgrade paths, and guest profiles, to mimic what a luxury hotel with 80 rooms will have.
The AI agent accesses hotel data exclusively through its function-calling tools, which map directly to backend service functions. When the agent calls lookup_reservation_by_name, the backend queries the database and returns the result as structured data. The AI never sees raw database queries or internals. It operates on a clean interface. This separation ensures the agent cannot fabricate reservation details or room availability; every factual claim in the conversation is grounded in the data layer.
Post-check-in room escort is handled by mapping room IDs to robot waypoints in the Sesto fleet management system. When the AI agent’s move_to_room tool is called, the backend looks up the corresponding waypoint and sends a navigation command to the Sesto API. If the API is unavailable, the system logs a mock navigation event and returns success, maintaining the end-to-end flow for testing purposes.
The decision to issue a digital room key rather than a physical keycard was driven by two factors. First, physical keycard dispensing requires dedicated encoding hardware integrated into the robot, adding mechanical complexity and a potential point of failure to a mobile platform. A digital key delivered via email eliminates this dependency entirely. Second, guest expectations are shifting toward contactless access: a joint survey by Skift and Oracle Hospitality (2025) found that over 60% of hospitality executives expected fully contactless check-in and room key delivery to become standard, while 34.4% of guests identified using their own device for hotel access as a must-have (Skift & Oracle, 2025). For the prototype, digital delivery also allowed us to demonstrate the complete check-in flow without sourcing proprietary keycard encoding equipment.
Upon check-in completion, the backend generates a digital room key delivered via email. If Apple Wallet signing certificates are configured, a .pkpass file is generated containing the room number, floor, check-in/out dates, and a barcode. This is emailed to the guest using a branded HTML template. The entire pipeline is non-blocking, as the check-in response returns immediately with the key card number while email delivery happens in the background, ensuring the guest experience is not delayed.
We tested the fully integrated system across three configurations of increasing fidelity.
The first configuration was full-stack local with mock data, serving as our primary development and iteration environment. All services ran locally with in-memory mock data, no external database or hardware required. This configuration allowed rapid iteration on the AI agent’s behaviour, UI transitions, and tool-calling logic. We verified every check-in step end-to-end, from welcome through farewell, confirming that the AI agent correctly orchestrated all transitions and that mock passport scans, NFC taps, and payment processing behaved identically to their real counterparts.
The second configuration connected the backend to a live Supabase instance seeded with test data. This verified that reservation lookups, fuzzy name matching, passport image uploads, and room upgrade queries worked correctly against a real database, and that the data normalisation layer (converting between database and frontend conventions) produced consistent results.
The third configuration was hardware-in-the-loop deployment on the NVIDIA Jetson mounted on the Sesto robot, with the live USB camera for passport scanning (EasyOCR engine) and the ESP32 NFC reader connected via USB serial. We conducted end-to-end check-ins with test passports and NFC card taps, verifying the complete flow from physical interaction through AI processing to digital key delivery. Key findings from this configuration included the importance of LED flash calibration for consistent passport scanning and the need for the serial listener auto-close behaviour to prevent duplicate NFC registrations.
To evaluate the final solution concept and gather actionable feedback for further development, we conducted validation activities across four complementary methods: open-house user testing with members of the public at NUS, hotel feedback sessions, expert review, and a structured survey. Together, these methods provided both qualitative depth and quantitative signal on the solution’s reception, feasibility, and priority areas for refinement.
Figure 87 and Figure 88: Our booth at NUS Open House
User testing was conducted on 7 March 2026 at the NUS Open House. 15 participants completed the full seven-step check-in prototype, from the welcome screen through to keycard delivery. We logged step-completion outcomes and behavioural observations in real time, supplemented by a post-session questionnaire capturing Likert-scale ratings and open-ended feedback.
Our AMR component was not deployed at this stage. Testing was scoped exclusively to the AI avatar check-in interface, evaluating step intuitiveness, voice interaction, and overall usability. The full end-to-end flow including AMR guest escort is planned for a subsequent testing phase once a suitable deployment environment can be secured.
All 15 participants fell within the 14 to 30 age range, distributed as follows: 4 participants aged 14 to 20, 7 aged 21 to 25, and 4 aged 26 to 30 This skews toward a digitally native cohort with high baseline comfort around kiosk interfaces and AI interactions. In terms of accommodation habits, the majority reported frequenting 4-star and 5-star hotels, with a smaller proportion using Airbnb or budget accommodation. Two participants reported experience with 6-star properties, reflecting a range of expectations around what ‘luxury’ service means.
Each of the seven prototype steps was logged for one of 3 outcomes: the participant completed the step without any assistance (‘Completed Unprompted’), required a verbal or physical prompt from us (‘Needed Hint’), or was unable to proceed regardless of assistance (‘Failed / Could Not Proceed’). The table below summarises these outcomes across all 15 participants.
| Step | Unprompted | Needed Hint | Failed | Key Observation |
|---|---|---|---|---|
| Step 1: Welcome Screen | 11 | 4 | 0 | Some users briefly hesitated at initiation, unclear how to begin. |
| Step 2: Voice Interaction | 11 | 4 | 0 | Open-house noise caused automatic speech recognition (ASR) failures; response latency created uncertainty and some frustration. |
| Step 3: Passport Scan | 3 | 12 | 0 | 80% needed guidance on this Wrong orientation or slot; no physical affordance to direct users. |
| Step 4: Reservation Confirmation | 13 | 2 | 0 | Strongest step. Minor AI lag for some users. |
| Step 5: Upgrade Offer | 11 | 2 | 2 | Mostly skipped by users which was expected behaviour. Those that tried generally found it smooth. |
| Step 6: Payment | 8 | 5 | 2 | Tap point somewhat unclear; 2 sessions had screen render failures. |
| Step 7: Keycard / Farewell | 5 | 7 | 3 | Highest failure rate, email lost in spam mailbox |
Table 16: Key Findings broken down into various steps
Microphone performance was raised in 9 of 15 sessions, users described the AI as stopping mid-interaction or failing to register speech, with no visual feedback to indicate whether input had been received. Requests included push-to-talk and a visible recording indicator. Passport scan orientation was the most frequent single-step failure (12 of 15), consistently caused by missing physical affordances. A smaller cluster of users (3 of 15 noted that instructional text was too small, the avatar face too dominant, and that speaking aloud to a screen in a public setting felt socially awkward.
8.1.5 Positive Signals
Speed and convenience were the most consistently praised aspects, raised in roughly 10 of 15 sessions. Multiple users independently highlighted late-night check-in (e.g., arrivals at 2–3am) as a particularly compelling advantage. Four users independently noted a preference for the AI Avatar precisely because it eliminated social interaction, an introverted-appeal angle that emerged without any prompting represented a genuine differentiator. Despite the voice-related issues, several users praised the AI’s conversational quality. Notably, one user observed that the avatar correctly identified an intentionally false last name, suggesting that the underlying model performs well when the audio pipeline is not a limiting factor.
The prototype was well received, with 73% rating it better than a traditional front desk and 80% indicating they would use it again. Navigation clarity, scoring 4.67 out of 5, suggests that the step logic is sound. However, the three main issues of microphone performance, passport scanner affordance, and keycard delivery remain key barriers to a seamless end to end experience and should be prioritised in the next iteration.
Qualitative feedback also revealed strong positioning opportunities, including appeal to introverted users, 24/7 availability, and the perception of technology as a marker of luxury, all of which emerged organically from users rather than being prompted by the team.
To validate the final robot concept against real operational constraints, we conducted structured site visits and feedback sessions with upper-upscale hotel operators in Singapore.
Each session involved a walkthrough presentation of the proposed solution, followed by an open discussion with property management and operations staff on feasibility, guest experience, privacy, and commercial considerations.
Property Profile
Hotel visits were conducted with two properties under The Ascott Limited: Citadines Rochester and lyf One-North. Both were selected for their technology-forward focus relative to traditional luxury hotels.
Figure 89 & 90: Our Visit to Ascott Limited Properties
Key Findings
| # | Key Finding |
|---|---|
| 1 |
Technical Feasibility
|
| 2 |
Privacy & Guest Comfort
|
| 3 |
Solution Architecture
|
| 4 |
Commercial Considerations
Any proposed solution must demonstrate a credible ROI to qualify for funding through the CapitaLand Innovation Fund (SGD 50 million) or the Ascott Fund.
|
Table 17: Key Findings from Our Visit to Ascott Limited Properties
To complement feedback from hotel visits and public testing, we sought an expert perspective grounded in hospitality academia and industry practice.
An expert consultation was conducted with Dr Natt Srinara, Lecturer at Ecole hôtelière de Lausanne (EHL) Hospitality Business School, with over 25 years of experience in hospitality consulting, marketing, and guest experience strategy. His advisory portfolio includes Mandarin Oriental, Pan Pacific, IHG, Marriott, Accor, and the Singapore Tourism Board. The session involved a presentation of the team’s final solution concept followed by a structured discussion on hospitality design principles, luxury guest expectations, and AI adoption frameworks.
Figure 91: Online Meeting with Dr Natt Srinara
|
Table 18: Key Findings from Our Meeting with the Expert
The expert review reinforced the core design premise: that automation in luxury hospitality must augment rather than replace human warmth. Dr Srinara suggested a pivot towards a tiered adoption framework that positions the solution as most appropriate for mid-to-upper tier properties rather than ultra-luxury settings.
To complement the controlled environment of the NUS Open House testing, we conducted a real-world navigation trial in public spaces to observe how people naturally respond to the robot in shared environments. The objective was to understand pedestrian behaviour around the robot, assess comfort levels with robot proximity, and identify design considerations for movement choreography.
The first round of testing was conducted in a lift environment, during which the robot interacted with a sample of roughly 100 members of the public.
Figure 92: A participant interacting with ELEVIA
Figure 93 and Figure 94: Participants sharing a lift with ELEVIA. (Right Image) The participant in red visibly displaying discomfort and positioning close to the door, eager to exit
| Response Patterns from Lift Testing |
|---|
Three distinct response patterns emerged:
|
Table 19: Response Patterns from Lift Testing
When the robot was repositioned to face the back wall of the lift, participants were markedly more comfortable, took up more space, and displayed less anxious behaviour. This suggests that direct eye contact with the robot’s AI avatar face, rather than the robot’s physical presence alone, was the primary source of discomfort, a finding consistent with the uncanny valley concerns raised during the expert review and NUS Open House testing.
Figure 95: Robot repositioned to face the back wall of the lift — participants visibly more comfortable, occupying more space and displaying less anxious behaviour
When the robot was repositioned to face the back wall of the lift, the response changed noticeably. Participants were markedly more comfortable, took up more space in the lift, and displayed less anxious behaviour. This suggests that the direction the robot faces has a significant effect on perceived intrusiveness and social comfort.
A second round of navigation testing was conducted in the open corridors and common areas of NUS, where the robot encountered approximately 10 pedestrians per minute. We wanted to observe how members of the public responded to the robot moving through shared space.
Figure 96 and Figure 97: Real-world corridor navigation testing. (left) A passerby waiting patiently for ELEVIA to pass, (right) pedestrians instinctively moving aside to make way for the robot
|
Table 20: Response Patterns from Corridor Navigation Testing
|
Table 21: Key Findings from Corridor Navigation Testing
To evaluate user adoption, a structured guest survey was administered to validate luggage handling as a recognised pain point among hotel guests and to gather initial reception data on the personal luggage companion robot concept.
The survey was therefore scoped to test luggage handling pain points, covering travel habits, arrival experience, concept appeal, trust and privacy concerns, and likelihood of use.
32 participants across a range of travel profiles. 68.8% stayed in 4–5 star hotels between 3–10 times per year, and 53.1% typically travel with two or more checked bags, establishing a relevant sample for the problem being investigated. Travel purposes spanned leisure, business, family, and mixed-purpose travel.
When asked to consider luggage-related pain points during hotel arrivals, friction surfaced consistently despite most respondents rating their overall arrival experience as smooth. Heavy lifting was the most widely cited pain point at 59.4%, followed by waiting for luggage in the room (34.4%) and lack of location visibility during transit (25%). These findings align with review analysis in Section 4.4, where luggage handling scored the lowest service dimension at 3.37 out of 5.0.
Figure 98: Luggage Related Pain Points
65.6% rated the luggage companion robot as appealing or very appealing. Notably in Figure 98, fetching amenities (58.1%) and security monitoring of the luggage (51.6%) ranked above core luggage transport (41.9%), with answering hotel and local questions coming in third (45.2%). This collectively suggests that guests perceive the robot’s value as extending well beyond the arrival moment and into the broader stay experience.
Figure 99: Most Valued Robot Features
In Figure 100, 59.4% were comfortable or very comfortable with the robot transporting their luggage, with only 21.9% expressing discomfort.
Figure 100: Comfort towards Autonomous Luggage Transport Feature
Additionally, 40.6% rated AI-assisted check-in as appealing or very appealing. When asked to pick features they were comfortable with, Voice-only was the most preferred format (43.3%), while 20% indicated they would not be comfortable with any AI assistant format, suggesting the need for a parallel human-assisted pathway.
Figure 101: AI Check-In Interface Preference
Responses were evenly split between luxury enhancement and convenience feature at 37.5% each, suggesting solution’s strongest fit in the upscale rather than ultra-luxury tier. Likelihood of use averaged 3.19 out of 5, with a bimodal distribution reflecting both genuine advocates and a sceptical segment deterred primarily by privacy and reliability concerns.
The full set of survey results can be accessed via https://drive.google.com/file/d/1DKi2mwWx3UOnLDoQM2IrRlxSfIRDLDr/view
Across the five validation methods, a consistent set of findings emerged that affirm the solution’s core direction and identify clear priorities for the next iteration.
| What Worked |
|
| What Needs Improvement |
|
| Looking Forward |
|
Table 22: Summary of Overall Findings
This section closes the loop between the problem space established, the design directions, and the validation evidence gathered across Sections 7.1 to 7.5. Evaluating where ELEVIA succeeded, where gaps remain, and what the findings mean for the next stage of development.
Against the Five Key Pain Points
| Pain Point | Status | Evidence |
|---|---|---|
| Check-in is high-stakes and time-sensitive | Addressed | Conversational AI check-in replaces queuing and counter overhead. 73% rated it better than traditional front desk. Core logic sound (navigation clarity 4.67/5). ASR reliability and keycard delivery remain technical gaps. |
| Luggage handling is a significant, underaddressed pain point | Partially Addressed | The AMR-based luggage transport targets this. 59.4% cited lifting heavy luggage as a pain point. 65.6% considered the concept appealing or very appealing. Real-world navigation testing validated its movement. Yet, it has not been validated in a live hotel environment. |
| Existing automation fails the luxury standard | Addressed | Warm conversational AI replaced transactional kiosk flow. Guests engaged naturally; several preferred AI over human interaction. Avatar face discomfort (uncanny valley) remains an open design question. |
| Staff are overloaded and the workforce is shrinking | Addressed | ELEVIA absorbs check-in and luggage handling workload without additional staff. Citadines visit confirmed autonomous navigation and lift integration are already commercially deployed in Singapore. |
| Guests want efficiency without losing the feeling of being hosted | Partially Addressed | Survey split evenly between luxury enhancement and convenience feature. Solution fits upscale tier more than ultra-luxury. Unexpected finding: introverted guests preferred AI precisely because it removed social pressure. |
Table 23: Against the 5 Key Pain Points
Against the Design Directions
| Design Direction & HMW | Status | Evidence |
|---|---|---|
| Human-Centric Automation for Enhanced Hospitality How might we make automated systems encapsulate human touch? |
Addressed | LLM-driven conversational AI replaces rigid kiosk sequences with natural dialogue. Validated: 73% of Open House participants rated it better than a traditional front desk, and several independently described it as more comfortable than speaking to a human. |
| Personalisation and Guest Preference Intelligence How might we enable hotels to provide genuinely personalised and tailored experiences? |
Partially Addressed | AI greets by name and retrieves live reservation data via tool-calling. Validated: guests responded positively to being recognised and guided. Deep pre-arrival preference integration (Alluvio) was not carried forward. Remains an open opportunity for the next phase. |
| Empowering Staff Consistency and Confidence How might we help hotel staff perform at their best even in high-pressure guest interactions? |
Indirectly Addressed | ELEVIA absorbs check-in, identity verification, payment, and luggage transport, indirectly reducing workload for front-desk hotel staff. |
| Effortless and Intuitive Arrival How might we design an automated hotel arrival experience that feels effortless and intuitive rather than laborious and frustrating? |
Addressed | Luggage travels with robot, check-in is conversational, key delivered digitally. Validated: navigation clarity scored 4.67/5 and 80% of Open House participants said they would use it again. Passport scanner affordance and ASR reliability were recognised as the two points where effort was transferred back to the guest. |
| Hospitality Beyond the Transaction How might we use technology to enhance perceived hospitality that extends beyond the transactional moment of check-in? |
Addressed | Robot converses during escort, extending the hosted feeling to room arrival. Validated: survey respondents ranked answering hotel questions above luggage transport as a desired feature; 73% of Open House participants rated it better than a traditional front desk. |
Table 24: Against the Design Directions
The most significant limitation of this project is the gap between the solution’s intended deployment context and the validation conducted. Due to the size of the ELEVIA prototype, it could not be transported out of the school premises for in-hotel pilot and real-world navigation testing. Feedback sessions were therefore conducted using a video demonstration of the prototype rather than direct hands-on interaction, limiting the reliability of responses as indicators of real-world usability and guest acceptance in an actual hotel environment.
The closest the team came to live prototype testing was at the NUS Open House, where the kiosk frame and shelf were brought out for testing with general students and members of the public. While valuable, this cohort skewed toward digitally native, younger participants rather than the target demographic of luxury hotel guests and frontline hospitality staff. The absence of testing with actual front desk staff is a particularly notable gap, as operational perspective and workflow compatibility were not validated beyond video viewing feedback.
The backend was validated using a mock Supabase database modelled on a fictional hotel property rather than a live Property Management System. Integration with an actual PMS such as Oracle Opera, including real reservation data, room inventory, and payment processing, remains unvalidated, and the technical and compliance requirements of such an integration represent a significant unknown.
Our research and interviews were weighted toward ultra-luxury properties, where the findings consistently indicated that human touch remains paramount and automation is less accepted. This reframed the target market toward upscale, midrange, and business-oriented properties, segments where operational efficiency, manpower reduction, and technology adoption are prioritised over personalised human service. Despite this, formal validation with the revised target segment was not conducted, and no pilot testing was carried out to confirm adoption, usability, or operational fit. We gathered qualitative signals from key industry stakeholders, notably Ascott and EHL Singapore, whose representatives expressed strong receptiveness toward the concept, affirming that automation and AI integration aligned closely with their innovation priorities. Their openness suggests that earlier and deeper engagement with this tier of hospitality operator would have strengthened the validation basis for the revised target market.
Finally, the guest survey conducted in Section 8.5 used closed multiple-choice questions, which limits the depth and generalisability of the findings as a measure of guest attitudes toward autonomous check-in. While the findings revealed useful behavioural patterns and qualitative feedback, they cannot be treated as reliable indicators of real-world performance. Meaningful validation would require deployment testing in an actual hotel environment with surveys and testing with real guests and frontline staff to assess usability, adoption, and operational fit under realistic conditions.
The purpose of this section is to show that our solution has a future beyond this project.
May visit to Stanford will focus on presenting validation findings from Singapore hotel visits, aligning on the final showcase direction, and testing the AI assistant’s conversational flow and modular check-in architecture.
Following discussions during Stanford’s visit to NUS, we converged on strengthening the underlying AI check-in infrastructure first, decoupling the core technology from any single physical form factor so it can be deployed in a plug-and-play manner across different mediums. Additionally, we are exploring a video conferencing feature that connects guests with front desk staff on demand, providing a human fallback option when needed. Our Stanford team is independently exploring virtual check-in as well within limousine services, reflecting a shared recognition that the arrival experience need not begin at the check-in counters.
For the EXPE Showcase, beyond improving the underlying AI model, we will explore a holographic AI host interface as advised by the teaching teams and Venture. This addresses hotel feedback that a physical robot can feel unsettling in certain guest interactions, while preserving the warmth and conversational quality of the check-in experience.
| Iteration Priorities from Validation | |
|---|---|
| PDPA Refine verbal behaviour in shared spaces | Movement Choreography Reduce unsettling proximity behaviour |
| Modular Opt-Design Consider separating check-in from luggage | Avatar Interface Explore alternative mediums of interaction |
Table 25: Iteration Priorities from Validation
Figure 103: Future Timeline
Venture Corporation Limited, the industry partner for this project, is a Singapore-based technology solutions company with capabilities spanning embedded computing, AI hardware, robotics, sensing, and communications. Venture represents a credible manufacturing and technology partner for the next stage of development, as several of their existing product capabilities map directly onto the core hardware requirements of the ELEVIA prototype.
Most notably, Venture has been developing proprietary compute boards with on-device AI capabilities, including the Jetson Orin Nano and the NXP iMX8M Plus with ARA2 AI accelerator. During a visit to their facilities, our team was shown a visual language model running locally on one of their boards, where a camera captures the environment and users can ask natural language questions about what they see. This capability is directly relevant to ELEVIA’s next iteration: the current prototype relies on cloud-based APIs from OpenAI for LLM inference, text-to-speech, and speech-to-text, which introduces both latency and recurring subscription costs.
Beyond the compute board itself, Venture’s product ecosystem offers hardware directly compatible with ELEVIA’s existing subsystems. Venture’s VEST Embedded High-Speed Scanning Kit targets applications in logistics, medical, and identity verification, and is closely aligned with ELEVIA’s check-in use case, especially for the passport verification stage.
Beyond language models, recent advances in open-source real-time avatar and video generation pipelines suggest that even the avatar rendering component, currently dependent on the Simli SDK, could eventually run locally, enabling a fully self-contained system with no external API dependencies. Venture has also expressed interest in exploring holographic display technology as a future form factor for the AI assistant, aligning with the team’s post-Stanford direction and signalling appetite for continued collaboration beyond the programme.
As established in Section 3.2, luxury in its most premium form is defined by exclusivity, genuineness, hyper-personalisation, high-touch service, and authenticity. Across every hotel interview conducted throughout this project, one finding was consistent: at the ultra-luxury level, human presence is not a legacy inefficiency to be automated away — it is the product. Guests at properties like Raffles or Banyan Tree are paying for the feeling of being known, welcomed, and cared for by another person. No AI avatar, however warm and conversationally capable, fully replicates that.
One of the most significant realisations to emerge from this project is that ELEVIA, as designed, is better suited to non-ultra-luxury properties than to the five-star and above segment the brief originally centred on. This conclusion is not a failure of the solution but a refinement of the problem space.
Where ELEVIA finds its strongest fit is in upscale, mid-range properties and business-oriented, e.g. hotels under Ascott Limited, where guests still expect a competent and pleasant arrival experience, but where the balance tips more toward efficiency and convenience than towards deeply personal human service. In this segment, the ability to check in instantly without queuing, have luggage accompanied throughout the journey, and access a responsive point of contact at any moment represents a genuine upgrade rather than a compromise. It also directly addresses the labour shortage challenge most acutely, where staffing constraints are severe but the guest expectation of human-only service is less absolute.
Several lessons emerged across the course of this project that extended beyond the technical details of what was built.
The most fundamental was about the relationship between automation and effortlessness. Early in the project, the team assumed that automating a task was sufficient to improve it. The Stanford Dark Horse experience dismantled that assumption. What guests respond to is not automation, but the removal of friction and effort.
A second lesson was that environment shapes behaviour as much as product design. Insights from Ascott revealed that how a robot is positioned in a lobby determines whether it gets used at all. Deliberate configuration of the physical environment, through psychological nudging via placement, visibility, and spatial flow, can direct guests toward self-check-in as naturally as any interface improvement.
The third lesson was that the pace of iteration matters. More exploration of radical ideas along with rapid prototyping and testing cycles would have resolved more unknowns earlier, particularly around user behaviour and hotel operator requirements. The team’s most productive learning moments came from building and testing quickly, and the project would have benefited from more of these moments distributed across the full timeline.
A fourth lesson concerned the importance of relationship-building and communication frequency with external stakeholders. Many hotels became unresponsive to outreach, likely due to infrequent and insufficiently personal communication. More frequent, relationship-driven engagement with hotel partners would have enabled faster feedback cycles, more meaningful pilot testing opportunities, and a stronger validation basis for the final solution.
The final lesson concerned the importance of engaging the right stakeholders early. The team’s primary research was weighted toward established luxury hotel operators. Innovation-oriented operators and hospitality institutions such as EHL Singapore, who are actively exploring new concepts and approaches, proved to be more receptive and generative as conversation partners. Engaging this category of stakeholder earlier in the project, alongside the traditional luxury segment, would have surfaced more forward-looking insights and provided a stronger foundation for the revised target market sooner.
When we first received the brief to reimagine a premium automated hotel check-in experience, we had little sense of how far the problem would take us. Ten months later, what the team has built goes beyond a prototype, it is a clearer understanding of where automation can and cannot replace human hospitality.
ELEVIA, a robot-mounted AI concierge integrating autonomous luggage transport, conversational check-in, passport verification, and contactless payment into a single continuous arrival experience, represents a genuine attempt to close the gap that existing solutions have left open. Traditional counter check-in is warm but time-consuming, occupying staff with repetitive administrative tasks that could otherwise be directed toward higher-value guest interactions. Self-service kiosks are efficient but transactional, lacking the warmth and guidance expected in a hospitality setting. Neither integrates the physical arrival experience with the check-in process into a single coherent journey. ELEVIA was designed to bridge all three.
The validation process, across the NUS Open House, feedback from Ascott Limited and EHL, confirmed both the promise and the boundaries of the current implementation. Participants responded positively to the conversational AI, the intuitiveness of the check-in flow, and the concept of a luggage companion that stays with them throughout arrival. Feedback received also sharpened the team’s understanding of what comes next: decoupling the luggage robot from the check-in kiosk as independent modular options, integrating a video-conferencing alternative with remote front-desk staff, refining the AI avatar’s physical modality, and focusing development on the non-ultra-luxury segment where the solution is most commercially viable.
Across ten months of hotel visits, prototyping, testing, and iteration, we have come away with more than a working system, we have a much clearer picture of the real problem, and a stronger foundation to build the next version on.
This appendix summarises the luxury hotels and organisations we visited as part of our primary research. Each visit helped us understand real-world check-in operations, constraints, and attitudes towards automation in luxury hospitality.
A.1 Amara Singapore
We visited Amara Singapore to observe front-office operations and better understand current check-in practices and guest–staff interactions.
Stakeholders Engaged
Gordon Aeria – General Manager, Amara Singapore
Pearlyn – Front Office Manager
A.2 Shangri-La Singapore
We conducted two visits to Shangri-La Singapore: the first visit focused on understanding the luxury hotel while the second visit involved sharing and testing early-stage prototypes with hotel stakeholders to gather feedback.
Stakeholders Engaged
Devendra Pandey – Director of Information Technology
Benny Fok – Front Office Manager
Figure A.2: Shangri-La Singapore (site visit photograph)
A.3 Raffles Hotel Singapore
At Raffles Hotel Singapore, we engaged with stakeholders to understand the perspectives from an iconic luxury heritage brand.
Stakeholders Engaged
Alfani Leonaris – Lobby Operation Manager
Christian Westbeld – Managing Director
Figure A.3: Raffles Hotel Singapore – lobby and entrance area (site visit photograph)
A.4 Banyan Tree Headquarters
We visited the Banyan Tree Headquarters to gain a brand-level perspective on guest experience and the strategic role of technology and AI across the group’s portfolio.
Stakeholder Engaged
Sheriann – Business Development Team
Figure A.4: Banyan Tree Headquarters (site visit photograph)
A.5 Mandai Rainforest Resort
We also visited Mandai Rainforest Resort, a flagship resort under Banyan Tree.
Stakeholder Engaged
Joan Yao – Director, Rooms
Figure A.5: Mandai Rainforest Resort – arrival area (site visit photograph)
To gain a holistic understanding of the current luxury hotel check-in experience, we conducted semi-structured interviews with hospitality professionals across four prominent hotels in Singapore: Shangri-La, Banyan Tree, Raffles Hotel, and Amara Hotel (Appendix B). Participants represented a diverse range of roles within the hotel ecosystem, including the Rooms Director, Front Desk Manager, Front Desk Staff, General Manager, and Head of Technology. These individuals were selected for their ability to offer operational, managerial, and technological perspectives. Initial contact was made through formal email outreach and online contact forms.
Interviews were conducted between September and October 2025, following the protocol developed for this study. Each session began with an introduction to the research context and verbal consent for recording. The interviews were audio-recorded with consent and supplemented by extensive note-taking two team members recorded observations and verbatim quotes while the other two led the conversation. In three of the four hotels, participants additionally provided guided walkthroughs of their front-desk operations, allowing the research team to observe real-time workflows and backstage processes. Notably, one hotel granted permission for us to interact directly with their front-desk system, providing valuable insights into system interfaces and limitations.
View Interview Questions Preparation Document →
The semi-structured interview guide was designed around five thematic stages.
This design enabled both structured coverage of key topics and flexibility for interviewees to share detailed narratives about daily operations, guest interactions, and technology adoption in premium hospitality environments.
Following the interviews, we adopted an affinity clustering methodology supported by an empathy mapping framework, where we classified each data point across six categories – Think/Feel, See, Say/Do, Hear, Pains, and Gains.
These clusters were then distilled into key insights and design implications forming the foundation for subsequent concept development.
Figure C.1: Empathy Map
Figure C.2: Affinity Clustering
The following presents the consolidated findings for each key insight. Each data point is colour-coded by source property: green denotes Amara Hotel, yellow denotes Shangri-La, blue denotes Raffles Hotel, orange denotes Banyan Tree, and purple denotes miscellaneous luxury hotel sources.
| # | Theme & Key Findings |
|---|---|
| 1 |
Tech Stack and Integration Reality
Backend systems such as Opera PMS and Oracle Cloud are generally reliable within existing workflows, but high reliance on third-party software and fragmentation between systems creates inefficiencies and compatibility issues. Implementing new technologies is costly and often constrained by vendor lock-in, data permissions, and cybersecurity concerns. As a result, technology upgrades remain incremental, focused on reducing staff workload rather than transforming the guest experience.
|
| 2 |
Human Touch vs Automation
Our interviewee from Shangri-La noted that 98–99% of guests were observed approaching human staff over kiosks even when self-service options were available. Luxury guests consistently associate check-in with being genuinely welcomed, and existing kiosk solutions were described as emotionless, transactional, and misaligned with luxury price points. The consensus across all interviewees was that automation should enhance rather than replace the human warmth central to luxury hospitality.
|
| 3 |
Staff Tools and Empowerment
Frontline staff expressed that while tools like Opera and HotSOS are indispensable, they are also complex and unintuitive, requiring steep learning curves. Training periods are long, and mistakes — especially in data entry or double rooming — can directly affect guest satisfaction. Staff repeatedly emphasised the need for simpler, integrated tools and better pre-shift briefings to manage information overload. Empowerment emerged as a central motivator: when staff have autonomy to resolve issues or make small gestures (e.g., using a discretionary budget to delight guests), morale and service quality improve significantly.
|
| 4 |
Pre-arrival Data and Personalisation
Hotels strive to capture guest preferences before arrival through membership profiles, pre-arrival forms, and communication platforms like Canary and Opera PMS. However, data utilisation remains inconsistent. While some hotels use this information to prepare amenities or room settings, others rely heavily on staff memory or manual notes. Luxury guests expect a personal touch proportionate to what they pay, yet personalisation across all guests is impractical due to scale and manpower constraints.
|
| 5 |
Manpower and Role Design of Staff
The manpower shortage remains one of the most pressing issues in the industry. Recruiting and retaining hospitality workers — especially for front-desk roles — is increasingly difficult due to long hours, stress, and perceived lack of career progression. Technology can reduce repetitive tasks and support staff efficiency but cannot replace the emotional labour essential to guest satisfaction. Hotels have thus begun redesigning roles to combine operational efficiency with relational expertise, positioning staff near kiosks to assist guests and manage exceptions.
|
| 6 |
Service Recovery and "Wow" Moments
Service recovery emerged as a defining factor separating good from exceptional hospitality. Staff described instances of empowered decision-making — where they could upgrade rooms, offer discounts, or personalise gestures without waiting for management approval — allowing quick, authentic responses to guest issues. This culture varies across hotels; some operate under strict approval hierarchies, limiting graceful recovery from service lapses. Interviewees emphasised that true "wow" moments often stem from staff intuition and empathy, not protocol.
|
| 7 |
Physical Arrival and Guest Escort Experience
The physical dimensions of arrival — from the moment guests step out of their vehicle to the point they reach their room — emerged as a consistently staff-dependent and labour-intensive process across all properties visited. Bellmen were described as playing a critical bridging role, leading guests from the entrance through to the check-in counter and, in the case of VIP or ultra-luxury guests, escorting them directly to their rooms with a brief orientation. Interviewees noted that this escort experience is among the most impression-forming moments of the stay, yet it is highly variable and driven almost entirely by staff availability and initiative rather than a consistent service standard.
|
Overview
This appendix documents the methodology, framework, and summarised notes from the on-site observational research conducted at three luxury hotel properties in Singapore: Marina Bay Sands, Fullerton Bay Hotel, and The Fullerton Hotel. Observations were conducted during peak check-in periods to maximise the density of guest-staff interactions visible within a single session.
Observation Details
| Property | Time | Duration | Observers |
|---|---|---|---|
| Marina Bay Sands | 2:00–4:30pm | 2.5 hrs | 2 |
| Fullerton Bay Hotel | 2.00-2.30pm | 30 mins | 2 |
| The Fullerton Hotel | 2.30pm-4pm | 1.5 hrs | 2 |
Observational Methodology
Observational research was selected as a complementary method to the interviews documented in Section 3.3.3. While interviews surface staff accounts of the check-in experience, observation captures what actually happens, including behaviours, adaptations, and frictions that practitioners may not consciously register or volunteer. The distinction is deliberate: staff accounts are shaped by professional norms, institutional memory, and the desire to present their operations favourably, whereas direct observation is not subject to these filters.
The team employed a structured observational approach drawing on the AEIOU framework (Figure X).
Figure D.1: AEIOU Framework
Observational Posture
Fly-on-the-Wall: We positioned ourselves in lobby areas without engaging staff or guests, allowing natural behaviour to emerge uninterrupted. This approach was selected to minimise the Hawthorne Effect: the documented tendency for individuals to modify their behaviour when they know they are being observed. By blending into the lobby environment, we were able to capture operational patterns that would not be visible during a formal site visit or guided tour.
Validation Against Interview Themes
Raw field notes were collected across all properties and organised into three thematic clusters as seen in Figure D.2: These were then mapped against the seven key themes identified in the staff interviews (Section 3.3.3) to assess where direct observation confirmed, qualified, or contradicted what practitioners had reported.
Figure D.2: Three Thematic Clusters Surfaced
The thematic clustering is accessible at the link below: https://taroboro.github.io/thematicinsighthotels/
Some images from our field observation can be found below
Arrival & Drop-Off
Figure D.3: Staff member unloading and bundling luggage from vehicle
Figure D.4: Multiple bellboys attending to a single vehicle
Luggage Handling
Figure D.5: Luggage with plastic bags of souvenirs alongside formal luggage
Figure D.6: Central luggage handling point — groups of luggage placed on floor before trolley loading
Figure D.7: Luggage cart pulled diagonally across lobby, cutting through guest circulation paths
The live dashboard is accessible at the link below: https://soongensayo.github.io/GEDI-ME310-hotel/assets/dashboards/hotel-review-dashboard.html
Overview
This appendix documents the methodology and findings from the first round of guest review analysis conducted during the interim phase of the project. The study focused exclusively on one-star reviews from five-star properties in Singapore to surface the most acute and unambiguous sources of guest dissatisfaction.
Methodology
Reviews were collected from major online travel platforms including TripAdvisor, Google Reviews, and Booking.com, filtered to one-star ratings at five-star Singapore properties. A dataset of 60+ reviews was assembled, cleaned, and structured for analysis. Each review was read in full and coded into sub-themes based on the nature of dissatisfaction expressed. Sub-themes were then consolidated into higher-level themes through affinity clustering, producing 9 themes across 34 categories.
The analysis was conducted independently by two team members, with disagreements in coding resolved through discussion. The focus on one-star reviews was a deliberate methodological choice: extreme dissatisfaction provides a clear and unfiltered signal of where the luxury experience breaks down most severely, without the moderating effect of positive aspects that appear in mixed-rating reviews.
| Key Findings | |
|---|---|
| Theme | Share of Total % |
| Staff & Service Quality | 95.80% |
| Value-for-Money | 65.55% |
| Room Assignment & Conditions | 62.18% |
| Check-In & Check-Out Process | 53.78% |
| Food & Beverage Experience | 37.82% |
| Facilities & Infrastructure | 36.97% |
| Reservation & Pre-Arrival | 20.17% |
| Technology & Amenities | 17.65% |
| Security & Privacy | 15.97% |
Within the Check-In & Check-Out Process theme, the dominant sub-categories were poor service (32.77% of all reviews) and long wait times (24.37%), confirming that process inefficiency and service quality failures are the primary drivers of check-in dissatisfaction.
Figure E.1: One-Star Review Insight Dashboard
The live dashboard is accessible at the link below: https://taroboro.github.io/hotelreviews/
Overview
This appendix documents the methodology and findings from the second round of guest review analysis, conducted to complement the one-star study with a broader, rating-balanced view of the luxury arrival experience across four Singapore properties.
Methodology
109 reviews were collected from four Singapore luxury properties: Capella, Marina Bay Sands, Raffles, and Fullerton. The reviews span a full rating range from one to five stars. Rather than coding reviews into themes, this round applied a structured sentiment scoring approach across five service dimensions: luggage handling, high-touch service, staff availability, staff competency, and staff attitude. Each dimension was scored on a 1–5 scale based on the sentiment expressed in the review text, with scores assigned only where the review contained sufficient evidence for that dimension. Reviews where a dimension was not mentioned were excluded from that dimension’s average to avoid distortion.
The broader rating range was a deliberate methodological choice: by including positive and neutral reviews alongside negative ones, this round captures what the best and worst arrival experiences have in common, not only what drives extreme dissatisfaction.
Key Findings
| Dimension | Avg Score | No. of Reviews Scored |
|---|---|---|
| Luggage Handling | 3.37 | 68 |
| High Touch Service | 3.59 | 34 |
| Staff Availability | 3.46 | 37 |
| Staff Competency | 3.28 | 32 |
| Staff Attitude | 3.67 | 45 |
Overall average rating: 3.5 / 5.0 across 109 reviews
Hotel breakdown: Capella (42 reviews), Marina Bay Sands (26), Raffles (10), Fullerton (31)
The 0.30-point gap between the highest dimension (attitude, 3.67) and the lowest (luggage handling, 3.37) was the most significant finding, confirmed across all four properties. 39% of reviews referenced check-in or waiting experiences as a source of friction or delight.
Linking to Interview Themes
The review data corroborates several key themes from staff interviews. Low scores in staff availability and competency validate the interview finding that manpower constraints create service inconsistency (Theme 5). The attitude-luggage gap validates Theme 7: that physical arrival dimensions remain underserved despite warm and willing staff. The check-in friction cited in 39% of reviews validates Theme 2: that human-led check-in remains the preferred and expected mode, and that existing processes are not consistently meeting that expectation.
This appendix presents detailed stage-by-stage breakdowns of the three current-state journey maps developed in Section 3.3.1. Each map was constructed based on hotel interviews, walkthroughs, and field observations conducted across multiple Singapore luxury properties.
Pre-Arrival
Figure G.1: Pre-Arrival Flow
The pre-arrival phase establishes the foundation for the guest’s overall hotel experience. In luxury hospitality, this stage is not merely transactional but an opportunity to communicate attentiveness, personalization, and efficiency — qualities that define a premium brand. A seamless pre-arrival journey ensures that guests begin their stay feeling understood and valued, while the hotel benefits from streamlined operations and accurate data for service preparation (EHL, 2023).
| # | Stage |
|---|---|
| 1 |
Booking
Guests today increasingly prefer online travel agencies (OTAs) such as Booking.com or Expedia for their flexibility and ease of comparison. However, hotels prefer direct booking channels as these allow access to guest data directly, enabling more targeted communication, personalisation, and upselling opportunities (Ernst & Young, 2023). Integrating personalised booking systems that synchronise with guest profiles allows hotels to anticipate needs such as preferred room type, amenities, and check-in times well before arrival — reinforcing the sense of exclusivity expected in the luxury segment.
|
| 2 |
Confirmation Email
The confirmation email is more than a transactional receipt; it acts as an early stage of relationship-building. Guests appreciate clear, accessible booking details and links that allow them to modify reservations, add services, or manage transportation requests with minimal friction. Many hotels leverage this touchpoint to include upselling content — dining experiences, spa packages, or transportation upgrades. The tone and aesthetic of these communications should reflect brand values: calm, refined, and anticipatory rather than commercial.
|
| 3 |
Requests and Preferences
This touchpoint captures the guest's ability to communicate specific needs and personal preferences — such as bedding type, dietary restrictions, or room location. However, as identified during user interviews, guests often experience frustration when their pre-submitted requests appear ignored or require repetition during check-in. For hotels, collecting and managing such data remains challenging due to low engagement rates and fragmented information systems.
|
| 4 |
Room Allocation
Behind the scenes, the pre-arrival process culminates in room allocation, where hotels match reservations to specific rooms based on availability, maintenance status, and guest requirements. In most luxury properties, this is managed by a reservations team or automated algorithm that pre-allocates rooms to optimise occupancy while accommodating personalised preferences. When integrated with CRM and housekeeping systems, this process enhances both efficiency and guest satisfaction by ensuring that the assigned room is prepared and tailored to expectations prior to arrival.
|
Collectively, these pre-arrival touchpoints demonstrate the interdependence of technology, personalization, and operational design in shaping the luxury guest journey. A reimagined premium check-in experience must therefore begin before the guest arrives—bridging digital anticipation with physical hospitality through integrated, data-driven, and emotionally engaging systems.
Traditional Counter Check-In
Figure G.2: Counter Check-In Flow
The check-in process is one of the most defining moments in the guest journey, shaping first impressions and setting the tone for the stay (Mann et al., 2024). For luxury hotels, this stage embodies the brand’s promise of seamlessness, warmth, and personalization. Yet, as our field research and observations reveal, traditional counter-based check-in workflows can create friction for both guests and staff due to outdated system design, fragmented communication, and process inefficiencies.
| # | Stage |
|---|---|
| 1 |
Arrival
Guest perspective: Upon arrival, guests often face queues before even reaching the front desk. Especially during peak hours, waiting time becomes a key source of frustration, undermining the perception of efficiency and exclusivity expected in premium hospitality. Luxury guests expect immediacy and recognition, and long waits detract from that promise.
Staff perspective: Front desk staff must juggle multiple simultaneous tasks — handling ongoing check-ins, attending to phone calls, and coordinating with bell staff. High guest volumes exacerbate this workload, leaving little time to deliver personalised attention. Staff shortages further intensify this pressure.
|
| 2 |
Greetings
Guest perspective: The greeting moment, while brief, carries emotional weight. Guests notice whether the staff member smiles, greets them by name, or acknowledges special occasions. Inconsistent greetings often lead guests to perceive the interaction as transactional rather than genuine.
Staff perspective: Staff acknowledge that they want to personalise greetings but often cannot recall guest details or lack access to the right information before the guest reaches the counter — a disconnect stemming from PMS interface limitations.
|
| 3 |
Exchange of Information
Guest perspective: Guests frequently express frustration when asked to repeat information they have already provided during online booking or pre-arrival forms. This duplication creates an impression of inefficiency and poor data integration. Guests also find it unclear what staff are doing behind the screen, leading to perceptions of slowness or disorganisation.
Staff perspective: Staff must navigate between multiple software systems (e.g., PMS, payment gateways, and ID verification tools) to complete a single check-in. This multitasking increases cognitive load and risk of error — many noted difficulty in maintaining conversation with guests while simultaneously keying data.
|
| 4 |
Requests and Questions
Guest perspective: Guests often hesitate to raise additional questions or requests during check-in, perceiving staff as too busy or unapproachable. When they do ask, responses may feel scripted or delayed due to staff needing to check information in other systems.
Staff perspective: Employees sometimes struggle to answer guest questions on the spot, particularly regarding local recommendations or real-time room updates. When guests express dissatisfaction, front desk agents must escalate issues while staying composed — a difficult balance amid ongoing check-ins.
|
| 5 |
Collection of Key Card
Guest perspective: At this point, guests expect efficiency and clarity — they want to feel assured that their requests (such as late checkout or special amenities) have been noted. However, rushed handovers can create confusion and anxiety if guests are unsure about room details or inclusions.
Staff perspective: Staff often continue inputting data or printing forms while handing over key cards. If last-minute changes occur (e.g., incorrect room setup), the responsibility still falls on the front desk, despite upstream system or communication failures.
|
| 6 |
Rooming
Guest perspective: After check-in, guests evaluate whether the in-room experience matches what was promised. A missing request or incorrect setup amplifies dissatisfaction, signalling poor internal communication.
Staff perspective: Staff acknowledge that follow-up lapses can occur, especially when information from the PMS is not synced with housekeeping or concierge systems. Front desk agents often receive the complaint despite not being responsible for the error.
|
Kiosk Check-In
Figure G.3: Self-Service Kiosk Check-In
As hotels experiment with automation to enhance efficiency and reduce manpower dependency, self-service kiosks have become increasingly common, especially in business and mid-to-upscale hotels. These kiosks aim to streamline routine procedures such as guest identification, payment, and room key issuance — mirroring the self-check-in models seen in airports. In Singapore, automation has been widely encouraged to address labour shortages and operational inefficiencies in the hospitality sector (Ernst & Young, 2023). However, while kiosk systems deliver measurable gains in speed and consistency, they also expose gaps in emotional engagement and personalization — both critical attributes of the luxury segment.
| # | Stage |
|---|---|
| 1 |
Entering of Key Details
Guest perspective: Guests generally perceive the kiosk as efficient and straightforward, appreciating the ability to bypass long queues. However, many express frustration that they still have to manually enter personal information even if these details were already provided during online booking — contradicting the promise of a seamless digital experience.
Staff perspective: The automation of initial data entry reduces front desk workload, allowing staff to supervise multiple kiosks simultaneously and assist guests only when necessary — enabling a more relaxed, concierge-like presence on the floor rather than behind the counter.
|
| 2 |
Guest Photo and Passport Scanning
Guest perspective: The passport scanning and verification process reinforces efficiency but introduces a transactional, impersonal tone. Guests accustomed to high-touch luxury interactions often perceive the lack of human acknowledgment as diminishing the sense of welcome.
Staff perspective: Kiosks significantly reduce training time — from an estimated one month to about a week — as staff no longer need to memorise complex PMS workflows. However, staff must still intervene frequently when the kiosk's document recognition fails, especially with non-standard passports or international ID formats.
|
| 3 |
Filling Additional Fields and Signing T&Cs
Guest perspective: This stage is where friction typically resurfaces. Guests may be required to fill in multiple mandatory fields, sign digital forms, and review terms on-screen. For less tech-savvy users or older guests, the interface can appear daunting, particularly if touch targets are small or instructions unclear.
Staff perspective: While kiosks handle the procedural aspects of check-in, they remain limited in scope — unable to accommodate complex or exception-based requests such as split billing, room upgrades, or special amenities. Staff must therefore monitor the kiosks closely to address these exceptions in real time.
|
| 4 |
Collection of Key Card and Handling of Issues
Guest perspective: Guests expect the process to conclude smoothly once the key card is dispensed. However, issues such as incorrect room assignment, non-functional cards, or unmet special requests often require them to return to the counter — undermining the convenience of the kiosk experience.
Staff perspective: Front desk teams report that kiosks reduce repetitive administrative tasks, freeing time for proactive engagement. However, system limitations lead to fragmented workflows — tasks often have to be finalised manually in the PMS, creating inconsistency in record-keeping and increasing post-check-in corrections.
|
Figure G.4: Luggage Handling Journey Map (modelled from Marina Bay Sands)
The luggage handling journey documents the physical arrival experience as a distinct dimension of the guest stay. Unlike the check-in flows above, this journey is physically demanding, spatially disruptive, and almost entirely staff-dependent, with no existing automated or digital system in place across any property observed.
| # | Stage |
|---|---|
| 1 |
Guest Arrival and Luggage Handoff
Guest perspective: Guests arriving with extensive luggage — oversized cases, plastic bags, or irregularly shaped items — often find the handoff process rushed and inconsistent, with no clear protocol for what gets taken and what remains with the guest.
Staff perspective: Bellboys must quickly assess each arrival, deploying additional staff for large luggage volumes and making individual judgement calls for irregular items. During peak periods, multiple bellboys assigned to a single vehicle can draw resources away from other arriving guests.
|
| 2 |
Luggage Tagging
Guest perspective: Luggage is tagged in front of the guest before being taken out of sight, providing some reassurance. However, the entirely manual process feels dated and slow, particularly when multiple pieces must each be individually tagged. Guests have no visibility of their luggage after this point, which can create anxiety.
Staff perspective: Bellboys remain fully accountable for luggage security until delivery. The process relies entirely on individual staff attentiveness and is vulnerable to human error, with no digital fallback.
|
| 3 |
Transport and Delivery
Guest perspective: Luggage carts travelling across the lobby floor create visual disorder inconsistent with the hotel's luxury positioning. Guests are also left uncertain about where their luggage is and when it will arrive. Guests expect their bags to be in the room the moment they enter.
Staff perspective: Staff must navigate active lobby spaces with covered trolleys during peak periods, completing a physically demanding circuit repeated for every arriving guest. Room delivery marks the final step, but any delay or mismatch at this stage compounds earlier friction and reflects poorly on the entire arrival experience.
|
Figure H.1: Diverse Guest Profiles and Their Unique Check-In Challenges
While each guest segment varies in priorities, their foundational expectations remain consistent.
|
Core Expectations
Fast, seamless, low-friction check-in • Recognition, warmth, and personalisation • Clear communication and prompt issue resolution • Strong reassurance of data privacy and consent
Pain Points
Needs
Faster, smoother, low-friction check-in • Warm, personalised interactions that match luxury standards • Seamless physical guidance from vehicle drop-off through to the room
|
2 Front-Office Staff
Front-office staff are responsible for executing the end-to-end check-in process, navigating complex systems such as Opera PMS, verifying guest identities, processing payments, managing room allocations, and handling real-time guest inquiries, all while maintaining warmth, composure, and attentiveness. This combination of administrative demand and emotional labour defines the central challenge of the front desk role.
|
Core Expectations
Deliver high-touch hospitality and maintain warm guest interactions • Accurately verify identities, process payments, check/modify reservations • Ability to multitask without compromising warmth or composure • Manage real-time issues, exceptions, and service recovery • Uphold brand standards under pressure
Pain Points
Needs
Tools that reduce repetitive administrative workload • Systems with low cognitive load and minimal training curve • Real-time visibility of guest data, preferences, and history • Error-reduction support (auto-fill, guidance, note capture)
|
Within the broader front-office team, bellmen and porters occupy a distinct and physically demanding sub-role. Their primary responsibility is the handling and transport of guest luggage from arrival to room, a task that is labour-intensive, physically taxing, and operationally inconsistent across properties.
|
Core Expectations
Deliver high-touch hospitality and maintain warm guest interactions • Manage guest luggage accurately and without delay • Physical labour without compromising warmth or composure
Pain Points
Needs
Physical support or tools to reduce lifting load and frequency across shifts • Digital luggage tracking to eliminate tagging errors and improve retrieval accuracy • Pre-arrival guest information to enable proactive and personalised service at the entrance
|
3 Hotel Management
Hotel managers oversee the performance and consistency of front office operations, ensuring that staff deliver service that meets luxury hospitality standards. They coordinate manpower, manage scheduling, monitor service quality metrics, resolve guest escalations, and make decisions on technology adoption. Their responsibilities bridge guest satisfaction, staff capability, and operational efficiency.
|
Core Expectations
Ensure consistent service quality across varying staff skill levels • Manage manpower allocation, scheduling, and team performance • Oversee guest satisfaction scores and service recovery protocols • Make decisions on technology investment and operations
Pain Points
Needs
Tools that increase staff productivity and reduce training time • Cost-effective, scalable solutions that integrate with existing systems • Visibility into operational bottlenecks and performance trends • Systems that reduce service inconsistencies and empower staff
|
4 Technology Department
Technology departments maintain the hotel’s digital ecosystem, including PMS, kiosk systems, CRM platforms, keycard systems, automated check-in solutions, and cybersecurity protocols. They ensure that systems remain compliant with data protection policies. Additionally, they support integrations, automation implementation and maintenance, troubleshooting system failures, and evaluating new technologies for feasibility and ROI. Their work underpins the operational reliability needed for smooth check-ins and personalised guest experiences.
|
Core Expectations
Maintain system reliability, uptime, and integration health • Oversee data governance, cybersecurity, and PDPA compliance • Support deployment, troubleshooting, and tech adoption • Ensure smooth operation of PMS, kiosks, key systems, and APIs
Pain Points
Needs
Modular and easily maintainable solutions • Secure systems with strong privacy protections and local processing • Minimal disruption to operations during integration • Reduced dependency on third-party vendors
|
Alluvio covers the pre-booking and booking phases of the luxury hotel check-in journey. Our goal is to design an intelligent, secure luxury system that intuitively captures and organises guest preferences. Through a fun, swipe-based interface, guests can build dynamic, evolving profiles while AI delivers personalised recommendations based on their preferences. Profiles can also securely store essential travel documents such as Visas, for easy and anytime access. With explicit consent, this information can be shared accurately across onboarded luxury hotels via secure integrations with their hotel management systems.
Design Rationale
Most guests start looking for accommodation on Online Travel Agencies such as Booking.com, Expedia, Trip.com and Agoda. These platforms act as a centralised hub that allows users to compare prices, amenities and reviews across a wide range of properties, helping them find the best fit with minimal effort and high convenience. In recent years, many OTAs have expanded beyond hotel stays to include rental cars, attractions, flights and even airport transfers to the booked hotel, reinforcing their position as a one stop shop for travellers. According to a 2024 hotel distribution report, the vast majority of guests in Asia and Europe continue to book through these indirect channels, based on data from 2018 to 2023 as shown in Figure 10 (Hotel Distribution Report, 2024). A similar pattern is observed in the United States, where data collected in 2019, 2021 and 2023 indicates that OTAs remain a dominant booking channel, as shown in Figure 11 (Phocuswright Research, 2022). Together, these findings demonstrate how OTAs have become modern day leviathans in travel, shaping how guests search for and book their stays.
Figure I.1: Share of direct and indirect online hotel bookings in Asia and Europe from 2019 to 2023
Figure I.2: Share of direct and indirect online hotel bookings in the United States in 2019, 2021 and 2023
However, while OTAs bring clear benefits to guests, they are not as well received by hotels. OTAs function as intermediaries, which can introduce misrepresentation of hotel offerings, including outdated photos, inaccurate descriptions or missing amenities (Goswami, 2024). From our interviews with hotel staff, we also learned that OTAs do not always pass on guest information accurately and in some cases do not share it at all. This breakdown in communication can lead to guest dissatisfaction when preferences or special requests are not properly recorded or honoured at the property.
These shortcomings help explain why many hotels prefer direct bookings. When guests book directly, hotels gain full access to guest data, which enables deeper personalisation and a stronger sense of hospitality. Direct access to accurate guest profiles allows hotels to tailor services, anticipate needs and build long term relationships rather than simply fulfilling a transaction. More importantly, hotels can avoid the commission fees that OTAs typically charge, which are often in the range of 15-30% of the booking value (Huang, 2025). For hotels, direct bookings therefore combine better control over the guest experience with improved financial outcomes.
Value Proposition
From here, we recognise that OTAs play an important role. They give hotels visibility, help them reach a wider audience and make it easy for guests to discover and compare options. At the same time, hotels still value direct bookings because they allow them to build stronger relationships with guests, personalise the stay and retain more revenue. Instead of replacing OTAs, our aim is to bring the best of both worlds together.
As such, Alluvio keeps the convenience and reach of OTAs while creating a direct and effortless connection between guests and the hotel. Through the integrated app and web platform, guests enjoy a smoother and more personalised pre-arrival experience and hotels can better anticipate their needs through direct communication. By allowing guests to apply their hotel loyalty programmes when booking through Alluvio, which is something that is not typically possible on OTAs, Alluvio makes the experience feel as seamless and rewarding as booking directly with the hotel while still delivering a level of service that reflects modern luxury.
User Testing and Analysis
We had the opportunity to conduct user testing and analysis with hotel guests and staff, who are the two key stakeholder groups for Alluvio. Guests shared valuable feedback on both usability and the overall experience. They highlighted the need to reduce interaction friction, such as keeping all swipe options on the same page to avoid unnecessary scrolling. Guests also expressed that first time discounts or immediate rewards would motivate them to download and try a new platform. In addition, they were enthusiastic about features that help them discover hotels more easily, such as personalised recommendations based on their preference profiles.
As for hotel staff, their insights centred strongly on revenue considerations. They emphasised that profit margins are always at the core of decision making and that guest preference data or personalised services are valuable mainly because they help guests feel that their stay is worth returning for. Staff noted that OTAs typically take between 16-20% of a room’s price, so from a business perspective they are open to adopting new platforms that offer more competitive pricing models. They also raised concerns about direct channel poaching, where guests who book through Alluvio could potentially be redirected by the hotel to amend or rebook their stay directly with the property due to the direct communication. This highlights the need for clear non-solicitation and shared data agreements if Alluvio were to work smoothly with hotels. Finally, staff suggested that Alluvio could offer guests meaningful benefits, such as a loyalty tier programme or the ability to stack rewards on top of existing hotel loyalty schemes, in order to motivate guests to use the platform.
These insights from guests and staff helped clarify Alluvio’s positioning and guided improvements to our interface and features. They are valuable considerations that we will carry forward as we decide on our final direction and solution.
The AI Kiosk Assistant is a complementary device that works alongside existing self-service kiosks, keeping their speed while adding warmth and guidance. It uses a natural, conversational voice to talk with guests, help them through check-in, and gently capture their preferences.
Design Rationale (Primary)
Through site visits to multiple hotels in Singapore and interviews with front-office staff and managers, we examined how existing self-service kiosks are deployed and experienced in practice. In one hotel, for example, we observed tourists approaching the kiosk, appearing confused, and quickly searching for staff rather than completing check-in independently, highlighting a lack of clear guidance and reassurance. Across these observations and interviews, we distilled recurring pain points:
These insights suggest that the core issue is not automation itself, but that current kiosk experiences lack emotional engagement, clear guidance, and a sense of being genuinely cared for.
Design Rationale (Secondary)
Secondary research points to a persistent tension between automation and emotional connection in hospitality. Automation can improve efficiency and consistency, but it often reduces warmth and empathy; qualities that are central to genuine hospitality. Studies also show that when self-service systems replace face-to-face interaction, guest satisfaction tends to drop, especially in areas like personalisation and perceived service quality (Christou et al., 2023).
Moreover, studies indicate that reduced interpersonal interaction in self-service systems negatively impacts guest satisfaction, particularly in areas related to personalization and perceived service quality (Peng & Zhang, 2020).
Despite technological advancements, guests continue to value human guidance in handling exceptions, building trust, and creating meaningful service experiences, showing that technology alone cannot meet the emotional expectations of luxury travelers (Christou et al., 2023). Consequently, emerging research supports a “High Touch High Tech” approach that combines human empathy with intelligent automation to achieve both operational excellence and lasting guest satisfaction (Nichols, 2025).
Collectively, these insights underscore the importance of designing solutions such as the AI Kiosk Assistant that balance efficiency with emotional resonance to redefine the modern luxury experience.
Value Proposition
For guests, the AI Kiosk Assistant offers the speed of a self-service kiosk with the reassurance of a human host. It turns the interaction from transactional to conversational, provides clear step-by-step guidance, responds to simple questions and exceptions, and adds emotional warmth and light personalisation so that using a kiosk feels aligned with luxury expectations rather than “cheap” or mechanical.
For hotels, it encourages higher kiosk adoption without the cost and disruption of a full hardware overhaul, as it can be added onto existing devices as a complementary layer.
Key Features
User Testing and Analysis
Feedback from Hotel Stakeholders and Industry Partners
To validate the AI Kiosk Assistant concept, we conducted early-stage user testing with front desk staff, hospitality trainees, and industry partners. The feedback provided valuable direction for refinement, summarised below:
1 Operational Realism and Alignment with SOPs
Stakeholders stressed that any AI layer must align with real hotel procedures rather than just “talk nicely” on top of the kiosk. They emphasised that the system must support upselling within existing hotel policies, check booking time, room status, and room type before issuing a key, and escalate to staff when rooms are unavailable or exceptions arise. Overall, this feedback underscored the importance of operational accuracy and strict adherence to SOPs, guiding our next steps to refine system flows so they mirror existing procedures and escalation rules to ensure seamless hotel adoption.
2 Voice Interaction, Noise, and Error Handling
Stakeholders raised concerns about whether voice interaction would function reliably in real hotel environments. They noted that lobbies can be noisy, especially during events, making it difficult for the AI to hear guests accurately, and there was worry that the system might overhear nearby conversations and respond inappropriately. Together, these points highlighted the need for robust handling of noise, misrecognition, and unintended activations. In response, our next steps focus on implementing dynamic audio systems and utilising touch-to-speak mechanisms to ensure more reliable interactions.
3 Privacy, Data Protection, and Guest Expectations
Both hotel stakeholders and Venture Corporation emphasised strong concerns around privacy and data protection. They worried that the AI might overhear nearby conversations, questioned where voice data would be sent or stored in relation to PDPA requirements, and stressed the need to reassure guests that the system only listens when intentionally activated. This feedback highlighted the importance of moving toward privacy-by-design solutions, shaping our next steps to establish clearer boundaries around when the AI is active and explore on-device processing such as EdgeAI to minimise data exposure.
4 Cost, ROI, and Adoption Risk
Cost and return on investment emerged as major concerns. With a single kiosk already costing around SGD 28,000, hotels questioned whether adding an AI layer would deliver clear, measurable benefits. Their feedback emphasised the need for a strong business case, guiding our next steps to assess whether the added investment can be justified.
Feedback from Potential Guests
Additionally, early-stage user testing with potential guests in a simulated setting revealed that users were open to guided automation and felt comfortable using a kiosk when it offered clear step-by-step instructions and reassurance at key moments. However, some were uneasy about speaking personal details aloud in a public lobby and preferred having the option to switch to touch input for sensitive information.
Building on the identified challenges of manpower shortages, inconsistent service quality, and rising guest expectations, our team developed Hotelly, an AI overlay system designed to discreetly support front desk staff during the hotel check-in process. Rather than replacing human hospitality, Hotelly enhances it. It serves as a real-time “co-pilot” that empowers staff to deliver warm, precise, and personalized service even under pressure.
Hotelly operates as a context-aware assistive layer, providing live prompts, key guest information, and automated note capture during guest interactions. This helps staff maintain composure and consistency, ensuring that high-touch service standards are met regardless of varying experience levels among employees. The prototype was inspired by successful analogues such as Google Contact Center AI, Otter.ai, and Cluely, which have demonstrated the technical viability of real-time overlays in other high-stakes conversational environments (AmplifAI, 2024).
Design Rationale
The design rationale behind Hotelly was shaped by a recurring insight from our fieldwork across luxury hotels: although technology can streamline back-end processes, the essence of frontline hospitality remains profoundly human. Guest-facing excellence depends on staff judgement, composure, and consistent delivery, all traits that are increasingly difficult to maintain amid labour shortages, variable training quality, and rising expectations for personalization (Ernst & Young, 2023). Rather than pursuing automation for its own sake, the team anchored the concept in an assistive paradigm: augmenting human capability rather than replacing it. Hotelly was therefore conceived as an AI co-pilot that strengthens service delivery while preserving the warmth and intentionality associated with luxury hospitality.
A key challenge uncovered during ethnographic observations was the cognitive load placed on front desk staff. Check-in requires parallel management of guest verification, data entry, problem-solving, and rapport-building all while staying attentive and composed. Less experienced staff often struggled to recall phrasing, hotel policies, or local recommendations without breaking conversational flow. To address this, Hotelly introduces context-sensitive, real-time guidance delivered through a minimal peripheral overlay. This design takes inspiration from tools such as Google Contact Center AI and Cluely, which demonstrate how subtle prompts can bolster performance without becoming intrusive. By surfacing relevant information at the right moment, Hotelly supports knowledge recall and reduces hesitation, enabling staff to maintain natural interaction and human presence. Preserving emotional connection was another foundational principle. Luxury guests consistently emphasized the value of eye contact, warmth, and authentic conversation; intrusive technology was seen as detracting from these qualities. User testing revealed strong resistance toward head-mounted interfaces, which were described as “awkward” and “dehumanizing.” As a result, Hotelly intentionally adopts a desktop-based design with compact, digestible prompts that live at the edges of the interface. This ensures that guidance remains available without pulling attention away from the guest or encouraging staff to read verbatim from a script. The system complements the choreography of human interaction.
Beyond moment-to-moment guidance, Hotelly also addresses a broader operational gap: the loss of service continuity between shifts. Many hotels suffer from inconsistent documentation of guest preferences and interactions, leading to lapses in personalization. Hotelly’s automated note capture and summarization create structured, timestamped records of guest conversations, improving handovers and supporting more accurate post-stay personalization and dispute resolution. This mirrors contemporary coaching systems (AmplifAI, 2024), where reflective review strengthens team capability over time. Together, these design choices reflect EHL Insights’s (2025) principle that AI in hospitality should enhance, not replace, empathy and human judgement. Ultimately, Hotelly aims to bridge automation with emotional intelligence, elevating the guest experience by empowering the people at its center.
Value Proposition
Hotelly delivers value by strengthening the quality and consistency of front desk service while preserving the human warmth central to luxury hospitality. The system equips staff with subtle, real-time prompts that enhance confidence, speed, and accuracy during guest interactions, helping them respond more naturally and maintain composure even under pressure. This ensures that high-touch service can be delivered reliably across varying experience levels.
In addition, Hotelly automates the capture of guest notes, preferences, and key conversational details, reducing manual administrative work and improving continuity across shifts. By integrating lightweight automation with human-centric guidance, the system enhances personalization, reduces cognitive load, and reinforces a seamless, brand-aligned check-in experience that benefits both staff and guests.
User Testing and Analysis
To validate the Hotelly concept, we conducted early-stage user testing with front desk staff and hospitality trainees. The feedback provided valuable direction for refinement, summarized below:
1 Real-Time Retrieval Builds Confidence
Many users described Hotelly as enabling them to appear “more knowledgeable” and “calmer under pressure.” Staff found it particularly helpful in recalling park timings, local attractions, or property-specific policies that they could not always memorize. The ability to surface key facts instantly helped maintain smooth conversational flow and reduced anxiety, especially among newer employees. This validated our hypothesis that cognitive offloading through AI can elevate, not hinder guest interaction quality.
2 Training Potential Strongly Validated
Participants widely recognized Hotelly’s potential as a training companion. New or junior staff saw it as a safety net that enabled them to handle complex guest requests more confidently. One participant noted: “It’s more useful as a training tool than in real life. But for new hires, it’s perfect.” This led to the concept of a dual-mode interface, a “Training Mode” with more guidance and feedback prompts, and a “Live Mode” optimized for minimal intrusion during actual guest interactions.
3 Automated Note-Taking as a Key Value Driver
Automation of guest note capture was consistently highlighted as one of Hotelly’s most valuable features. Staff emphasized its potential for dispute resolution, shift continuity, and personalized service. However, they also noted that accuracy and brevity would be critical: “It even summarises preferences, that’s very helpful, but accuracy is important.”This feedback informed our next development milestone integrating real-time summarization with adjustable confidence thresholds to balance automation and reliability.
4 Managing Cognitive Offloading and Skill Atrophy
While automation was largely welcomed, several respondents expressed concern about potential skill atrophy. Over-reliance on AI prompts might make staff dependent on the system rather than internalizing knowledge. As one user put it: “This could make staff lazy… they might just read off it instead of remembering.” These insights guided our philosophy that Hotelly should serve as a co-pilot, not a crutch, providing support while encouraging independent learning through gradual reduction of assistance.
5 Interface and Usability Feedback
Aesthetics and legibility were key concerns. Staff preferred short bullet points, large fonts, and strong visual hierarchy for quick scanning. They emphasized that the overlay should never compete with the PMS (Property Management System) interface, but rather complement it. This will guide subsequent iterations focusing on adaptive UI scaling, contrast sensitivity, and contextual card grouping.
6 Discretion in Guest-Facing Interactions
A final insight related to physical discretion was that participants felt that using smart glasses or overly visible devices risked making interactions feel robotic. Instead, staff favored screen-based overlays placed subtly on monitors or tablets. This feedback affirmed the decision to keep Hotelly’s presence peripheral and contextually embedded within existing workflows.
Together, these insights underscored the importance of balance—between speed and subtlety, automation and authenticity, information and intuition.
Aria is an AI assistant designed to help staff focus on conversation rather than typing. It empowers hospitality staff through voice-driven data capture and real-time transcription without recording. Conversation details could be automatically autofilled into guest profile and request fields, while guided prompts provide answers to guest inquiries, suggest follow-up questions, generate real-time summaries, and support personalised recommendations. Aria could also reference hotel policies, FAQs, internal databases such as room availability, and safe external web information. To maintain accuracy and accountability, staff would be able to manually verify, edit, and approve all extracted information. Consent, privacy, and data governance remain central: Aria would require explicit guest consent before activation, retain transcripts only briefly for verification, encrypt any stored text, and maintain audit trails for compliance. Operationally, Aria could integrate with existing systems such as Opera PMS to support seamless workflow integration.
Design Rationale (Primary)
From our interviews, we found that front desk staff often struggle to balance conversation and data entry. Staff members described needing to pause interactions to avoid mistakes, which prolongs the process. Staff also get bombarded with guest questions and also frequently need to multitask. Such as across calls, chatboxes, in-person queries, and typing into systems, some of which occur simultaneously. Since details are manually keyed into Opera, mistakes such as missing or wrong/misspelled information may occur. These insights highlight the need for a tool that reduces typing burden and supports accurate, real-time data capture.
Design Rationale (Secondary)
As personal service by staff remains an important skill, research across luxury hospitality consistently shows that high-touch remains central to luxury, and technology should enhance rather than replace human warmth and empathy,(World, 2025; AL-HYARI et al., 2023; Bharwani & Mathews, 2021; EHL Insights, 2025). This informs our decision to position Aria for staff support instead of replacement.
AI can streamline routine administrative tasks and boost efficiency, improving service quality and allowing employees to focus on higher-value meaning guest interactions, creating a lasting impression (Bharwani & Mathews, 2021; EHL Insights, 2025). In this context, Aria automates typing so staff can focus more on the guest.
Moreover, technology enables superior guest service and improves guest satisfaction by helping hotels identify and anticipate guest needs. It acts as an efficiency enhancer that equips staff with real-time, guest-specific and directly relevant information, combining data-driven precision with human empathy to elevate personalisation experience and service (AL-HYARI et al., 2023; Bharwani & Mathews, 2021). This aligns with our design choice for Aria to analyses guest profiles to tailored prompts and service recommendations, and support staff with answers to guest questions.
Value Proposition
For hotel staff who need to reduce manual workload while multitasking, ARIA is an AI-powered assistant that listens to guest conversations, automatically captures key information, and provides real-time intelligent prompts and answers. Delivering seamless and faster integration into hotel processes, allowing staff to focus on delivering personalized, high-touch guest experiences.
Unlike manual workflows where staff must track guest requests while juggling real-time interactions, ARIA supports rather than replaces staff tasks by reducing administrative burden, keeping them in the loop for verification, and providing quick access to information. This ensures accuracy, reduces stress and enhances workflow.
User Testing and Analysis
1 Accuracy Concern
During feedback sessions, the manager raised concerns about accuracy and the risk of staff over-relying on AI. They worried that staff may lose focus or assume the system captured information when it did not, which could lead to problems. Staff emphasised that the effectiveness of an AI assistant depends heavily on its reliability and the need for staff to remain very attentive and actively verify information. In response, Aria can incorporate real-time confirmation prompts and to maintain accuracy and accountability and ensure that control over guest data always rests with staff. Concerns also emerged regarding microphone sensitivity and placement. The manager noted that counters in close proximity could cause the mic to pick up conversations from neighbouring guests. Solutions can include using directional microphones and training the AI to distinguish speakers to mitigate background voice capture.
2 Data Protection
Data protection was another major concern. The manager highlighted PDPA risks, noting that guests can be very sensitive about data protection such as voice and cited “voice leak scandals” as to why guests may fear being recorded and also mention the importance of assuring guests that all data is deleted. He also mentioned that some staff might activate the tool even without obtaining consent. To address this, Aria requires explicit consent before activation, uses real-time transcription without storing raw audio and should include a visible active indicator, enforce audit trails with logged user actions and timestamps, and automatically delete transcripts after a defined period with a logged deletion timestamp. The IT director further stressed that any stored transcript must be encrypted.
3 Value of autofill
Feedback also revealed mixed views about the usefulness of the auto-fill feature. The IT director acknowledged its value for capturing guest preferences and requests, noting that such requests could ideally be routed directly to service centres. However, the front office manager questioned its benefit for very short or simple interactions, where manual typing could be done quickly and easily. This informed our positioning that Aria is most beneficial in long, information-heavy, or multitasking situations rather than every check-in.