Amazon internal review found its AI tool Q fell 'significantly' behind rivals on accuracy in its first year
Briefly

Amazon internal review found its AI tool Q fell 'significantly' behind rivals on accuracy in its first year
"The document, from March, said Q Business struggled to process tabular and spreadsheet data, drawing complaints from customers, including Accenture, Intuit, and Smartsheet. It also noted difficulties with longer responses and conversational flow. "We face challenges with non-text data (embedded tables and spreadsheets), accuracy evaluation methods, and currently lag behind competitors in conversational experience that customers seem to be delighted with," the document said."
"The document also reflects Amazon's strong writing culture, which encourages employees to surface concerns and address customer complaints proactively. Indeed, Amazon's spokesperson told Business Insider that the March document is "outdated" and the accuracy issues have since been fixed in updates to the service. "Our culture demands that we remain vocally self-critical as we innovate rapidly for customers," the spokesperson said."
Q Business struggled with accuracy throughout its first year, including mishandling tabular and spreadsheet data and producing incomplete or uneven longer responses and conversational flow. Customers including Accenture, Intuit, and Smartsheet registered complaints about data processing and response quality. Some employees linked early problems to a rushed launch, while others warned the product risked losing customers over subpar features. Amazon plans to merge Q Business with other AWS products into a new agentic AI product called Quick. Amazon indicated that accuracy issues were later fixed and emphasized a culture that encourages vocal self-criticism and proactive handling of customer concerns.
Read at Business Insider
Unable to calculate read time
[
|
]