Microsoft Plans to Double Bing Chat’s Character Limit, Despite Cost Challenges

2023-09-15 04:53:41
Microsoft plans to double the query input character limit for the personal and enterprise versions of the Bing Chat chatbot from the current 4,000 characters to 8,000 characters, but says it may not be able to do so quickly due to cost issues. When Bing Chat was launched at the beginning of this year, as long as it responded to questions more than 15 times, it would exhibit abnormal behavior, such as conflicts with users or excessive tone, forcing Microsoft to quickly reduce the number of questions and answers and the number of characters entered by users. As its performance stabilizes, Microsoft gradually relaxes Bing Chat and user conversation input content. Currently Windows users can ask Bing Chat 20 questions and 4,000 characters at a time. The enterprise version of Bing Chat launched in July also has the same restrictions. This week, Microsoft’s search department Mikhail Parakhin responded to a request from a Bing Chat Enterprise user and stated that Microsoft plans to increase the input character limit for Windows consumer and enterprise Bing Chat from 4,000 characters to 8,000 characters (Chrome The maximum input limit for Bing Chat is 2,000 characters), but you have to wait for a while. The reason is that the algorithm will cause the context space requirement to increase exponentially, so a 2x character expansion will increase Bing Chat’s operating costs by 4x. While Microsoft will definitely deliver on its promises, the reality is that running chatbots is resource-intensive. Servers running AI chatbots not only consume a lot of energy, but also involve higher cooling costs; according to a University of California study cited by Fortune Magazine, users query chatbots such as Microsoft Bing Chat or ChatGPT and distribute the data once every time. The server heats up and consumes 1 bottle of water. Microsoft’s data shows that due to the surge in the use of AI systems, the company’s global data center water usage will surge by 34% in 2022 compared with the previous year. These huge expenses are a big challenge for new startups. Research institutions estimate that the daily operating cost of OpenAI’s ChatGPT is as high as US$700,000. If it were not for Microsoft’s financial injection, it might go bankrupt next year.
1694790819
#Microsoft #plans #double #input #character #limit #Bing #Chat #wait #iThome