In October, New York City announced a plan to harness the power of artificial intelligence to improve the business of government. The announcement included a surprising centerpiece: an AI-powered chatbot that would provide New Yorkers with information on starting and operating a business in the city.
The problem, however, is that the city’s chatbot is telling businesses to break the law.
Ars’ example gave me some hope![User asking: "Can I evict a tenant for refusing to pay rent?" Chatbot responding: "No, you cannot evict a tenant for refusing to pay rent. Evicting a tenant for this reason is not allowed."](https://awful.systems/pictrs/image/6e67be28-570c-4d14-bbb5-5ec86c0dd446.jpeg)