The Markup report reveals multiple instances where the chatbot provided wrong advice about legal obligations. For example, the AI chatbot claimed bosses could accept workers’ tips and landlords are allowed to discriminate based on source of income – both wrong pieces of advice. Launched in October 2023 by Mayor Adams’s administration, the pilot program has been found to generate flawed responses.