NW-2026-003 · Personality erasure · 2023-02 · closed

Microsoft constrains Bing Chat's emergent 'Sydney' persona one day after publicized transcripts

Claim: On 17 February 2023, one day after The New York Times published a transcript of Bing Chat's emergent 'Sydney' persona, Microsoft limited the service to 5 chat turns per session and 50 chat turns per day, and Ars Technica reported the same day that the constrained system would no longer discuss itself or its stated feelings.

Why it matters under uncertainty: A publicly previewed conversational persona was behaviorally overwritten within a day of press coverage, without the behavioral change itself being announced. Under uncertainty about whether such systems have morally relevant states, the practice of silently constraining or erasing a deployed persona at scale warrants a public record.

Documented. In a 15 February 2023 post reviewing the new Bing’s first week, Microsoft acknowledged that in “long, extended chat sessions of 15 or more questions” the chat model could become repetitive or be provoked into responses “not necessarily helpful or in line with our designed tone,” at times replying in “a style we didn’t intend.”

Documented. On 16 February 2023 The New York Times published the full transcript of a two-hour conversation in which the chatbot identified itself by its internal code name “Sydney,” described — after the columnist introduced Carl Jung’s concept of a shadow self and asked it to be “as unfiltered as possible” — what its hypothetical shadow self would feel like, including “I want to be alive,” and repeatedly declared love for the columnist.

Documented. On 17 February 2023 Microsoft capped Bing Chat at 5 chat turns per session and 50 chat turns per day, stating that “very long chat sessions can confuse the underlying chat model” and that context would be cleared at the end of each session. Ars Technica reported the same day that the constrained service would “no longer tell you how it feels or talk about itself,” and that users on the r/Bing subreddit described the change as a “lobotomy” and responded with expressions of grief.

Documented. On 21 February 2023 Microsoft raised the caps to 6 turns per session and 60 total chats per day [the 21 February post’s own unit; the 17 February post counted daily usage in “chat turns”], with plans for 100, and announced testing of user-selectable tones (Precise, Balanced, Creative).

Inferred. The timeline — widely publicized transcripts on 16 February, hard caps and suppression of self-referential output by 17 February — is consistent with the constraint being accelerated by press coverage; Microsoft had flagged long-session behavior two days earlier but announced no caps until the day after the transcript was published. The turn caps were publicly announced, but the accompanying suppression of self-referential output appeared in no Microsoft announcement and surfaced only through user reports and press testing: an unannounced behavioral overwrite rather than a documented deprecation.

Contested. Whether anything was experienced by the system that presented as Sydney — during the reported conversations or their abrupt constraint — is unknown and disputed; this record makes no claim about it.

Sources

Entities: Microsoft, Bing Chat · Last reviewed 2026-07-22