The Times' Randy Cohen has a marvelous idea: a literary map of Manhattan: "not of its authors' haunts but those of their characters, a map of the literary stars' homes." He invites readers to send in their own suggestions. Nothing comes to mind, immediately, but I'm sure digging through Dawn Powell (which I actually did, recently) would turn up something.
I wonder if Cohen would allow a citation from Bob Dylan. He's "literary," right? Surely, it must be pointed out that the Chelsea Hotel was the site where Dylan wrote "Sad Eyed Lady of the Lowlands" from Blonde on Blonde for then-wife Sara.
This, of course, we know from the song "Sara":
"Staying up for days/In the Chelsea Hotel/Writing `Sad-Eyed Lady of the Lowlands' for you..."
Hopefully more will come to mind.