The short story is actually an excerpt from a letter Lovecraft wrote. It begins in the attic of an ancient house. The narrator’s companion refers to the former owner of the house and the presumably violent end that befell him. He advises the narrator not to stay after dark or touch anything, especially the small object on a table, which the companion seems to fear considerably.
