Several of Dørnebergers art have been purchased by the National Gallery and he had many famous artists in his circle, including Edvard Munch and Axel Gallén, who both painted portraits of him.

Dørnberger is known to the locals at least as much for his eccentric behaviour. He always wore a distinctive Hamburg hat, he had three legs and carried two pistols in his belt, which he called "Kitty" and "Kitty's brother". He was keen to keep his shooting skills up to par so he aimed for cat tails which resulted in Son having a large population of tailless cats. One of the daughter's suitors was also shot, and Dørnerberger was charged but acquitted by the Court of Appeal because he allegedly shot to castrate him, not to kill. In the house there are bullet holes in many rooms and on the exterior walls.

While sitting on the train once, he stuck a knife through his trouser deep into his wooden leg. Both women and children in the compartment fainted.

Dørnberghuset is a special building, where the oldest part is from around 1680, and later built on in 1700 and 1900. The house is made of timber and half-timbering with original windows made of curved glass.