Footnote: I just figured out where I first read "And He Built A Crooked House". It was reprinted in one of my all-time favorite SF anthologies, Where Do We Go From Here? edited by Isaac Asimov (Doubleday, 1971), which was intended as a Science Fiction reader for high school and college science students -- there are study questions after each story.
For this story, Asimov included three figures of a tesseract in pseudo four-dimensions and unfolded in three-dimensions. He also mentioned that Heinlein in 1941 lived on Lookout Mountain Avenue and was the Original Hermit of Hollywood he refers to in the beginning of the story.
I read this anthology in Mr. Moody's Physics class at Grimsley Senior High School, Greensboro NC, in my junior year -- 1974-75 -- and eleven years later in physics graduate school at Michigan Tech my office mate, Dave Woon, had a copy which he gave to me after I rhapsodized about how wonderful a collection it was, and so I am eternally grateful to him. (Amazon.com, BTW, lists 39 new & used hardcover copies for sale starting at $0.29!!)
This really is a great anthology. Out of 17 stories, at least 14 or 15 I'd rate as some of the best SF short stories I read in the 1970s, but really none of them are stinkers. I'd go on and on, but I have grading to do -- half of my final exams just got back from one grader as well as one of the last quizzes, so I need to work on that.
For the record, my three favorite SF anthologies -- all from my early years of reading SF are, in order of when I read them: The Green Hills of Earth by Robert Heinlein, The Best Science Fiction of the Year, edited by Terry Carr (1972) and Where Do We Go From Here? edited by Isaac Asimov. The first is still in print, used copies of the others are available through Amazon partners and other used book dealers.