The short answer is yes. I always have a book on the go. I might not have picked up and read any of that book in four days but it’s on my bedside table or ready to go in my handbag whenever I might need it. I very rarely read more than one physical book at once (I do tend to read an audiobook and a physical/ebook at the same time as I consume them in different places and ways) but I do have a few books piled up by my bed as my would-like-to-pick-up-soon TBR.
I find I have to start a book, even if it takes me a long time to read it. If I finish a book and don’t pretty much immediately choose what book I’m going to read next, that’s when I can end up in an almost reading slump as there’s too much choice and I don’t know what book to read next.