Can't enter "31 1st Ave" while holding anything

Impossible to enter the “31 1st Ave” building properly while holding anything. (reported in-game as well)

If your hands are empty, it works fine, but if you have a cart or a box in your hand, you can’t enter. I was able to make it work by clicking on Bizman, and closing it - see video.