I started with 0 and worked my way chronologically from there (with the remakes for 1 and 2), and 0 is my pick for best if the series. I think the thing to know about the real estate sub-game, and others of its ilk like the host club in the same game (I think), is that they are completely parallel, non-consequential, optional content.
I personally feel that you could go through every single Yakuza game playing only the main story and side stories without missing anything of value. I would frequently force myself to play batting cages or karaoke or dancing because fans talk a lot about that stuff, but there's really very little there to compel your attention unless you enjoy it. You can totally skip all that.
You could probably also skip the side stories if you just want to follow the main path, but those I do think are more crucial to Yakuza's experience and identity - the outrageously silly flip side of the coin to the main story's soap-opera-esque melodrama.
If I remember correctly, 0 might be the only game to do this. 0 was my first game too and I remember being taken back by this (the static scene talking to some guy in a car smoking a cigarette or something is what sticks out in my memory). It's possible other games did this too and I just forgot, but I'm not sure.
As for 0 being a good starting point, I do disagree. Having played all of them, I think 0 would land better if it was played after 1, 2, and 3. Kiryu's and especially Majima's stories in 0 heavily reference things that occur or are at least revealed in 1 and 3.