If a building becomes architecture, then it is art.
Architecture tends to consume everything else, it has become one's entire life.
I don't see that any buildings should be excluded from the term architecture, as long as they are done properly.
The primary factor is proportions.