You can synthesis by syllable if the target language has a finite (and
small) syllable set. In English, syllables can be constructed from
phonemes freely, so it maybe quite hard to synthesis by syllables.
While in Chinese, the syllable set is limited, so it is possible to
synthesis by syllable, and it is quite easy to construct such a
system.