We show that each element in the semigroup $S_n$ of all $n \times n$ non-singular upper (or lower) triangular stochastic matrices is generated by the infinitesimal elements of $S_n$, which form a cone consisting of all $n \times n$ upper (or lower) triangular intensity matrices.