This paper studies the constrained robust adaptive stabilization problem for a class of lower triangular systems with unknown control direction. A robust adaptive feedback control law for the systems is proposed by incorporating the technique of Barrier Lyapunov Function with Nussbaum gain. Such a controlled system arises from the study of the constrained robust output regulation problem for a class of output feedback systems with the unknown control direction and a nonlinear exosystem. An application of the constrained robust adaptive stabilization design leads to the solution of the constrained robust output regulation problem in the sense that the output tracking error is constrained within the prescribed barrier limit while asymptotically approaching to zero and the closed loop signals are all bounded for all the time. A numerical example is provided to illustrate the performance of the proposed control.