Y. Euh, J. Park and K. Sekigawa were the first authors who defined the concept of a weakly Einstein Riemannian manifold as a modification of that of an Einstein Riemannian manifold. The defining formula is expressed in terms of the Riemannian scalar invariants of degree two. This concept was inspired by that of a super-Einstein manifold introduced earlier by A. Gray and T. J. Willmore in the context of mean-value theorems in Riemannian geometry. The dimension $4$ is the most interesting case, where each Einstein space is weakly Einstein. The original authors gave two examples of homogeneous weakly Einstein manifolds (depending on one, or two parameters, respectively) which are not Einstein. The goal of this paper is to prove that these examples are the only existing examples. We use, for this purpose, the classification of $4$-dimensional homogeneous Riemannian manifolds given by L. Bérard Bergery and, also, the basic method and many explicit formulas from our previous article with different topic published in Czechoslovak Math. J. in 2008. We also use Mathematica 7.0 to organize better the tedious routine calculations. The problem of existence of non-homogeneous weakly Einstein spaces in dimension $4$ which are not Einstein remains still unsolved.