In the side, i.e. in the outside, in a little chest fixed to it, for nothing but the tables of stone were contained in the ark, 1Ki_8:9. Here it was kept for greater security and reverence.
A witness against thee, i.e. against thy people, to whom he turns his speech, that they might be more affected with it.