With my voice; the witness of my faith and fervency of affections.
Out of his holy hill; either out of heaven, so called Psa_15:1: compare Isa_66:1. Or rather,
2. Out of the hill of Zion, where God was especially present, the ark being there at this time; towards which the saints then used to direct their prayers, and from thence God heard and answered and blessed them, Psa_128:5 134:3.