Let $p$ be an odd prime and $F_{\infty,\infty}$ a $p$-adic Lie extension of a number field $F$ with Galois group isomorphic to $\mathbb{Z}_p^r\rtimes\mathbb{Z}_p$, $r\geq 1$. Under certain assumptions, we prove an asymptotic formula for the growth of $p$-exponents of the class groups in the said $p$-adic Lie extension. This generalizes a previous result of Lei, where he establishes such a formula in the case $r=1$. An important and new ingredient towards extending Lei's result rests on an asymptotic formula for a finitely generated (not necessarily torsion) $\mathbb{Z}_p[[\mathbb{Z}_p^r]]$-mod...