At the national level, you can find incarceration statistics in the Sourcebook of Criminal Justice Statistics published by the Bureau of Justice Statistics.
Section 6 of the sourcebook concerns statistics of jail and prisons and selected data is broken down by state.