Should I put tar paper against the cement foundation wall before I put up the 2x4's?
Tar paper isn't necessary inside, as long as the foundation walls are covered with a bituminus coating (standard) on the outside. Leave an air gap between the concrete and the studs—about 1"—and insulate with fibreglass with a vapour barrier on the warm side of the wall.