If I have a dividend reinvestment plan (DRP), will the dividends I reinvest increase the cost basis?

Yes, a dividend reinvestment plan uses dividends to invest in additional stock and will therefore increase your cost basis.