Have is correct. People mistakenly use "of" because they get confused with the pronunciation of "could've."
