The Karjenners are through it all in regards to affairs