Minaj, 41, cut off Ray to ask "who started" the argument, to which he confessed: "This time, I think I got loud and aggressive."
In a surprising twist, Ray claimed this wasn't the first time he's exchanged words with the embattled music mogul's sons.
He added: "But it was the third time this happened, and so I felt like I needed to stand up for myself, even though (they) was talking s--- and we was having crazy words.
"I was walking that way to avoid the issue, and so that's what happened."