Of course they do.  Elephants grieve like humans do when one of their number are killed.  Koko the gorilla signed for days on end, saying that she wanted her cat, All Ball back after it has died.  And that she missed him.

So, yes.  Animals do feel regret.  And happiness, sadness and the entire gamut of emotions.