I mean, yes, you are the jungler you have the right to keep it, but you don't even use mana...
I honestly think the blue buff is better off on the support than the non-mana jungler, at least for the support they can spam more cc and poke.
Same goes for non-mana mid laners too, why do you even take a blue buff if you don't use mana? Why waste such precious resource?
edit: not talking about first blue buff, ofc you need the first blue buff for exp, but the later ones like say 15 minutes into the game that buff really isn't that valuable for a non-mana jungler.