Preheat the oven to 350 and prepare a loaf pan with parchment and grease. Set to the side.
Zest and juice the oranges in seperate bowls.
In a medium-sized bowl, combine the flour, baking powder, baking soda, salt, and spices. Set to the side.
In a large bowl, whisk together the olive oil, sugar, eggs, zest, juice, milk, and vanilla. Mix to combine.
Gradually add the dry ingredients to the olive oil mixture. Fold in the mixture until no dry spots are left.
Add the batter to the prepared pan and bake in the oven for 50-60 minutes.
While the cake is baking, make the glaze. Combine the orange juice, heavy cream, and powdered sugar in a bowl. Whisk until desired consistency is reached.
Let the cake cool completely in the pan. When the cake is cool, take it out of the pan and pour the glaze on top. Top with orange zest if desired.