Preheat the oven to 350 degrees and prepare a loaf pan with parchment and grease. Set to the side.
Juice and zest the oranges. Save ¼th cup of the juice for the glaze and set the rest to the side.
Combine the sugar and eggs with a whisk. Then, add in the sour cream, oil, orange juice, and orange zest. Whisk to combine.
Add in the flour, baking powder, baking soda, and salt. Mix to combine.
Fold in the ginger pieces using a rubber spatula.
Pour the batter into the prepared cake pan. Place the cake in the oven and bake for 45-55 minutes, until a toothpick run cleans.
While the cake is baking, make the glaze. Combine the powdered sugar, orange juice, and heavy cream in a small bowl. Mix until there are no lumps left.
When the cake is done, let it fully cool in the pan. Then, remove the cake from the pan and top with the glaze. Top the cake with more chopped ginger pieces if desired.