In a large bowl, whisk lemon pudding mix with cold milk for 2 minutes. Let rest for 5 minutes to thicken.
In a separate bowl, beat heavy cream, powdered sugar, and vanilla until stiff peaks form, about 2–3 minutes.
Gently fold half of the whipped cream into the lemon pudding until smooth. Reserve remaining whipped cream for topping.
Cut angel food cake into 1-inch cubes.
In a trifle dish or large glass bowl, layer: ⅓ of cake cubes, ⅓ of blueberries, ⅓ of pudding mixture. Repeat two more times.
Spread reserved whipped cream evenly over the top layer.
Garnish with remaining blueberries, lemon zest, and mint leaves.
Cover and refrigerate for at least 2 hours before serving.