Cool! Now I know the NAME for such things.
Someone once showed me an "Easter Egg" of THIS scene from "The Big Lebowski." But it was on a tv series, and a young lady was involved, not a guy. I can't find it now. Maybe YOU'VE seen it?
https://youtu.be/HUPB4hMAbbY
Yes, breaking down the 4th Wall is when the pretend-set is demolished by actors speaking directly to the audience. It is also employed at the very end of the operetta, "Gianni Schicci." (Puccini.) And countless other instances, too.
Unless you just want to enjoy the duet-Aria, jump to 1:55, where it begins.
https://youtu.be/YhnT7NdUb48