If we had one for real, we'd get in trouble with the No-Maj police, that's for sure.
It didn't help that Mary Lou was talking outside the bank - a BANK for crying out loud! A place where the Niffler can spend hours and hours of time collecting all shiny things.