He may also have been affecting a spurious veneration for the court and his belief in the judicial system, seeking to compare his deference for authority with the unruliness and general disrespect exhibited by most criminals.
But in this case, it's actually pretty apt: The group combines the messier impulses of punk, psychedelia, '60s rock and '90s Britpop, complete with a carefully cultivated reputation for unruliness which includes (but has not been limited to) urinating on each other, vomiting onstage and setting their instruments on fire.