The exception to the rule? Limerick poems, a form of humorous poetry that's been making us laugh for hundreds of years.
Two poems with a strict rhyming structure are limericks and clerihews ... third and fourth lines add extra information or something funny. The second line rhymes with the first.