The title is a song from the musical "Kiss Me, Kate." The original Broadway production opened at the New Century Theater on December 30, 1948, ran for 1077 performances, and won the 1954 Tony Awards for the Best Musical, Book, and Score.
The shampoo Jesse mentions "Gee, Your Hair Smells Like Melons" is a reference to the shampoo "Gee, Your Hair Smells Terrific" that was sold in the 1970s, but is still produced in the Philippines.
When Joey books the musical group "R.E.M." at the Smash Club, he mistakes them for the 1980s-2000s band who sings "Losing My Religion," but the name represents the initials of the singers "Renee, Ester, and Martha." This is similar to how the musical group TLC uses their name to represent the initials of the singers T-Boz, Left Eye, and Chilli.