This pair operates on entirely different levels: Cancer wants love to be emotionally transcendent, Libra seeks perfect intellectual communication. Libra has no sympathy for Cancer's moods, and Cancer is made insecure by Libra's detachment and shallow emotions. Cancer is too temperamental and possessive for airy Libra.
They have a hard time establishing real sexual rapport, and that exasperates Cancer.
They both love a beautiful home, but Libra also needs parties and people and outside pleasures. When Cancer turns critical, especially about Libra's extravagance, Libra starts looking elsewhere.