A Yonko has no room to show weakness. After a conflict with Luffy, these parties could attack the Big Mom family and make sure the Yonko group is destroyed!
OPLovers may remember what happened to the Whitebeard group first. After their captain died, substitute captain (Marco) tried to fight with the Blackbeard group. They are defeated, and their territory is now taken by another Yonko.
Some are indeed occupied, some are forced to seek refuge in other Yonkō like Fishman Island.
New World is different from Paradise, the first half of the Grand Line. In a way, the second half of the Grand Line is a gang war arena of four of the strongest pirate groups in the world. One weakness alone will be exploited by other groups to strengthen themselves.
Luffy, Whole Cake Island and the Big Mom pirates are ruined. One Sweet Commander collapsed, and two others could catch up before it's over. A number of Big Mom kids, such as Moscatto and Opera, were killed. Aladine and Charlote Praline left the group.
Although Big Mom is just K.O., not to death, this condition is actually very tempting to be used by some groups to attack the Big Mom family. These are the parties who can benefit!
Captain Tsubasa: Dream Team
The Blackbeard Group
It would be interesting that Luffy would only get a copy of each Poneglyph, while Teach and his group continued to obtain their physical stone. When this happens, these two groups will actually be the two fighting in Raftel.
The Kaido Group
Another party who can take advantage of the opportunity to attack the Big Mom family can you check on the second page!