Continue using that combo if you like, but Dodge Offset with it. So YB(hold)RYR. That right there is essentially broken -- you can beat every difficulty without much trouble just doing that single move. As for other good moves, I liked to use this combo often: P<-P(hold for the lift), PPKP, A B, PPPKKK. I think that's how it went, to be honest I've nearly forgotten how to play and it's only been a month since I PP'd everything.

PP (delay) P is good, PPK(K/K/P) is good (and very very useful against Jeanne). A couple of the angel arms are pretty useful as well, like the staff and bow. Pick them up and mash B with the bow to annihilate everyone you see or B with the staff to do this spin attack that also destroys everyone around you (they also give you tons of points + multiplier).
Bayonetta's combo system is very free-form, so just experiment really. Lots of moves wind up launching the enemy and from there he's all yours. It's not as combo focused as DMC (more so linking every enemy together during the fight for the multiplier), so really just do whatever works. Take a look at the combo list next time you play and just use short attacks that end with a weave, like PKP, PPKKK, PP . P, etc.
Also, you might want to use the fire durgas, since that will leave a bomb in the air for a few seconds with its hold attack