Personally, ME and DE work did take a hit. But only for the first couple of weeks.
When I did it as outlined above, those were total non-issues after I go used to it. When I first started working my way into it, I didn't do assistance exercises, just upper back and abs after the main work.
After some time, add an assistance exercise. A very small one. Then sub a bigger assistance movement. Then add another small one. Then sub a bigger assistance exercise for that second assistance slot.
Even when you get used to this, if you feel like crap and you know you're under recovering because of stress, life, bs, etc, you can cut out assistance work entirely.
Just remember that the assistance is there to add to your main lifts, not take away from them.
I have the supplementary movements on their own days for recovery. With the higher frequency, it's too much for me to recover from having both DE or ME Lower and a supplementary Lower. Same with bench.
Normally, I'd try to let other people chime in before I would make a response unless I'm just damned sure of myself but I don't know of anyone else on these boards who have done what you intend to or what I have done, but there are a few who have done DUP (daily undulating periodization). That's just having a hypertrophy, power, and strength day once a week for each lift at it's core but using the main lift all the time for those traits. Some of the people who have tried it here loved it.
I don't see why this would be any more difficult to recover from, even with ME lifts because of the conjugating.