Open Question: UK Landlord Question... Right to quiet enjoyment clarification...?

We live in London, England and I'm looking for clarification in regards to the right to quiet enjoyment law. We pay our rent weekly, and in our contracts, (which we have found out aren't technically legal but we are all out of these illegal contracts and onto rolling contracts now) it states that the Landlord collects the rent on Sundays, quite frequently when we have all put our monies into the safe by Sunday the Landlord does not turn up on that day to collect rent, and basically comes in at anytime after it to collect the rent sometimes its morning sometimes evening and there seems to be no correlation to the day what day he turns up after it. My question relates to this point - as he is collecting rent is he violating the 'Right to quiet enjoyment' by not giving us 24 hour notice. The more detail given in responses the better, do not leave a short reply I would like details, especially if they are of your own personal experiences.