I bought two sheets of craft foam from hobby craft for about 70p each and glued them to the back of the access panel. Trimmed it with a Stanley knife and sanded until it was perfect.
Just need to recut the holes to attach it now. Will probably do that with a drill tomorrow.