Not sure if this helps but I once had a very similar problem. Turned out the file manager RANGER could handle it (not sure why)
Ranger is not user friendly, basically launch it via command line (ranger, once its installed) and then use arrow keys (or vim keys) to navigate to the folder you are trying to delete, press 'Shift d' (uppercase D) and then hit enter, should remove the folder)
good luck :)