We’ve had some people report the same problem… could you tell us what version you’re using?
The workaround is to go and delete all the pages for the site first (there’s a default page added to new sites, so even if you haven’t made any yourself there’s at least one to delete). Then you should be able to delete the site without issue.