The worst is that as soon as new faster CPU's come out the programmers have already produced bloated softwares that eat all the computational power.... with unusefull gadgets
Don't even get me started on this one!
I've long held that Microsoft would make more money selling a minimalist, rock solid, OS... and nothing but the OS... Add your own options --browser, word pro, etc.-- by download, don't ship it with the OS. But then I see people go all gaga over an onscreen CPU monitor (why?) or a fancy clock that manages to consume 10% CPU... It's really amazing the crap people do to perfectly good computers...
And FWIW... yes, I agree, there is a LOT of really crappy software out there.
You are right that there are many bugs on optimization, but our job is to find and signal them so Pelle can fix the compiler. It's our payment for use of the compiler itself.
Well, that and an annual donation...
Anyway with no optimization you'll spare some problems and with actual CPU clock's it's hard to see any difference. Unless when strong compute power is used like in math routines (matricial calculations, discrete integration, real-time FFT and DCS for video, etc), but also intensive string manipulation, substitution & replacement can show the difference.
Surprisingly, I do very little math in the things I do. Most of it is file access --Inventory records, file copies, etc. The busiest parts of it are generally broken up by the relatively slow disk access. The slowest parts of my applications are the keyboard, most spend 80% of their time waiting for someone to type something. As such it's likely the optimizations don't make much overall difference. On AMD CPUs with "cool and quiet" enabled, it's unusual for them to ever get up to full speed, mostly they just idle along at 1/2 speed. It's not like I'm sending it off to do 6 hour long calculation runs or something...