I wonder if it's more like "qualitative gradient descent" on a very non-linear non-convex surface.

You can try this yourself in a simple fashion -- let's say you have piece of code that you want to speed up. Point your agent to a code profiler (your oracle -- typically your Python profiler) and tell it speed up the code. I've tried it. It works.