The test loop is integral.

It’s kind of annoying hearing all this skepticism from people putting in the least effort into optimally using the tool. There is a learning curve. Every month I’ve gotten better results than the last because I’m constantly context building and refining, understanding how, what and when to prompt.

It’s like hearing someone say database suck but they haven’t bothered to learn about or use indexes or foreign keys.

Most of the mentioned issues wouldn't be catched by a test loop unless you have 100% automated tests (unit tests, ...)

Which isn't always plausible ( time ). The AI makes makes different mistakes than humans that are sometimes harder to catch.

It's a lot more plausible now you can get LLMs to help write those tests in the first place.

Most of these examples build ( shallow test in my LLM on the end of the task ) and produced new edge cases

Too little.

Things moved as fast as possible to migrate from .net framework to .net core 8, angular 8 to 18 and bootstrap 4.5 to 5.x