Answering your questions from my knowledge level on AI:
Managing AI agents is like running a knowledge business. If you are not an expert enough to understand what agents are doing, there is still large room for errors. Its important to set design decisions early in the development process.
Your questions:
3. I think this is absurd. Agent can generate the test cases, but you still have to verify the tests are actually valid.
4. The architecture document should be the source of truth. SO when a engineer reviews they know what to look for & flag/fix. The comprehensive the document is the better. Version it based on what the prototype carries. — Data models, API design, Services, Roles, etc. You can ask this to AI — What all should a high/low level SDD carry?
5. Just make sure the architecture doc is solid, development is as per the document, ask AI to generate/perform regression test cases and document them as well (pass/fail).
I came across this comment on HN and got me curious to know if a lot of people in the Website design & development space are looking for a cheaper Webflow alternative. And why? what more users are looking for?