codegen as the last step
Because the models like sonnet and opus are able to generate great code... the productised service section of software is at peak.
Can't figure out something? Lets do a fucking codegen and lets hope we can figure out after that. And this practice is being followed at every step.. when chatgpt can't figure out something it goes on to generate code and then that code runs in a sandbox to try to derive the final output. Do you see how insane this is?
Ask it to generate a PDF, instead of using a service that can generate a PDF it will try to create a code to generate a new PDF and then dispose that code. If you have to generate a PDF why not use a service with a set of templates and see if the user is happy with it? If not, you can always generate a fresh code and do it highly customized. My gut tells me the default templates for invoice, taxation, salary slip etc will work for most cases and only edge cases will see codegen.
Codegen has become cheap but it is still not near zero. And it's so fucking slow and doesn't lead the product anywhere...
If you have an engineer however cheap, would you like them to work on new code everytime or try create templates and sections as part of learning from past projects? You can't run a web design company if you don't have a tools and stacks in place.. you can't create fresh code from scratch for every new website.
Keep asking, what will it take to not codegen at all and if we really have to generate the code.. what will it take to create a template out of it. Having million templates is still better than outputting 100k tokens every time you codegen.
Just because now LLMs can write code, the basics hasn't changed.