Researchers are developing software entirely through natural language conversations with advanced large language models. The trend is transforming how research gets done—but it also presents new challenges for evaluating the outcomes.