Matthew Schwartz of Harvard has made a big recent splash, between his public Aspen talk "10000 Einsteins" a year ago about the role of AI and the future of physics, and his talk last week at the APS Global Physics summit on the same topic, and now with this essay, "Vibe Physics: The AI Grad Student", on the website of Anthropic (producers of the AI tool Claude).
The essay talks about how Prof. Schwartz used Claude to write this paper, and he states that the AI tool functions roughly like a 2nd year grad student (one who also doesn't get tired or complain, but does need close checking and supervision). The claim is that with this approach to doing calculations and writing papers, he was able to come out with a piece of work that would've taken literally ten times longer if done by working with a human student. Note that he's not exactly unbiased, and he concludes his essay (on anthropic's site) saying you should spend the $20/month Claude subscription fee and it will change your life.
There is no doubt that AI tools can speed up certain kinds of work, and there is a every hope that applying this in science will lead to increased pace of progress. That said, right now these tools are (unsurprisingly) best at working in areas that are well-known and explored - one of my colleagues has tried applying these to really underexplored higher dimensional problems, and they're much less effective there. The essay's claim that "LLMs are profoundly creative" is provocative. There is also no discussion here about the cost of these tools, in financial, energy, and environmental terms.
Still, Schwartz raises many questions about the future of the field and graduate education in general. (His paragraph about how human beings will still be needed in science for getting experimental data, at least for a while, is really something.) University research is not just about answering scholarly questions; it's about educating people. Maybe some faculty will revel in writing papers without that kind of interaction, but somehow I don't think we're quite at the stage yet where we don't need to worry anymore about training experts in technical fields. I do agree that it's good advice for everyone to pay close attention to where these capabilities are going. We certainly live in interesting times.