Not Even Wrong

The US particle physics community has been going through a multi-year process designed to lead up this fall to a 10 year strategic plan to be presented to the DOE and the NSF. In particular, this will generate a prioritized list of what projects to fund over this period. The process began with the Snowmass self-study, concluded last year, and available here. Since last fall there have been two independent efforts going on:

• A National Academies study has been holding meetings, materials available here.
• A P5 (Particle Physics Project Prioritization Panel) is holding meetings, see here, and planning for a report to NSF and DOE by October.

Looking through all the materials relevant to particle theory, there seems to me little acknowledgement of the serious problems faced by the subject, or any new ideas for how to address these problems. Most of the effort though is devoted to where most of the money will be spent, on the experimental side. To a large degree, for the short-term it’s clear where funding has to go (to continue supporting the LHC into the HL-LHC era, and finish building the DUNE/LBNF US neutrino project). The longer-term is however very uncertain, as it is unclear whether there’s a viable energy-frontier project that could study higher energies than those accessible at the LHC.

Last week EPP2024 and P5 held Town Hall events at Fermilab, see here and here. There’s video of the EPP2024 event here. On the question of the long-term future, one issue that is getting a lot of attention is that of whether to prioritize development of a possible muon collider. In this presentation a young physicist gives a future timeline including their likely retirement and death dates, showing that a muon collider is their only hope for new energy frontier physics during their lifetime. For those of my age the situation is a bit different, since even a muon collider is not going to do the job. At the EPP2024 event (3:28 in the video) Nima Arkani-Hamed makes the case that:

I think the subject has not been so exciting for many, many decades, and at the same time our ability to experimentally address and solidly settle some of these very big questions has never been more uncertain. I don’t think it’s a normal time, it’s an inflection point in the history of the development of our subject, and it requires urgency… The confluence of the technical expertise for doing so and the enthusiasm amongst the young people who are willing to do it exists now and I very much doubt it will exist in 10 or 15 years from now. If we are going to do it, we have to start thinking about doing it now.

While his point is more general, he’s clearly making the case for starting a new energy frontier machine project soon, with the muon collider the one possibility for getting to higher energies than the LHC.

A few weeks ago there was a workshop at the KITP devoted to the muon collider question, with a news story here (anyone know why the video of the panel discussion is password-protected?). Arkani-Hamed gave a talk aimed at other physicists here. On the European front, a couple days ago there was this meeting.

Already twenty years ago when I was writing Not Even Wrong, it was clear that a muon collider was in principle a very attractive idea for how to get to higher energies and I wrote about this in the first chapter of the book. The much higher mass of the muon than the electron means that you don’t have the same synchrotron energy loss problem, so can build a much smaller storage ring at the same energy, or get to much higher energies with the same size. The problem though is that muons have a life-time of only 2.2 microseconds. This implies two serious difficulties:

• You need to produce, store, accelerate and collide the muons in a very short period of time.
• As the muons decay they’ll produce large numbers of high energy electrons and neutrinos, creating a difficult environment for detectors to operate in and significant radiation hazards.

Normally one thinks of neutrinos as virtually never interacting with anything, but the numbers and high energies of the neutrinos produced at a muon collider create a potential significant radiation hazard, one that cannot be dealt with by shielding.

While I might not be around to see the results from a muon collider, if such a thing is viable, I’d strongly support such a project, and would even buy a t-shirt. The US DOE HEP budget is about a billion dollars/year. One would think this should be enough to accommodate building demonstrator projects or a small collider ring on a 10 year timescale, and possibly even an energy-frontier ring on a 20 or more year timescale. What’s worrying me a bit is the fact that more visible progress on this hasn’t happened since I looked into it 20 years ago. Why no current demonstrator project? Have the potential radiation hazard issues found solutions? I’d be very curious to hear from anyone with expertise on these questions.

I just noticed that last semester Edward Witten was teaching Physics 539 at Princeton, a graduate topics course. Since he’s now past the age of 70, at the IAS he is officially retired and an emeritus professor (the IAS is the only place I know of in the US with retirement at 70, presumably since it is a non-teaching institution). I don’t know if there are other times Witten has been teaching courses at the university since his move to the IAS in 1987.

Videos of the first few lectures are on Youtube here, problem sets on this web-page. It seems like the course started out covering issues with causality in general relativity, following these lecture notes, then later moved on to topics in quantum information theory.

Some interviews that readers of this blog may find of interest:

• David Zierler at the AIP interviews Lee Smolin (April 1, 2021).
• David Zierler at the AIP interviews Stephon Alexander (June 7, 2021).
• Alexis Papazoglou at IAI News interviews me (hot off the press).

This posting is about the problems with the idea that you can simply formulate quantum mechanical systems by picking a configuration space, an action functional S on paths in this space, and evaluating path integrals of the form
$$\int_{\text{paths}}e^{iS[\text{path}]}$$

Necessity of imaginary time

This section has been changed to fix the original mistaken version.
If one tries to do this path integral for even the simplest possible quantum field theory case (a non-relativistic free particle in one space dimension), the answer for the propagator in energy-momentum space is
$$G(E,p)=\frac {1}{E-\frac{p^2}{2m}}$$
Fourier transforming to real-time is ill-defined (the integration goes through the location of the pole at $E=\frac{p^2}{2m}$). Taking $t$ complex and in the upper half plane, for imaginary $t$ the Fourier transform is a well-defined integral. One gets the real-time propagator then by analytic continuation as a boundary value. For a relativistic theory one has
$$G(E,p)=\frac{1}{E^2-(p^2+m^2)}$$
and two poles (at $E=\pm \sqrt{p^2+m^2}$) to deal with. Again Fourier-transforming to real-time is ill-defined, but one can Fourier transform to imaginary time, then use this to get a sensible real-time propagator by analytic continuation.

Trying to do the same thing for Yang-Mills theory, again one gets something ill-defined for real time, with the added disadvantage of no way to actually calculate it. Going to imaginary time and discretizing gives a version of lattice gauge theory, with well-defined integrals for fixed lattice spacing. This is conjectured to have a well-defined limit at the lattice spacing is taken to zero.

Not an integral and not needed for fermions

Actual fundamental matter particles are fermions, with an action functional that is quadratic in the fermion fields. For these there’s a “path integral”, but it’s in no sense an actual integral, rather an interesting algebraic gadget. Since the action functional is quadratic, you can explicitly evaluate it and just work with the answer the algebraic gadget gives you. You can formulate this story as an analog of an actual path integral, but it’s unclear what this analogy gets you.

Phase space path integrals don’t make sense in general

Another aspect of the fermion action is that it has only one time derivative. For actions of this kind, bosonic or fermionic, the variables are not configuration space variable but phase space variables. For a linear phase space and quadratic action you can figure out what to do, but for non-linear phase spaces or non-quadratic actions, in general it is not clear how to make any sense of the path integral, even in imaginary time.

In general this is a rather complicated story (see some background in the part I post). For an interesting recent take on the phase-space path integral, see Witten’s A New Look At The Path Integral Of Quantum Mechanics.

Update: A commenter pointed me to this very interesting talk by Neil Turok. The main motivation that Turok explains at the beginning of the talk (and also in the Q and A afterwards) is exactly one that I share. He argues that the lesson of the the last 40 years is that one should not try and solve problems by making the Standard Model more complicated. All one needs to do is look more closely at the Standard Model itself and its foundations. If you do that, one thing you find is that there’s a “trouble with path integrals”. In Turok’s words, the problems with the path integral indicate that “the field is without foundations” and “nobody knows what they are doing”.

I do though very much part company with him over the direction he takes to try and get better foundations. He argues that you shouldn’t Wick rotate (analytically continue in time), but should complexify paths, analytically continuing in path space. For some problems doing the latter may be a better idea than doing the former, and in his talk he works out a toy QM calculation of this kind. But the model he studies (anharmonic oscillator) doesn’t at all prove that going to the imaginary time theory is a bad idea, for some calculations that works very well. He’s motivated by defining the path integral for gravity, where Euclidean quantum gravity is a problematic subject, but the gravitational version of the toy model I think will also be problematic. The ideas I’ve been pursuing involving the way the symmetries of spinors behave in Euclidean signature I think give a promising new way to think about this, and you won’t get that from just trying to complexify the conventional variables used to describe geometries.

Two things recently made me think I should write something about path integrals: Quanta magazine has a new article out entitled How Our Reality May Be a Sum of All Possible Realities and Tony Zee has a new book out, Quantum Field Theory, as Simply as Possible (you may be affiliated with an institution that can get access here). Zee’s book is a worthy attempt to explain QFT intuitively without equations, but here I want to write about what it shares with the Quanta article (see chapter II.3): the idea that QM or QFT can best be defined and understood in term of the integral
$$\int_{\text{paths}}e^{iS[\text{path}]}$$
where S is the action functional. This is simple and intuitively appealing. It also seems to fit well with the idea that QM is a “many-worlds” theory involving considering all possible histories. Both the Quanta article and the Zee book do clarify that this fit is illusory, since the sum is over complex amplitudes, not a probability density for paths.

This posting will be split into two parts. The first will be an explanation of the context of what I’ve learned about path integrals over the years. If you’re not interested in that, you can skip to part II, which will list and give a technical explanation of some of the problems with path integrals.

I started out my career deeply in thrall to the idea that the path integral was the correct way to formulate quantum mechanics and quantum field theory. The first quantum field theory course I took was taught by Roy Glauber, and involved baffling calculations using annihilation and creation operators. At the same time I was trying to learn about gauge theory and finding that sources like the 1975 Les Houches Summer School volume or Coleman’s 1973 Erice lectures gave a conceptually much simpler formulation of QFT using path integrals. The next year I sat in on Coleman’s version of the QFT course, which did bring in the path integral formalism, although only part-way through the course. This left me with the conclusion that path integrals were the modern, powerful way of thinking, Glauber was just hopelessly out of touch, and Coleman didn’t start with them from the beginning because he was still partially attached to the out-of-date ways of thinking of his youth.

Over the next few years, my favorite QFT book was Pierre Ramond’s Field Theory: A Modern Primer. It was (and remains) a wonderfully concise and clear treatment of modern quantum field theory, starting with the path integral from the beginning. In graduate school, my thesis research was based on computer calculations of path integrals for Yang-Mills theory, with the integrals done by Monte-Carlo methods. Spending a lot of time with such numerical computations further entrenched my conviction that the path integral formulation of QM or QFT was completely essential. This stayed with me through my days as a postdoc in physics, as well as when I started spending more time in the math community.

My first indication there could be some trouble with path integrals I believe started in around 1988, when I learned of Witten’s revolutionary work on Chern-Simons theory. This theory was defined as a very simple path integral, a path integral over connections with action the Chern-Simons functional. What Witten was saying was that you could get revolutionary results in three-dimensional topology, simply by calculating the path integral
$$\int_{\mathcal A} e^{iCS[A]}$$
where the integration is over the space of connections A on a principal bundle over some 3-manifold. During my graduate student days and as a postdoc I had spent a lot of time thinking about the Chern-Simons functional (see unpublished paper here). If I could find a usable lattice gauge theory version of CS[A] (I never did…), that would give a way defining the local topological charge density in the four-dimensional Yang-Mills theory I was working with. Witten’s new quantum field theory immediately brought back to mind this problem. If you could solve it, you would have a well-defined discretized version of the theory, expressed as a finite-dimensional version of the path integral, and then all you had to do was evaluate the integral and take the continuum limit.

Of course this would actually be impractical. Even if you solved the problem of discretizing the CS functional, you’d have a high dimensional integral over phases to do, with the dimension going to infinity in the limit. Monte-Carlo methods depend on the integrand being positive, so won’t work for complex phases. It is easy though to come up with some much simpler toy-model analogs of the problem. Consider for example the following quantum mechanical path integral
$$\int_{\text {closed paths on}\ S^2} e^{i\frac{1}{2}\oint A}$$
Here $S^2$ is a sphere of radius 1, and A is locally a 1-form such that dA is the area 2-form on the sphere. You could think of A as the vector potential for a monopole field, where the monopole was inside the sphere.

If you think about this toy model, which looks like a nice simple version of a path integral, you realize that it’s very unclear how to make any sense of it. If you discretize, there’s nothing at all damping out contributions from paths for which position at time $t$ is nowhere near position at time $t+\delta t$. It turns out that since the “action” only has one time derivative, the paths are moving in phase space not configuration space. The sphere is a sort of phase space, and “phase space path integrals” have well-known pathologies. The Chern-Simons path integral is of a similar nature and should have similar problems.

I spent a lot of time thinking about this, one thing I wrote early on (1989) is available here. You get an interesting analog of the sphere toy model for any co-adjoint orbit of a Lie group G, with a path integral that should correspond to a quantum theory with state space the representation of G that the orbit philosophy associates to that orbit. Such a path integral that looks like it should make sense is the path integral for a supersymmetric quantum mechanics system that gives the index of a Dirac operator. Lots of people were studying such things during the 1980s-early 90s, not so much more recently. I’d guess that a sensible Chern-Simons path integral will need some fermionic variables and something like the Dirac operator story (in the closest analog of the toy model, you’re looking at paths moving in a moduli space of flat connections).

Over the years my attention has moved on to other things, with the point of view that representation theory is central to quantum mechanics. To truly play a role as a fundamental formulation of quantum mechanics, the path integral needs to find its place in this context. There’s a lot more going on than just picking an action functional and writing down
$$\int_{paths}e^{iS[\text{path}]}$$

Since I had a little free time today, I was thinking of writing something motivated by two things I saw today, Sabine Hossenfelder’s What’s Going Wrong in Particle Physics, and this summer’s upcoming SUSY 2023 conference and pre-SUSY 2023 school. While there are a lot of ways in which I disagree with Hossenfelder’s critique, there are some ways in which it is perfectly accurate. For what possible reason is part of the physics community organizing summer schools to train students in topics like “Supersymmetry Phenomenology” or “Supersymmetry and Higgs Physics”? “Machine Learning for SUSY Model Building” encapsulates nicely what’s going wrong in one part of theoretical particle physics.

To begin my anti-SUSY rant, I looked back at the many pages I wrote 20 years ago about what was wrong with SUSY extensions of the SM in chapter 12 of Not Even Wrong. There I started out by noting that there were 37,000 or so SUSY papers at the time (SPIRES database). Wondering what the current number is, I did the same search on the current INSPIRE database, which showed 68,469 results. The necessary rant was clear: things have not gotten better, the zombie subject lives on, fed by summer schools like pre-SUSY 2023, and we’re all doomed.

But then I decided to do one last search, to check number of articles by year (e.g. search “supersymmetry and de=2020”). The results were surprising, and I spent some time compiling numbers for the following table:

These numbers show a distinct and continuing fall-off starting after 2015, the reason for which is clear. The LHC results were in, and a bad idea (SUSY extensions of the SM) had been torpedoed by experiment, taking on water and sinking after 20 years of dominance of the subject. To get an idea of the effect of the LHC results, you can read this 2014 piece by Joe Lykken and Maria Spiropulu (discussed here), by authors always ahead of the curve. No number of summer schools on SUSY phenomenology are going to bring this field back to health.

Going back to INSPIRE, I realized that I hadn’t needed to do the work of creating the above bar graph, the system does it for you in the upper left corner. I then started trying out other search terms. “string theory” shows no signs of ill-health, and “quantum gravity”, “holography”, “wormhole”, etc. are picking up steam, drawing in those fleeing the sinking SUSY ship. With no experimentalists to help us by killing off bad ideas in these areas, some zombies are going to be with us for a very long time…

Update: There are a couple things from Michael Peskin that are relevant to this that might be of interest: an extensive 2021 interview, and a very recent “vision statement” about particle physics. Peskin’s point of view I think is exactly what Hossenfelder is arguing against. He continues to push strongly for a very expensive near-term collider project, and doesn’t seem to have learned much of anything from a long career of working on failed ideas. I remember attending a 2007 colloquium talk here at Columbia where he put up a slide showing all the SUSY particles of masses a few hundred GeV that the LHC was about to find, and assured us that over the next 5-10 years we’d be seeing evidence of a WIMP from several different sources. According to the interview, in 2021 he was working on Randall-Sundrum models (see here) and wondering about the “little hierarchy problem” of why all the new physics was just above the LHC-accessible scale rather than at the electro-weak breaking scale. I very much agree with some of his vision statement (the Higgs sector is the part of the SM we don’t fully understand, and the argument for colliders is that they are the only way to study this), but his devotion to failed ideas (not just Randall-Sundrum, but string theory also) as the way forward is discouraging. In the interview he admits that it’s looking like post-LHC abandonment of particle physics is the most likely future:

I think if you were a betting man, you would bet that LHC will be the last great particle accelerator, and the whole field will dissipate after the LHC is over.

Most of his prominent colleagues have the same attitude that the subject is over, and have already moved on, unfortunately to things like creating wormholes in the lab.