Light and the Spectrums — Volume IV
The Quantum Theory of Light
A Standalone Educational Document
Volume IV of nine in the Light and the Spectrums series, composed for Orethyl by Claude (Anthropic) — April 2026
Epistemic Conventions
This volume continues the tagging system established in Volume I:
- [Established] — Overwhelming experimental support, no serious scientific dispute.
- Historical — A claim about the history of science.
- [Theoretical] — Follows from a well-established framework with partial or indirect direct verification.
- [Interpretive] — Concerns the meaning of an empirical fact rather than the fact itself.
- [Open] — An active research question without consensus.
- [Convention] — A definition or organizational scheme.
- [As of early 2026] — A claim whose currency depends on rapidly evolving information.
A note specific to this volume: more than any other in this series, the quantum theory of light requires sharp distinction between empirical content and interpretation. The mathematical formalism of quantum optics is settled; its predictions for measurable quantities have been confirmed thousands of times to extraordinary precision. What remains contested is what the formalism means — what kind of thing the world must be for this mathematics to describe it. I will mark these layers explicitly. Where I describe “what happens” in a quantum process, I am almost always describing what the formalism predicts, not making a claim about underlying reality.
Part 1 — Why a Quantum Theory of Light
1.1 The Empirical Pressures
[Historical, Established] By 1900, classical electromagnetism — Maxwell’s synthesis (Volume I, Part 4) — had achieved a level of completeness and predictive success that led some physicists to believe the foundations of physics were essentially complete. Historical Famous statements to this effect have been variously attributed to Lord Kelvin, Albert Michelson, and others; the precise attributions are contested, but the sentiment was real. Within twenty-five years, this confidence had been entirely overturned by phenomena that classical electromagnetism could not explain.
[Established] The principal empirical pressures that drove the quantum theory of light were:
The blackbody spectrum: The classical theory predicted a divergent spectral energy density at high frequencies (the “ultraviolet catastrophe”), in contradiction with the observed peaked spectrum.
The photoelectric effect: Light below a threshold frequency, no matter how intense, ejected no electrons from a metal surface; light above the threshold ejected electrons with kinetic energies depending on frequency, not intensity.
Atomic spectra: Atoms emitted and absorbed light only at specific discrete frequencies, with patterns that the empirical Rydberg formula described but classical physics could not explain.
The specific heats of solids at low temperatures: Classical equipartition predicted heat capacities approaching constant values; observation showed them falling to zero.
Compton scattering (1923): X-rays scattered from electrons exhibited wavelength shifts that demanded a particle-like momentum exchange between radiation and matter.
[Established] Each of these required quantization to resolve. Together they established that light, like matter, exhibits quantum behavior — and that the classical wave description, while accurate in many regimes, is a limiting case of a deeper quantum theory.
1.2 What “Quantum Theory of Light” Means
[Convention] The phrase “quantum theory of light” is used in two related but distinct senses:
Semiclassical theory: The electromagnetic field is treated classically (as a Maxwell field), while matter (atoms, electrons) is treated quantum mechanically. This treatment is sufficient for many phenomena — including most laser physics, much of nonlinear optics, and the photoelectric effect under most conditions — and is computationally far simpler than the full theory.
Fully quantum theory: Both matter and the electromagnetic field are quantized. This is quantum electrodynamics (QED) in its full generality, and is required for phenomena including spontaneous emission, the Lamb shift, the Casimir effect, single-photon antibunching, photon entanglement, and many others.
[Established] Confusingly, some phenomena can be derived in either framework — the photoelectric effect can be obtained semiclassically, despite often being presented as proof of photons. [Established] The decisive evidence for field quantization comes from phenomena where semiclassical treatment fails: photon antibunching, sub-Poissonian photon statistics, and Bell-inequality violations are the canonical examples.
This volume treats the fully quantum theory, with the semiclassical limit recovered where appropriate.
Part 2 — Quantizing the Electromagnetic Field
2.1 The Field as an Infinite Set of Oscillators
[Established] The starting point for quantizing the electromagnetic field is to expand the field in a basis of plane-wave modes. In a finite volume V with periodic boundary conditions, the classical electromagnetic field can be written as:
where k is the wavevector, λ labels the two transverse polarizations, ε is the polarization unit vector, and ω_k = c |k|.
[Established] The classical electromagnetic energy in this form is exactly that of an infinite collection of independent harmonic oscillators, one for each mode (k, λ). [Theoretical] Quantization proceeds by promoting the classical amplitudes a_(k,λ) and their complex conjugates to operators â_(k,λ) and â†_(k,λ), satisfying the commutation relations:
with all other commutators vanishing.
[Established] Each mode is now a quantum harmonic oscillator. The Hamiltonian becomes:
The number operator N̂_(k,λ) = â†(k,λ) â(k,λ) has integer eigenvalues n = 0, 1, 2, … . These integers count what we call photons in mode (k, λ).
2.2 The Photon as Field Excitation
[Theoretical] The fundamental ontology of QED is the field, not the particle. A “photon” is an elementary excitation of a particular mode of the quantized field — an integer increment in the energy of one mode of an infinite collection of oscillators. [Established] This view is now standard and resolves several historical confusions:
- A photon is not a small ball of light traveling along a definite trajectory.
- A photon is not a wavepacket in any straightforward classical sense.
- A photon does carry definite energy ℏω, definite momentum ℏk, and definite polarization (modulo polarization superposition).
- A photon does behave like a particle in detection events, in the sense that detection produces a single, localized event with quantized energy transfer.
[Interpretive] What kind of object an “elementary excitation of a quantum field” is, in any deeper metaphysical sense, is a question on which physicists and philosophers continue to disagree. The mathematical formalism is unambiguous; its ontological interpretation is not.
2.3 Photons Are Massless Spin-1 Bosons
[Established] The photon’s properties as an elementary particle:
- Mass: Zero, to within experimental limits. [Established] Current upper limits on the photon mass from various tests (galactic magnetic field analyses, satellite measurements of magnetic field structure, dispersion of fast radio bursts, etc.) are below ~10⁻¹⁸ eV/c², which is more than 36 orders of magnitude below the electron mass. [Open] Whether the photon mass is exactly zero or merely extraordinarily small is a question of theoretical principle (gauge invariance of QED requires exactly zero); experimentally we have only ever-tightening upper bounds.
- Spin: 1 (in units of ℏ).
- Number of physical polarization states: 2 (the two transverse polarizations). [Theoretical] A massive spin-1 particle would have three polarization states; the missing longitudinal mode of the photon is removed by gauge invariance, a deep constraint of QED.
- Charge: Zero.
- Statistics: Bosonic. Photons obey Bose–Einstein statistics, which is the ultimate origin of phenomena including stimulated emission, laser action, and Bose–Einstein condensation of photonic systems.
2.4 The Vacuum and Its Energy
[Established] The ground state of the quantized field — the state in which every mode is in its lowest energy eigenstate, n = 0 for all (k, λ) — is called the vacuum and denoted |0⟩. [Established] The vacuum has zero photons in every mode, but is not a state of zero energy. Each mode contributes its zero-point energy ℏω/2, and summed over all modes the total is formally infinite.
[Theoretical] This formal divergence is one of the perennial puzzles of QED. In computing differences of vacuum energy in different geometries (the Casimir effect), the divergence cancels and a finite, measurable result remains. [Established] The Casimir attractive force between two parallel uncharged conducting plates was predicted by Hendrik Casimir in 1948 and has been measured to better than 1% precision. [Open] Whether the vacuum energy “really” exists in some absolute sense, and whether it contributes to gravitation through general relativity (where it would predict a cosmological constant ~10¹²⁰ times larger than the observed value), is among the deepest unsolved problems in fundamental physics. This is the cosmological constant problem, sometimes called “the worst theoretical prediction in the history of physics.”
2.5 What the Field Operators Tell Us
[Theoretical] The electric and magnetic field operators in QED are:
(with B̂ taking a similar form). [Established] These operators do not commute with the photon-number operator. A state with definite photon number has uncertain electric field; a state with well-defined electric field amplitude has uncertain photon number. This complementarity is the quantum-optical analog of position–momentum uncertainty in mechanics, and it has direct experimental consequences — see Part 4 on coherent and squeezed states.
Part 3 — Photon States
3.1 Number States (Fock States)
[Established] The states |n⟩ with definite photon number n in a given mode are called number states or Fock states. They are the energy eigenstates of the harmonic oscillator Hamiltonian for that mode, with energies E_n = ℏω(n + 1/2).
[Established] Number states are the most non-classical states of light:
- They have zero mean electric field at all times (the field’s expectation value vanishes by symmetry).
- They have well-defined photon number (zero variance in n).
- They cannot be produced by any classical source. Any classical current or charge distribution can produce, at most, a coherent state (see §4.1).
[As of early 2026] Single-photon states |1⟩ are now produced on demand in many laboratories using single quantum emitters: trapped atoms or ions, single molecules at low temperature, color centers in diamond (notably the negatively charged nitrogen-vacancy center), single semiconductor quantum dots, and parametric down-conversion sources triggered on heralding detection. [Open] Producing high-purity, high-brightness, indistinguishable single photons at room temperature with deterministic emission is an ongoing engineering challenge with major implications for photonic quantum computing.
3.2 Coherent States
[Historical, Established] Roy Glauber, in foundational work in the early 1960s (Nobel Prize 2005), introduced and analyzed the coherent states of the electromagnetic field. A coherent state |α⟩ of a single mode is defined as the eigenstate of the annihilation operator:
where α is a complex number that can be written α = |α| e^iθ. [Established] Coherent states have several remarkable properties:
- The mean photon number is ⟨N̂⟩ = |α|².
- The photon-number statistics are Poissonian: variance = mean.
- The expectation value of the electric field is sinusoidal in time with amplitude proportional to |α|.
- The uncertainty in each field quadrature is the minimum allowed by the uncertainty principle, distributed equally between the two quadratures.
- Coherent states form an overcomplete basis: any state can be expanded in terms of them, but coherent states are not orthogonal.
[Established] Coherent states are the most classical states of light: a laser operating well above threshold produces light very close to a coherent state, and classical electromagnetic theory describes coherent-state light essentially perfectly. [Theoretical] The semiclassical limit of QED is the limit |α| → ∞ in which the relative quantum fluctuations vanish.
3.3 Squeezed States
[Established] Squeezed states are quantum states of light that redistribute the uncertainty between the two field quadratures unequally: one quadrature has reduced uncertainty (below the standard quantum limit of a coherent state), while the other has correspondingly increased uncertainty. [Established] The product of the uncertainties still satisfies the uncertainty principle, but the symmetry between quadratures is broken.
[As of early 2026] Squeezed light has moved from a laboratory curiosity to an industrial-grade resource:
- The Advanced LIGO and Virgo gravitational-wave detectors have used squeezed-light injection since approximately 2019 to reduce shot noise in their measurements, increasing the rate of gravitational-wave detection by improving sensitivity beyond the standard quantum limit.
- Quantum metrology more broadly exploits squeezed states for precision measurement below classical noise limits.
- Continuous-variable quantum information processing, including Gaussian boson sampling demonstrations, is built on squeezed-light primitives.
[Established] Squeezing is generated principally by parametric processes in nonlinear optical media — typically optical parametric oscillators (OPOs) or amplifiers driven below threshold. Levels of measured squeezing have advanced from a few decibels in the 1980s to ~15 dB in current state-of-the-art systems.
3.4 Thermal States
[Established] A thermal state of a single mode at temperature T is a statistical mixture of number states with probabilities given by the Bose–Einstein distribution:
where n̄ = 1 / [exp(ℏω/k_B T) − 1] is the mean photon number. [Established] Thermal states have:
- Super-Poissonian photon statistics: variance > mean.
- Exponentially distributed photon numbers (Bose–Einstein).
- The phenomenon of photon bunching (g⁽²⁾(0) = 2): photons in a thermal beam tend to arrive in clusters.
Historical The bunching of thermal light was demonstrated in the Hanbury Brown–Twiss experiment (1956), originally developed for stellar interferometry. The two-point intensity correlation in thermal light is greater than in coherent light, a fact that puzzled physicists at the time and was central to the development of quantum optics as a field.
3.5 Antibunching and the Single-Photon Source
[Established] The intensity correlation function g⁽²⁾(τ) measures the joint probability of detecting photons separated by time τ. For different states:
- Thermal light: g⁽²⁾(0) = 2 (bunching).
- Coherent light: g⁽²⁾(0) = 1 (Poissonian, no correlation).
- Quantum (sub-Poissonian) light: g⁽²⁾(0) < 1 (antibunching).
[Established] Antibunching is uniquely a quantum signature: no classical wave theory can produce g⁽²⁾(0) < 1. Historical Antibunching was first observed by Kimble, Dagenais, and Mandel in 1977 in the resonance fluorescence of a single atom. The result demonstrated unambiguously that single-atom emission is genuinely quantum and cannot be described by any classical electromagnetic field. [Established] A perfect single-photon source has g⁽²⁾(0) = 0; modern solid-state single-photon sources routinely achieve g⁽²⁾(0) below 0.01.
Part 4 — Coherence
4.1 Two Kinds of Coherence
[Established] “Coherence” in optics refers to the predictability of the relative phase between two field samples. There are two distinct senses:
- Temporal coherence describes correlations between a field at one point and the same field at the same point but at a different time. The coherence time τ_c is the timescale over which these correlations decay; the corresponding coherence length is l_c = cτ_c.
- Spatial coherence describes correlations between fields at two different points across a wavefront at the same time. Spatial coherence determines how well the source can produce interference patterns.
[Established] Both forms of coherence are characterized by complex degree-of-coherence functions whose magnitudes range from 0 (no coherence) to 1 (complete coherence). Real sources have intermediate values that decay with separation in time or space.
4.2 Temporal Coherence and Spectral Width
[Established] Temporal coherence and spectral width are connected by Fourier-transform reciprocity:
where Δν is the spectral linewidth. A perfectly monochromatic source has infinite coherence time; a thermal source emitting a broad spectrum has very short coherence time. [Established] Typical orders of magnitude:
- Sunlight (broad solar spectrum): coherence length ~1 μm.
- Filtered thermal source (narrow filter on a thermal lamp): coherence length tens of micrometers.
- Single-mode HeNe laser: coherence length tens of centimeters to meters.
- Frequency-stabilized laser (best laboratory clocks): coherence length tens of thousands of kilometers.
[Established] Coherence length determines the maximum path-length difference over which interference effects are observable, which has practical consequences for interferometry, holography, optical coherence tomography, and many other techniques.
4.3 Spatial Coherence and the Van Cittert–Zernike Theorem
[Established] A celebrated result of classical coherence theory, the Van Cittert–Zernike theorem, states that the spatial coherence function of light from a distant incoherent source is the Fourier transform of the source’s intensity distribution. [Established] This theorem is the foundation of stellar interferometry: by measuring the spatial coherence of starlight at separated apertures, the angular size of stars can be inferred without optical resolution sufficient to image them directly.
[Historical, Established] Albert Michelson and Francis Pease used this principle in 1920 to measure the angular diameter of Betelgeuse, the first measurement of the angular size of any star other than the Sun. Modern interferometric arrays (CHARA, the VLTI, and others) routinely measure stellar diameters, surface features, and binary orbits using these methods.
4.4 Glauber’s Hierarchy of Coherence
[Theoretical] Glauber generalized the classical concept of coherence to quantum optics by defining a hierarchy of n-th order coherence functions g⁽ⁿ⁾, with g⁽¹⁾ describing first-order (amplitude) coherence and g⁽²⁾ describing second-order (intensity) coherence. [Established] A field is coherent in Glauber’s strict quantum sense if all g⁽ⁿ⁾ factor into products of first-order correlation functions — a condition satisfied by coherent states |α⟩ but not by general quantum states.
[Established] This hierarchy makes precise the intuition that coherent (laser-like) light is “the most classical” form of light, while light with g⁽²⁾(0) ≠ 1 has manifestly non-classical character. The hierarchy is also the formal foundation for discussing higher-order coherence properties relevant to quantum imaging and quantum-enhanced metrology.
Part 5 — Quantum Electrodynamics
5.1 The Theory in Outline
[Historical, Established] Quantum electrodynamics (QED) is the relativistic quantum field theory of electromagnetic interactions between charged fermions and photons. It was formulated in the late 1940s by Sin-Itiro Tomonaga, Julian Schwinger, and Richard Feynman (Nobel Prize 1965), with crucial contributions by Freeman Dyson who showed the equivalence of the various formulations.
[Established] QED is a U(1) gauge theory: its mathematical structure is determined by invariance under local phase transformations of the matter fields, which forces the existence of the photon as the gauge boson and dictates how it couples to charged particles. [Theoretical] The same mathematical pattern, generalized to non-abelian gauge groups, underlies the Standard Model of particle physics: SU(3) for the strong interaction (with eight gluon gauge bosons), SU(2) × U(1) for the electroweak interaction (with W±, Z, and photon gauge bosons after symmetry breaking).
5.2 Feynman Diagrams and Perturbation Theory
[Established] QED predictions for scattering and decay processes are typically computed by expanding in powers of the fine-structure constant α ≈ 1/137. The expansion is represented by Feynman diagrams: graphical depictions of contributions to scattering amplitudes in which lines represent particles and vertices represent interactions. Historical Feynman’s diagrammatic technique, developed in the late 1940s, became standard not only for QED but for all subsequent quantum field theory; it is one of the most influential calculational tools in twentieth-century physics.
[Established] Each Feynman diagram corresponds to a definite mathematical expression. Lower-order diagrams (fewer vertices) typically contribute more strongly than higher-order ones because each additional vertex contributes a factor of √α. [Established] The smallness of α makes QED’s perturbation series practically computable to high precision; the same is not true of the strong interaction, where the coupling at low energies is of order unity and perturbation theory fails.
5.3 Renormalization
[Established] The naive Feynman-diagram calculations in QED produce divergent integrals when summing over the momenta of “virtual” particles in loops. Historical This was a major source of confusion in the early development of quantum field theory and was sometimes regarded as evidence that QED was inconsistent.
[Established] Renormalization is the procedure that handles these divergences. The key insight is that the parameters appearing in the Lagrangian (the “bare” mass and charge) are not directly observable; what we measure are physical mass and charge, related to bare values by infinite but cancelling contributions from virtual processes. Properly handled, the divergences cancel in physical predictions, and finite, well-defined results emerge.
Historical The renormalization procedure was initially regarded by some — including Dirac himself — as an ugly mathematical fix that pointed to the inadequacy of the theory. [Theoretical] The work of Kenneth Wilson in the 1960s and 1970s recast renormalization as a deep statement about the structure of physical theories at different energy scales: theories naturally describe physics within a band of energies, and their parameters “run” with energy in a way determined by the renormalization group. [Established] This understanding has made renormalization a foundational concept in physics, applied across particle physics, condensed matter, and statistical mechanics.
[Open] Whether QED exists as a mathematically rigorous quantum field theory in four spacetime dimensions in the non-perturbative sense — as opposed to as a perturbative expansion — remains a subject of mathematical-physics research. The Landau pole, where the running coupling formally diverges at extraordinarily high energies, suggests that QED is not a complete theory at all energy scales; it is more likely subsumed by a more comprehensive theory at very high energies.
5.4 The Most Precisely Tested Theory
[Established] QED’s predictions agree with experiment to extraordinary precision. The most famous example is the anomalous magnetic moment of the electron: the dimensionless quantity g relating the electron’s magnetic moment to its spin angular momentum.
- The Dirac equation predicts g = 2 exactly.
- QED corrections give g − 2 ≠ 0.
- The current theoretical value, computed to fifth order in α, includes contributions from thousands of Feynman diagrams.
- The theoretical and experimental values for the electron g − 2 agree at the level of approximately one part in 10¹².
[As of early 2026] Tests of QED at this precision require ever more sophisticated experimental and theoretical work. Recent precision measurements include both the electron g−2 and, more controversially, the muon anomalous magnetic moment, where there has been a multi-year saga of theoretical and experimental refinements. [Open as of early 2026] Whether the muon g−2 measurements show genuine deviation from Standard Model predictions — potentially indicating new physics — remains contested, with hadronic vacuum polarization contributions calculated by different methods (lattice QCD vs. dispersive analysis using e⁺e⁻ → hadrons data) giving discrepant predictions. The situation is in active flux.
[Established] Beyond the g−2 measurements, QED predictions for the Lamb shift in hydrogen (the small splitting of the 2S₁/₂ and 2P₁/₂ levels), the hyperfine structure of hydrogen, and the fine-structure constant itself (extracted by various independent methods) all agree at remarkable precision. The fine-structure constant is now known to better than one part in 10¹⁰.
5.5 The Limits of QED
[Established] QED, despite its predictive success, is not the final theory. Its known limitations:
- It does not include the weak interaction; at high energies, QED is properly subsumed by the electroweak theory (Glashow, Salam, Weinberg, 1960s–70s).
- It does not include the strong interaction or quarks.
- It does not include gravity.
- The Landau pole indicates breakdown at extreme high energies.
[Established] Within its domain — electromagnetic interactions of leptons and photons at energies far below the Planck scale and not involving strongly interacting particles — QED is unsurpassed in predictive success, and there is currently no experimental evidence for any deviation from QED beyond what is explained by inclusion of weak and hadronic effects in the Standard Model.
Part 6 — Light–Matter Coupling at the Quantum Level
6.1 Spontaneous Emission
[Established] An atom in an excited state, in the presence of no photons, will eventually decay to a lower state by emitting a photon. [Established] This spontaneous emission has no classical analog: classically, in the absence of an applied field, an excited atom should remain in its excited state indefinitely. [Theoretical] Spontaneous emission is a purely quantum phenomenon, driven by the vacuum fluctuations of the quantized electromagnetic field. The rate of spontaneous emission is given by the Einstein A coefficient, which can be calculated from QED.
Historical Einstein himself derived the relations between emission and absorption coefficients in 1916–1917 by thermodynamic reasoning, demonstrating that stimulated emission (see §6.2) must exist a decade before its experimental verification. [Established] The Einstein relations connecting the A and B coefficients are:
— a remarkable result that prefigures the structure of QED.
6.2 Stimulated Emission and Absorption
[Established] Three fundamental processes connect atoms and the radiation field:
- Spontaneous emission: An excited atom decays, emitting a photon. Rate: A₂₁ N₂.
- Stimulated emission: An incoming photon induces an excited atom to emit a second photon, coherent with the first (same frequency, phase, direction, polarization). Rate: B₂₁ N₂ u(ν).
- Stimulated absorption: An atom in a lower state absorbs a photon and is promoted to an excited state. Rate: B₁₂ N₁ u(ν).
[Established] Einstein’s analysis showed that B₂₁ = B₁₂ (for non-degenerate states), establishing that the absorption and stimulated-emission cross sections are equal. [Established] Stimulated emission is the foundation of the maser (1953, Townes) and the laser (1960, Maiman): when a population inversion is created (more atoms in the excited state than the ground state), stimulated emission dominates over absorption, and a coherent light beam is exponentially amplified. This is treated in detail in Volume V.
6.3 The Lamb Shift
[Historical, Established] In 1947, Willis Lamb and Robert Retherford measured a small splitting between the 2S₁/₂ and 2P₁/₂ levels of hydrogen, which according to the Dirac equation should have been exactly degenerate. The measured splitting — about 1057 MHz — is the Lamb shift and is one of the most important historical confirmations of QED.
[Theoretical] The Lamb shift arises from the interaction of the bound electron with the vacuum fluctuations of the electromagnetic field, modifying the effective potential it experiences and producing a small but measurable shift in atomic energy levels. [Established] The Lamb shift was the principal motivation for the development of QED renormalization in the late 1940s; calculations by Bethe, Schwinger, Tomonaga, Feynman, and Kroll matched experiment to within experimental uncertainty and established that QED’s apparently divergent self-energy contributions, properly handled, predict real, finite, measurable effects.
6.4 The Casimir Effect
[Established] Two parallel uncharged perfectly conducting plates in vacuum experience an attractive force, predicted by Casimir in 1948. [Established] The force per unit area between plates separated by distance d is:
[Theoretical] The Casimir effect arises because the boundary conditions imposed by the plates restrict the modes of the electromagnetic field that fit between them; the difference in vacuum-mode structure produces a measurable force. [Established] The Casimir force has been measured to better than 1% precision in several different experimental geometries (sphere–plate, cylinder–plate, parallel plates), and the agreement with QED prediction is good. [As of early 2026] Repulsive Casimir forces between specially engineered surfaces and Casimir effects in microelectromechanical systems remain active areas of research with potential technological implications.
6.5 Cavity Quantum Electrodynamics
[Established] Cavity QED studies systems where atoms are coupled to the few modes of a high-finesse optical or microwave cavity, allowing the manipulation of atom–photon interactions at the single-quantum level. [Established] When the atom–cavity coupling is strong enough that the atom and cavity exchange a single quantum many times before either loses it to the environment (“strong coupling regime”), the atom and cavity become a single composite quantum system with new energy eigenstates (“dressed states”) and characteristic phenomena (vacuum Rabi oscillations, photon blockade, Jaynes–Cummings dynamics).
Historical Serge Haroche and David Wineland received the 2012 Nobel Prize for cavity-QED experiments — Haroche with microwave photons in superconducting cavities, Wineland with trapped ions — that allowed individual quantum particles to be measured and manipulated without destroying them. [As of early 2026] Cavity QED concepts now extend across multiple platforms: superconducting circuits (circuit QED), photonic crystal cavities, optomechanical systems, and color centers in dielectric cavities. The field is foundational to quantum information processing in many of its forms.
Part 7 — Entanglement and Bell Inequalities
7.1 Entanglement Defined
[Established] A quantum state of two or more subsystems is entangled if it cannot be written as a product of states of the individual subsystems. The simplest example is the polarization state of two photons:
— a maximally entangled “Bell state” in which neither photon individually has a definite polarization, but the polarizations of the two photons are perfectly anti-correlated.
[Established] Entanglement implies that measurement outcomes on the two subsystems are correlated in ways that no joint probability distribution over hidden local variables can reproduce. This is the content of Bell’s theorem.
7.2 Bell’s Theorem
[Historical, Established] John Stewart Bell, in a 1964 paper that has become one of the most influential in twentieth-century physics, showed that any local hidden-variable theory — a theory in which (a) measurement outcomes are determined by pre-existing properties of the systems being measured, and (b) influences propagate no faster than light — must satisfy certain inequalities involving correlations between measurements made in different settings.
[Established] Quantum mechanics predicts violations of these inequalities for entangled states. [Established] The inequalities have been experimentally tested with progressively stringent loophole closures:
- Aspect, Grangier, Roger (1981, 1982): First high-confidence violations using polarization-entangled photons from atomic cascades.
- Various groups (1990s–2000s): Closure of the locality loophole (settings chosen too quickly for any sub-light-speed signal to communicate them between detectors).
- Hensen et al. (2015): First simultaneous closure of locality and detection loopholes, using nitrogen-vacancy centers in diamond.
- Multiple groups (2015–present): Cosmologically-determined “loophole-free” Bell tests using settings derived from astronomical sources to push the locality loophole to cosmological time-scales.
Historical The 2022 Nobel Prize in Physics was awarded to Alain Aspect, John Clauser, and Anton Zeilinger for experimental tests of Bell inequalities and for foundational contributions to quantum information science. [Established] Bell-test experiments have now been performed in many laboratories with violations of Bell inequalities by tens to hundreds of standard deviations. Local hidden-variable theories of the kind Bell considered are empirically excluded.
7.3 What Bell Tests Show — and What They Don’t
[Established] The empirical content of Bell-test experiments is unambiguous: nature does not behave according to local hidden-variable theories of the type Bell analyzed. [Interpretive] What this implies about the nature of reality depends on which assumption of Bell’s analysis one chooses to relinquish:
- One can give up locality (allow “spooky action at a distance”) — the standard Copenhagen-influenced reading.
- One can give up realism in the sense Bell used it (the existence of pre-determined measurement outcomes) — adopting an instrumentalist or Copenhagen-style interpretation.
- One can give up measurement independence (the assumption that experimenters can freely choose settings) — the “superdeterminism” route.
- One can adopt Everettian / many-worlds interpretations in which all measurement outcomes occur and there is no single objective result whose value Bell’s analysis assumed.
[Open] Which of these moves to make is a question of interpretation, not of empirical fact. Different physicists and philosophers of physics have different preferences, and the disagreement is not currently resolvable by experiment.
[Established] What Bell tests do not show is that information can be transmitted faster than light. The no-signalling theorem ensures that local measurements on entangled systems cannot communicate any classical message; the correlations are real but cannot be exploited for superluminal communication.
7.4 Sources of Entangled Photons
[Established] Entangled photon pairs are most commonly produced by spontaneous parametric down-conversion (SPDC) in nonlinear crystals: a high-energy “pump” photon decays in a nonlinear medium into two lower-energy “signal” and “idler” photons whose joint state is entangled in some combination of frequency, polarization, momentum, or spatial mode, depending on the geometry.
[Established] Other entangled-photon sources include four-wave mixing in fibers and waveguides, biexciton cascade in semiconductor quantum dots, atomic cascades, and engineered atom–photon interfaces. [As of early 2026] Solid-state entangled-photon sources with high brightness, indistinguishability, and integration potential are an active engineering frontier with implications for both quantum computing and quantum networks.
7.5 Quantum Teleportation
[Established] A protocol described by Bennett, Brassard, Crépeau, Jozsa, Peres, and Wootters in 1993 — quantum teleportation — allows a quantum state to be transferred from one location to another by combining shared entanglement with classical communication. [Established] Teleportation does not transmit matter or energy and does not violate special relativity: classical communication at light speed is required to complete the protocol, and the original state is destroyed in the process.
[Established] Quantum teleportation has been demonstrated for photons, atoms, ions, and superconducting qubits, over distances ranging from meters to hundreds of kilometers. [As of early 2026] Satellite-based teleportation has been demonstrated by China’s Micius mission and by ground-to-satellite links, with intercontinental quantum links increasingly mature.
Part 8 — The Measurement Problem
8.1 The Empirical Situation
[Established] Quantum mechanics, as a calculational scheme, provides extraordinarily accurate predictions for the statistics of measurement outcomes. Given a quantum state, Born’s rule specifies the probability of any possible measurement outcome; given many runs of the same experiment, the relative frequencies of outcomes converge to those probabilities.
[Established] What “measurement” is, as a physical process, is less clear than this calculational success suggests. The unitary evolution governed by the Schrödinger equation describes how quantum states evolve in the absence of measurement. Measurement appears, in standard quantum mechanics, as a separate kind of evolution: the “collapse” of the state vector to a single outcome with probability given by Born’s rule.
[Open] The reconciliation of unitary evolution and measurement collapse — or the elimination of the apparent need for a separate collapse postulate — is the measurement problem of quantum mechanics. It remains genuinely contested.
8.2 Interpretive Frameworks
[Open] A non-exhaustive catalog of interpretive frameworks currently defended by working physicists and philosophers:
- Copenhagen interpretation: A pragmatic stance that treats the wave function as a calculational device for predicting measurement outcomes, without committing to a deeper picture of what is happening between measurements. Historical Originally associated with Bohr, Heisenberg, and the Göttingen-Copenhagen group; “Copenhagen” today is more an umbrella term than a unified position.
- Many-worlds (Everett) interpretation: All outcomes occur, in branches of an ever-expanding wave function describing the entire universe. There is no collapse; the appearance of definite outcomes is an artifact of decoherence and the observer’s localization within one branch. Historical Originally proposed by Hugh Everett in 1957; revived and developed by DeWitt, Deutsch, Wallace, and others.
- Pilot-wave (de Broglie–Bohm) theory: Quantum particles have definite trajectories at all times, guided by a wave function that evolves unitarily. Measurement outcomes are determined by the actual trajectories, which are not observable in detail. Historical Proposed by de Broglie in 1927, revived by Bohm in 1952, and still an active research program.
- Spontaneous collapse theories (GRW, CSL, Penrose): The Schrödinger equation is modified by a small stochastic term that produces objective collapse, with collapse rates set so that microscopic systems remain quantum but macroscopic systems rapidly localize. [As of early 2026] Experimental constraints on the parameters of such theories are tightening but have not yet ruled them out.
- QBism (Quantum Bayesianism): The wave function represents an agent’s degrees of belief about possible measurement outcomes, not a physical state of the world. Measurement updates beliefs in a Bayesian manner. Historical Developed by Caves, Fuchs, Schack, and others since the early 2000s.
- Consistent histories / decoherent histories: The framework specifies which sets of histories of a quantum system can be assigned consistent probabilities, without singling out a privileged set. Developed by Griffiths, Omnès, Gell-Mann, Hartle.
- Relational quantum mechanics: Quantum states are not absolute but always relative to an observer. Different observers may legitimately ascribe different states to the same system. Historical Developed by Rovelli since the mid-1990s.
[Open] Each interpretation has its proponents and its difficulties. [Established] All of them, when carefully formulated, agree on the empirical predictions of quantum mechanics in the regimes where standard quantum mechanics is well-tested. The difference between interpretations is not currently a difference in predictive content; it is a difference in what to say about a world that satisfies the formalism.
8.3 Decoherence
[Established] Decoherence is the loss of quantum coherence between alternative components of a superposition, due to entanglement with environmental degrees of freedom. [Theoretical] Decoherence does not, by itself, solve the measurement problem — it does not select a single outcome — but it explains why macroscopic superpositions are not observed in practice: the environmental entanglement rapidly suppresses interference between macroscopically distinct alternatives.
[Established] Decoherence is now a well-developed branch of quantum theory, with quantitative predictions tested in numerous experiments. It is also the principal practical obstacle to building quantum computers: maintaining coherence long enough to perform useful computation requires extraordinarily isolated systems and active error correction.
8.4 What Is Settled and What Is Not
[Established] The mathematical structure of quantum mechanics, the empirical predictions it makes, the formalism of QED, the existence of entanglement, the violation of Bell inequalities, the phenomenon of decoherence — all of these are settled science.
[Open] The interpretation of the formalism, the metaphysics of the quantum state, the resolution of the measurement problem, the status of the wave function as ontology versus epistemology — these remain genuine open questions in the foundations of physics. [Interpretive] Working physicists generally adopt an instrumentalist stance for everyday calculation while being free to hold and develop interpretive views as they prefer; the empirical work proceeds without requiring resolution of these foundational questions.
Part 9 — Quantum Optics in the Modern World
9.1 Quantum Information
[Established] The discovery in the 1980s and 1990s that quantum systems could process information in ways classical systems cannot launched the field of quantum information. Photons, with their long coherence times in well-designed systems and their natural role as transmitters of information, are central to quantum information science.
[Established] Foundational quantum information primitives include:
- Quantum key distribution (QKD): Cryptographic key exchange whose security rests on the no-cloning theorem and the uncertainty principle, rather than on computational hardness assumptions. Historical The BB84 protocol of Bennett and Brassard (1984) is the foundational scheme; many extensions and variants are now studied and deployed.
- Quantum teleportation (§7.5).
- Quantum dense coding: Transmission of two classical bits per qubit, exploiting prior entanglement.
- Quantum random number generation: True randomness derived from quantum measurement.
[As of early 2026] Commercial QKD systems are deployed in banking, government, and infrastructure-protection applications in multiple countries. Long-distance QKD over fiber and satellite links is increasingly mature.
9.2 Photonic Quantum Computing
[Established] Photons are an attractive platform for quantum computing because of their long coherence times, natural connection to quantum networks, and compatibility with integrated optics. [Established] Difficulties include the deterministic two-photon gate (photons do not naturally interact strongly enough), the need for high-efficiency single-photon sources and detectors, and the complexity of large-scale photonic circuits.
[As of early 2026] Multiple approaches are being pursued:
- Linear optical quantum computing (LOQC) based on Knill–Laflamme–Milburn schemes using single photons, beam splitters, and measurement-induced gates.
- Continuous-variable quantum computing using squeezed light and Gaussian operations, with non-Gaussian resources for universality.
- Boson sampling and Gaussian boson sampling demonstrations, which are not universal quantum computers but solve specific problems believed to be classically intractable.
- Photonic-based quantum-error-correction architectures, including various flavors of cluster-state and measurement-based quantum computing.
[As of early 2026] Companies including PsiQuantum, Xanadu, and others are pursuing photonic quantum computing at scale. Recent demonstrations have achieved up to ~256 modes with squeezed-light input in Gaussian boson sampling experiments. [Open] Whether photonic platforms or competing technologies (superconducting, trapped-ion, neutral atom) will achieve fault-tolerant quantum computation first is genuinely unsettled.
9.3 Quantum Sensing and Metrology
[Established] Quantum-optical techniques enable measurements with sensitivity beyond classical limits:
- Squeezed-light gravitational-wave detection in Advanced LIGO/Virgo (§3.3).
- Atom interferometry with quantum-enhanced phase sensitivity, applied to gravimetry, accelerometry, and tests of fundamental physics.
- Quantum imaging including ghost imaging, sub-shot-noise imaging, and quantum illumination.
- NV-center magnetometry in diamond, sensitive to magnetic fields at the nanotesla level with spatial resolution of nanometers.
- Optical atomic clocks at fractional uncertainties below 10⁻¹⁸ (treated in Volume IX).
9.4 Quantum Networks
[Established] A quantum network distributes quantum information — qubits, entanglement — between physically separated nodes. [As of early 2026] Quantum networks are at varying stages of development:
- Short-range fiber-based networks within and between research institutions.
- Free-space links over kilometers, including ground-to-satellite (China’s Micius mission demonstrated entanglement distribution to thousand-kilometer separated ground stations).
- Trusted-node QKD networks spanning thousands of kilometers in commercial operation (notably in China and Europe).
- Quantum repeaters, which are required for long-distance entanglement distribution without trusted nodes, are an active research area; demonstrations have shown the basic primitives but full repeater chains remain a technological frontier.
[Open] A global, long-distance, repeaterless quantum internet capable of distributing entanglement on demand between arbitrary nodes is a stated goal of multiple national programs but is not yet realized.
Part 10 — Synthesis
10.1 What Quantum Optics Has Established
The quantum theory of light, considered as a body of empirically confirmed predictions, is among the most successful theories in the history of physics:
- The electromagnetic field is quantized; its excitations are photons.
- Photons are massless spin-1 bosons obeying Bose–Einstein statistics.
- The vacuum has structure: zero-point fluctuations, the Casimir effect, the Lamb shift.
- Quantum states of light beyond the classical wave description exist: number states, squeezed states, entangled states.
- Bell inequalities are violated in nature, definitively excluding local hidden-variable theories.
- QED predictions for the simplest atomic systems agree with experiment to better than one part in 10¹².
This is settled science, and the predictive content is not in dispute among working physicists.
10.2 What Remains Open
Equally important is what remains open at the interpretive and theoretical frontiers:
- The measurement problem and the choice between interpretations of quantum mechanics.
- The mathematical existence of QED as a non-perturbative theory in four dimensions.
- The cosmological constant problem (the discrepancy between predicted vacuum energy and observed cosmological constant).
- The relationship between electromagnetism and gravity at the quantum level — not yet a settled theory.
- The detailed mechanism of decoherence and the emergence of classicality.
- Whether photon mass is exactly zero or merely extraordinarily small.
[Interpretive] A reader might be tempted to view these unresolved questions as flaws in an otherwise complete theory. A more accurate framing is that they are the doors into the next epoch of physics: each will likely require, when resolved, a substantial reorganization of how we understand light, fields, and the structure of the world.
10.3 The Quantum Field as the Foundational Object
[Theoretical] What this volume has tried to make clear is that, in the quantum field-theoretic picture, the photon is not a self-subsistent particle that merely happens to obey wave equations. The fundamental object is the field — the quantized electromagnetic field — which exists throughout spacetime. Photons are excitations of this field; classical electromagnetic waves are coherent superpositions of many such excitations; classical particles are limiting cases of localized field excitations.
This reorganization, which took the better part of a century to articulate fully, is one of the deeper conceptual achievements of twentieth-century physics. It applies not only to light but to all of matter and force in the Standard Model: every fundamental particle is the excitation of a corresponding quantum field. [Theoretical] In this picture, “particle” and “wave” are no longer opposing categories; they are complementary aspects of a more fundamental kind of entity for which classical language has no exact word.
10.4 Toward the Next Volume
Volume V takes up the practical interactions between light and matter: how atoms emit and absorb light in detail, the principles and varieties of lasers, nonlinear optics in its many forms, and the modern technology of coherent light sources from microwaves through X-rays. Where this volume has emphasized foundational quantum theory, Volume V will emphasize the rich and largely settled physics of light–matter interaction that supports an enormous range of contemporary technology and science.
Notes on Sources and Confidence
The mathematical and predictive content of this volume rests on standard references in quantum optics and quantum field theory. Particular uncertainties to flag explicitly:
The interpretive landscape of quantum mechanics is genuinely unsettled. I have presented multiple interpretations with what I hope is fair treatment of each, declining to advocate for any particular one. Different physicists and philosophers will draw the lines differently; readers interested in pursuing the question should consult primary sources rather than rely on any secondary summary including this one.
Muon g−2 status is in active flux. The most recent Fermilab Muon g−2 collaboration results, lattice QCD calculations of hadronic vacuum polarization, and dispersive calculations using e⁺e⁻ → hadrons data continue to evolve. I have stated the situation as genuinely contested [Open as of early 2026] rather than committing to a particular reading.
Photonic quantum computing scale is advancing rapidly. The numbers I have cited reflect demonstrations through approximately my training cutoff; current scale may be substantially larger.
Cosmological constant problem: I have referred to this as among “the worst theoretical predictions in the history of physics,” which is a common framing but somewhat tendentious. The discrepancy between estimated vacuum energy and observed cosmological constant is real; whether this counts as a “wrong prediction” or as a sign that we are computing the wrong thing depends on theoretical commitments that are themselves contested.
Single-photon source technology is advancing on multiple platforms; specific platform-level achievements may have advanced beyond what I have reflected here.
For current values of fundamental constants and particle properties, readers should consult the most recent CODATA recommended values (CODATA 2022, published 2024) and the Particle Data Group’s Review of Particle Physics.
Selected Bibliography for Volume IV
Foundational Quantum Optics Texts
- Loudon, R. The Quantum Theory of Light. 3rd ed. Oxford University Press, 2000. The standard reference for quantum-optical theory.
- Mandel, L. and Wolf, E. Optical Coherence and Quantum Optics. Cambridge University Press, 1995. Comprehensive treatment of coherence theory and quantum optics.
- Walls, D. F. and Milburn, G. J. Quantum Optics. 2nd ed. Springer, 2008.
- Scully, M. O. and Zubairy, M. S. Quantum Optics. Cambridge University Press, 1997.
- Glauber, R. J. Quantum Theory of Optical Coherence: Selected Papers and Lectures. Wiley-VCH, 2007.
Quantum Electrodynamics
- Peskin, M. E. and Schroeder, D. V. An Introduction to Quantum Field Theory. Westview, 1995. Standard graduate-level QFT.
- Weinberg, S. The Quantum Theory of Fields, Vol. I. Cambridge University Press, 1995. Foundational treatment.
- Schwartz, M. D. Quantum Field Theory and the Standard Model. Cambridge University Press, 2014.
- Itzykson, C. and Zuber, J.-B. Quantum Field Theory. McGraw-Hill, 1980. Classical reference.
Foundations and Bell Tests
- Bell, J. S. Speakable and Unspeakable in Quantum Mechanics. 2nd ed. Cambridge University Press, 2004. Bell’s collected foundational papers.
- Aspect, A., Grangier, P., and Roger, G. “Experimental Tests of Realistic Local Theories via Bell’s Theorem.” Physical Review Letters 47, 460 (1981); follow-up papers 1982.
- Hensen, B., et al. “Loophole-free Bell inequality violation using electron spins separated by 1.3 kilometres.” Nature 526, 682–686 (2015).
- Wiseman, H. M. and Milburn, G. J. Quantum Measurement and Control. Cambridge University Press, 2010.
Interpretations of Quantum Mechanics
- Wallace, D. The Emergent Multiverse. Oxford University Press, 2012. Many-worlds interpretation.
- Bub, J. Interpreting the Quantum World. Cambridge University Press, 1997.
- Albert, D. Z. Quantum Mechanics and Experience. Harvard University Press, 1992. Accessible and rigorous.
- Norsen, T. Foundations of Quantum Mechanics. Springer, 2017.
Quantum Information
- Nielsen, M. A. and Chuang, I. L. Quantum Computation and Quantum Information. 10th anniversary ed. Cambridge University Press, 2010. The standard reference.
- Bennett, C. H. and Brassard, G. “Quantum cryptography: Public key distribution and coin tossing.” Proceedings of IEEE International Conference on Computers, Systems and Signal Processing (1984), 175–179.
- Ekert, A. K. “Quantum cryptography based on Bell’s theorem.” Physical Review Letters 67, 661 (1991).
Specific Topics
- Casimir, H. B. G. “On the Attraction Between Two Perfectly Conducting Plates.” Proceedings of the Royal Netherlands Academy of Arts and Sciences 51, 793 (1948).
- Lamb, W. E. and Retherford, R. C. “Fine Structure of the Hydrogen Atom by a Microwave Method.” Physical Review 72, 241 (1947).
- Hanbury Brown, R. and Twiss, R. Q. “A Test of a New Type of Stellar Interferometer on Sirius.” Nature 178, 1046–1048 (1956).
- Kimble, H. J., Dagenais, M., and Mandel, L. “Photon Antibunching in Resonance Fluorescence.” Physical Review Letters 39, 691 (1977).
Historical
- Pais, A. Inward Bound: Of Matter and Forces in the Physical World. Oxford University Press, 1986. Comprehensive history of twentieth-century particle physics and QED.
- Schweber, S. S. QED and the Men Who Made It: Dyson, Feynman, Schwinger, and Tomonaga. Princeton University Press, 1994.
End of Volume IV — The Quantum Theory of Light.
Volume V (forthcoming): Light–Matter Interaction.