I’ve recently run across various interesting mathematically oriented sites, each with some connection to physics:
Alain Connes now has a web-site. He’s now a professor at Vanderbilt University as well as at the College de France. I can see him in Robert Altman’s movie “Nashville”. His site contains quite a few interesting things, including most of his research articles and some interesting survey articles about his work on non-commutative geometry. For instance, take a look at his “A View of Mathematics”, which starts off with a wonderful description of doing mathematical research and some interesting history of geometry, before surveying his recent work relating non-commutative geometry and physics.
David Ben-Zvi at Austin is organizing a new lecture series to be made available over the web called GRASP (for Geometry, Representations and Some Physics), which sounds promising although it is just getting started.
The MIT math department sponsors something called the Talbot workshops. Last year the topic was elliptic cohomology, this year geometric Langlands. Notes from the lectures are available courtesy of Megumi Harada who also maintains a useful website of geometry conferences, many of which have some sort of physics component.