DOn't worry, if you present a good paper, they may even come to speak with you themselves ;-) Moreover, there are official diners and other activities, so try not to get seated next to a revisionist and everything with be ok.
Well, as for the EHESS, if you decide to follow a very particular Ph.D course, you might be even obliged to pick one or two courses given by such guys (as there won't be enough choice). But then, the advantages are great, too. The most important issue is the choice of the tutor. The courses are over soon, the dissertation is not...