Ignore him, look at the boat for what you want, maintenance issues, cored hull/deck issues, rigging issues, etc. In short...I suggest you hire a surveyor to analyze the condition of the boat. A GOOD surveyor.
If you want to worry about something, worry about finding a GOOD surveyor worth their salt.