and most folks end up doing a lot more miles to get there... from San Diego for instance, it is some 65 miles or more, depending on where you take off, and many folks here tend to do it as a long overnight trek, not the "daytrip" you are describing.
Even from Oceanside it is some 50 miles out and twice as long as the song implies.
Even to get to that 26 mile point likely involves day sails of 50 miles or so. Sure, nothing like crossing oceans, but not exactly something to do "in a leaky old boat..." (although I bet some did and still do... from places like Long Beach)
And getting down to the tip of Baja also requires some overnight hops... for whatever it's worth.