A great circle distance calculator earns its keep the moment a route plan gets real. Picture a delivery skipper prepping a sailboat run from the Port of Los Angeles (33.74°N, 118.27°W) to Honolulu (21.31°N, 157.86°W). The chart plotter is packed away, the owner wants a fuel and provisioning budget today, and “about 2,500 miles” isn't good enough. Enter both coordinates above and you get the working numbers in one shot: 2,220 nautical miles (2,555 statute miles, 4,112 km), departure course 261°, arrival course 242°, and a midpoint near 28.97°N, 139.23°W for a position check. This guide walks through that exact calculation by hand, shows what the curved route saves over a constant heading, and covers the three coordinate mistakes that quietly wreck voyage math.
The Straightest Route on Earth Looks Bent on Your Map
Stretch a string between two points on a globe and it traces a great circle — the shortest path over the Earth's surface. Flatten that same path onto a standard Mercator chart and it bows toward the nearest pole, which is why flight trackers show those “curved” arcs over the ocean. The curve is an artifact of the map, not the route. There's a practical catch, though: a great circle track doesn't hold one compass course. On the Los Angeles–Honolulu run, you leave on 260.8° and arrive steering 241.8° — the required heading drifts 19° over the crossing. That's exactly why our calculator reports both an initial bearing and a final bearing instead of pretending one number covers the whole track.
From 2 Coordinates to 2,220 Nautical Miles
The math under the hood is the haversine formula, and it's worth seeing once with real numbers. With latitudes φ and longitudes λ converted to radians:
a = sin²(Δφ/2) + cos φ₁ · cos φ₂ · sin²(Δλ/2)c = 2 · atan2(√a, √(1−a))d = R · c
For Los Angeles to Honolulu, Δφ is −0.2170 radians and Δλ is −0.6909 radians. Run the substitution and a = 0.1006, c = 0.6454 radians, and with Earth's mean radius R = 6,371 km the distance lands at 4,112 km. Divide by exactly 1.852 to get 2,220 nautical miles, or by 1.609 for 2,555 statute miles. The initial bearing comes from a second identity, θ = atan2(sin Δλ · cos φ₂, cos φ₁ · sin φ₂ − sin φ₁ · cos φ₂ · cos Δλ), normalized to 0–360°. One caveat honesty requires: the haversine model treats Earth as a perfect sphere, so results can differ from ellipsoidal GPS figures by up to about 0.5% — roughly 11 NM on this crossing, and irrelevant for fuel planning.
Why 1,852 Meters Exactly? A Short History of the Nautical Mile
The nautical mile isn't an arbitrary unit — it's carved out of the planet's geometry. One nautical mile is one minute of latitude, so one degree equals 60 NM and a navigator can measure any distance with dividers against the latitude scale printed on the chart's edge. No conversion table, no calculator, which is precisely why NOAA and every marine and aviation authority still work in NM today. Because meridian arcs vary slightly with latitude, countries once disagreed on the exact length — the British used 6,080 feet, the US 6,080.20 feet — until the 1929 International Extraordinary Hydrographic Conference in Monaco fixed it at 1,852 meters exactly. The United States didn't adopt the international value until 1954. The knot follows directly: one nautical mile per hour, so a 2,220 NM crossing at 20 knots takes 111 hours — about 4 days and 15 hours underway.
Great Circle vs Rhumb Line: What the Curve Is Worth
The alternative to a great circle is a rhumb line — one constant compass heading the whole way, plotted as a straight line on a Mercator chart. It's simpler to steer and it's always longer. How much longer depends on the route, and the pattern is worth knowing before you decide whether the curved track is worth the waypoint work:
| Route | Great circle | Rhumb line | Savings |
|---|---|---|---|
| Miami → San Juan | 896 NM | 896 NM | ~0 NM |
| Los Angeles → Honolulu | 2,220 NM | 2,230 NM | 10 NM (0.4%) |
| New York → Southampton | 2,975 NM | 3,089 NM | 114 NM (3.7%) |
| San Francisco → Yokohama | 4,476 NM | 4,722 NM | 246 NM (5.2%) |
| Los Angeles → Shanghai | 5,646 NM | 6,091 NM | 446 NM (7.3%) |
| New York → Yokohama | 5,875 NM | 6,921 NM | 1,046 NM (15.1%) |
Three things drive the gap. Distance: longer legs diverge more. Latitude: the Mercator distortion that penalizes rhumb lines grows toward the poles. Orientation: east–west routes benefit most, while a purely north–south passage like Miami–San Juan saves nothing because the meridian itself is both the great circle and the rhumb line. On the New York–Yokohama extreme, the great circle arcs up over Alaska and hands back 1,046 NM — more than two full days of steaming at 20 knots, which is why the FAA's Pilot's Handbook of Aeronautical Knowledge teaches great circle routing as the default for long-haul planning.
One scope note: this tool is deliberately coordinate-to-coordinate. If you want the distance between two airports by name or code, our air miles calculator does that lookup for you, and the flight time calculator turns any distance into block time at typical cruise speeds. For road legs to and from the port, the travel time calculator covers driving instead of geodesics.
3 Coordinate Mistakes That Move Your Destination
1. The dropped minus sign.In decimal degrees, West longitude is negative. Type Los Angeles as +118.2706 instead of −118.2706 and you've moved your origin to the East China Sea — the “Honolulu” result comes back as 4,411 NM, nearly double the true 2,220. The tell is a bearing that makes no sense: an eastbound course of 75° for a voyage you know heads southwest. If the compass direction surprises you, check signs before anything else.
2. Reading nautical miles as statute miles.One NM is 1.1508 statute miles, so the units are 15% apart — never interchangeable. Treat a 2,220 NM crossing as if it were 2,220 statute miles and you've mentally shortened the voyage by 291 NM. At a sailboat's 8 knots that's about 36 hours of extra passage time nobody provisioned for; on a fuel budget it's a 15% shortfall exactly where you can't fix it.
3. Steering the initial bearing all the way.The 260.8° departure course for Honolulu is correct for the first miles only — hold it for the whole crossing and you're not on the great circle anymore. Working navigators break the arc into waypoints every 300–500 NM and let the heading walk from 261° toward 242°. Skip that on a route like Los Angeles–Shanghai and you give back most of the 446 NM the curve was supposed to save.