Photogrammetry Fundamentals

Core principles of photogrammetric measurement, collinearity equations, stereo geometry, parallax, and the mathematical foundations of extracting 3D coordinates from imagery.

Overview#

Photogrammetry is the science and technology of obtaining reliable measurements and spatial information about physical objects and the environment through the processes of recording, measuring, and interpreting photographic images. The word itself derives from the Greek roots photos (light), gramma (something drawn or written), and metron (to measure) -- literally, "measuring from light-drawings."

"Photogrammetry is the art, science, and technology of obtaining reliable information about physical objects and the environment through the process of recording, measuring, and interpreting photographic images and patterns of electromagnetic radiant energy and other phenomena." -- ASPRS, Manual of Photogrammetry (5th Ed.), Ch. 1, p. 1

The discipline emerged in the mid-19th century when Aime Laussedat first demonstrated the use of terrestrial photographs for topographic mapping in 1849. Aerial photogrammetry became practical after World War I, when surplus aircraft and cameras were repurposed for civilian mapping. By the mid-20th century, photogrammetry had become the primary means of producing topographic maps worldwide.

Metric vs. Interpretive Photogrammetry

Photogrammetry divides broadly into two branches:

BranchPurposePrimary Output
Metric photogrammetryPrecise spatial measurement3D coordinates, distances, areas, volumes, elevations, DEMs
Interpretive photogrammetryQualitative analysis of imageryLand use classification, feature identification, change detection

Surveying professionals are primarily concerned with metric photogrammetry -- the extraction of accurate three-dimensional coordinates and spatial relationships from imagery. Every formula, coordinate system, and adjustment procedure discussed in this article serves that quantitative goal.

"Metric photogrammetry involves making precise measurements from photos to determine the relative locations of points -- it is quantitative photogrammetry." -- Ghilani & Wolf, Elementary Surveying: An Introduction to Geomatics (15th Ed.), Ch. 27, p. 791

Types of Photogrammetry#

Terrestrial and Close-Range Photogrammetry

Terrestrial photogrammetry uses ground-based cameras to photograph objects from fixed, known positions. When the camera-to-object distance is short (typically less than 300 meters), the practice is specifically called close-range photogrammetry. Applications include:

  • Architectural documentation and historic preservation
  • Industrial measurement (ship hulls, machinery, structural deformation)
  • Accident scene reconstruction
  • Archaeological site recording
  • Structural monitoring of dams, bridges, and tunnels

The mathematical principles are identical to aerial photogrammetry, but the camera geometry differs -- the optical axis is typically horizontal or oblique rather than near-vertical.

Aerial Photogrammetry

Aerial photogrammetry captures images from airborne platforms -- historically manned aircraft, and increasingly unmanned aerial systems (UAS). The camera is typically oriented with its optical axis near-vertical (within 3 degrees of the plumb line for vertical photography). This is the most widely practiced form of photogrammetry for mapping and is the primary focus of surveying exam preparation.

Satellite Photogrammetry

Satellite-based sensors (e.g., WorldView, Pleiades, SPOT) capture imagery from orbital altitudes. The geometry differs from frame cameras -- many satellite sensors use pushbroom (linear array) acquisition rather than frame-based imaging, which introduces different mathematical models. Ground sample distances (GSD) for commercial satellites now reach 30 cm or finer.

TypePlatformTypical GSDCommon Applications
Terrestrial / close-rangeTripod, handheldsub-mm to cmStructural monitoring, archaeology, accident reconstruction
Aerial (manned)Fixed-wing aircraft5--30 cmTopographic mapping, orthophoto production, corridor surveys
Aerial (UAS)Multirotor or fixed-wing drone1--5 cmSite surveys, volumetrics, construction monitoring
SatelliteOrbital platform30 cm -- several mRegional mapping, change detection, disaster response

The Collinearity Condition#

The collinearity condition is the fundamental mathematical model of photogrammetry. It states that, at the instant of exposure, an object point, the corresponding image point, and the perspective center of the camera lens are all collinear -- they lie on a single straight line.

"The collinearity equations express the condition that an object point, its image, and the exposure station all lie along a straight line in three-dimensional space." -- Wolf, Dewitt & Wilkinson, Elements of Photogrammetry with Applications in GIS (4th Ed.), Ch. 11, p. 293

Mathematical Formulation

Let the object point have ground coordinates (X,Y,Z)(X, Y, Z), the exposure station (perspective center) have coordinates (XL,YL,ZL)(X_L, Y_L, Z_L), and the corresponding image point have coordinates (x,y)(x, y) in the image coordinate system with principal point at (x0,y0)(x_0, y_0) and focal length ff. The collinearity equations are:

xx0=fm11(XXL)+m12(YYL)+m13(ZZL)m31(XXL)+m32(YYL)+m33(ZZL)x - x_0 = -f \cdot \frac{m_{11}(X - X_L) + m_{12}(Y - Y_L) + m_{13}(Z - Z_L)}{m_{31}(X - X_L) + m_{32}(Y - Y_L) + m_{33}(Z - Z_L)}

yy0=fm21(XXL)+m22(YYL)+m23(ZZL)m31(XXL)+m32(YYL)+m33(ZZL)y - y_0 = -f \cdot \frac{m_{21}(X - X_L) + m_{22}(Y - Y_L) + m_{23}(Z - Z_L)}{m_{31}(X - X_L) + m_{32}(Y - Y_L) + m_{33}(Z - Z_L)}

where mijm_{ij} are the elements of the 3×33 \times 3 rotation matrix M\mathbf{M} that relates the image coordinate system to the ground coordinate system. The rotation matrix is defined by three sequential rotations about the axes, parameterized by the angles ω\omega (omega), ϕ\phi (phi), and κ\kappa (kappa):

  • ω\omega -- rotation about the XX-axis (tip/roll)
  • ϕ\phi -- rotation about the YY-axis (tilt/pitch)
  • κ\kappa -- rotation about the ZZ-axis (swing/yaw)

Interior and Exterior Orientation

Each photograph is characterized by two sets of orientation parameters:

OrientationParametersDescription
Interior orientationff, x0x_0, y0y_0, lens distortion coefficientsDefines the internal geometry of the camera -- focal length, principal point location, and systematic lens distortions
Exterior orientationXLX_L, YLY_L, ZLZ_L, ω\omega, ϕ\phi, κ\kappaDefines the position and angular orientation of the camera at the instant of exposure

Interior orientation is established through camera calibration. Exterior orientation is determined through photogrammetric processes such as space resection, relative orientation, and aerotriangulation (bundle adjustment).

The collinearity equations contain six unknowns per photograph (the exterior orientation parameters). Each measured image point provides two equations. Therefore, a minimum of three well-distributed ground control points visible on a single photograph are required to solve for its exterior orientation -- a process known as space resection.

"The minimum number of ground control points needed for space resection is three, but additional points are always desirable for redundancy and reliability." -- Mikhail, Bethel & McGlone, Introduction to Modern Photogrammetry, Ch. 5, p. 163

The collinearity equations also form the basis of bundle adjustment, the simultaneous least-squares solution of all exterior orientation parameters, ground point coordinates, and (optionally) interior orientation parameters from all measured image points across an entire block of photographs. Bundle adjustment is the standard method for aerotriangulation in modern photogrammetry.

Stereo Geometry and Parallax#

Stereoscopic Viewing

Human depth perception relies on binocular vision -- the brain fuses two slightly different views of the same scene (one from each eye) into a three-dimensional perception. Photogrammetry replicates this principle using overlapping photographs taken from different positions along a flight line. The lateral shift in position between two successive exposure stations is called the air base (BB).

When two overlapping photographs of the same terrain are viewed through a stereoscope (or digitally with 3D display systems), the observer perceives a three-dimensional stereomodel of the terrain.

"The three-dimensional impression created by viewing overlapping photographs stereoscopically forms the basis for all stereoscopic measurement in photogrammetry." -- Wolf, Dewitt & Wilkinson, Elements of Photogrammetry with Applications in GIS (4th Ed.), Ch. 8, p. 195

Parallax

Parallax is the apparent shift in position of an object when viewed from two different vantage points. In photogrammetry, parallax is the key to extracting elevation information from stereo pairs.

  • x-parallax (absolute stereoscopic parallax): The difference in the xx-coordinates of the same point as imaged on the left and right photographs of a stereo pair. This parallax is directly related to the elevation of the point. Points at higher elevations exhibit greater x-parallax.

  • y-parallax: The difference in yy-coordinates of the same point on the two photographs. Ideally, y-parallax is zero for a perfectly aligned stereo pair. Non-zero y-parallax indicates tilt, unequal flying heights, or other orientation errors.

Parallax Equations for Height

For a vertical photograph stereo pair with flying height HH above datum, air base BB, and focal length ff, the elevation hh of a point above datum can be determined from its parallax. Let pp be the absolute stereoscopic parallax of the point. Then:

h=HBfph = H - \frac{B \cdot f}{p}

The difference in elevation between two points, AA and BB, can be computed from their parallax difference Δp=pApB\Delta p = p_A - p_B:

Δh=hAhB=HhBpBΔp\Delta h = h_A - h_B = \frac{H - h_B}{p_B} \cdot \Delta p

This relationship is the foundation of stereoscopic height measurement. The precision of height determination depends on the magnitude of the parallax difference, which in turn depends on the base-to-height ratio (B/HB/H). Larger base-to-height ratios provide better height accuracy.

Scale of a Photograph#

The scale of a vertical aerial photograph depends on two quantities: the camera focal length ff and the flying height above the terrain HH':

S=fHS = \frac{f}{H'}

where H=HhH' = H - h is the flying height above the terrain, HH is the flying height above the datum, and hh is the terrain elevation above datum. Because terrain elevation varies across the photograph, the scale is only truly uniform for flat terrain. For undulating terrain, the scale varies point by point.

"The scale of a vertical photograph varies from point to point, depending on the elevation of the terrain. A single-valued scale can only be given for a specific elevation." -- Ghilani & Wolf, Elementary Surveying: An Introduction to Geomatics (13th Ed.), Ch. 27, p. 806

Worked Example

A vertical aerial photograph is taken with a camera having a focal length of f=152.4 mmf = 152.4 \text{ mm} from a flying height of H=3,048 mH = 3{,}048 \text{ m} above mean sea level. What is the photo scale at a point with ground elevation h=305 mh = 305 \text{ m}?

S=fHh=152.4 mm3,048305 m=0.1524 m2,743 m=118,000S = \frac{f}{H - h} = \frac{152.4 \text{ mm}}{3{,}048 - 305 \text{ m}} = \frac{0.1524 \text{ m}}{2{,}743 \text{ m}} = \frac{1}{18{,}000}

The photo scale at that point is approximately 1:18,0001:18{,}000.

If the terrain elevation were instead h=610 mh = 610 \text{ m}:

S=0.15243,048610=0.15242,438=116,000S = \frac{0.1524}{3{,}048 - 610} = \frac{0.1524}{2{,}438} = \frac{1}{16{,}000}

The higher terrain yields a larger scale (less ground area covered per unit photo distance), illustrating how scale varies with elevation.

Relief Displacement#

Relief displacement is the radial shift in the image position of a point caused by its elevation above (or below) a reference datum. Objects with height (buildings, trees, terrain above datum) appear to lean radially outward from the center of the photograph (the nadir point or principal point for a truly vertical photograph).

Relief Displacement Formula

The magnitude of the relief displacement dd is given by:

d=rhHd = \frac{r \cdot h}{H}

where:

  • dd = relief displacement on the photograph
  • rr = radial distance from the principal point to the image of the top of the object
  • hh = height of the object (or elevation above datum)
  • HH = flying height above the base of the object (or above datum)

Key properties of relief displacement:

  • It increases linearly with the radial distance from the photo center
  • It increases with object height
  • It decreases with greater flying height
  • It is always directed radially outward from the photo center
  • At the exact center of the photograph (r=0r = 0), there is no relief displacement regardless of object height

"Relief displacement is radial from the principal point on a truly vertical photograph. It causes images of objects that have height above the datum to be displaced outward from the photo center." -- Wolf, Dewitt & Wilkinson, Elements of Photogrammetry with Applications in GIS (4th Ed.), Ch. 6, p. 147

Worked Example

On a vertical photograph taken from H=3,000 mH = 3{,}000 \text{ m} above datum, a building's rooftop image falls r=85.0 mmr = 85.0 \text{ mm} from the principal point. If the building is h=45 mh = 45 \text{ m} tall, the relief displacement is:

d=85.0×453,000=1.275 mmd = \frac{85.0 \times 45}{3{,}000} = 1.275 \text{ mm}

The building's roof image is displaced 1.275 mm radially outward from where its base would appear if the building had no height.

Coordinate Systems#

Photogrammetric work requires careful management of multiple coordinate systems. The principal systems are:

Image (Photo) Coordinate System

A two-dimensional coordinate system defined in the plane of the photograph, with its origin at the principal point (where the optical axis intersects the image plane). The xx-axis is typically aligned with the direction of flight, and the yy-axis is perpendicular. Units are typically millimeters or micrometers. Fiducial marks (on film cameras) or sensor geometry (on digital cameras) establish this system.

Camera (Sensor) Coordinate System

A three-dimensional coordinate system centered at the perspective center (rear nodal point of the lens). The xcx_c and ycy_c axes are parallel to the image coordinate axes, and the zcz_c-axis coincides with the optical axis, pointing toward the ground. The focal length ff is the distance from the perspective center to the image plane along zcz_c.

Object (Ground) Coordinate System

The three-dimensional coordinate system in which ground control points and final map coordinates are expressed. This may be a local project coordinate system, a State Plane coordinate system, UTM, or a geodetic (latitude/longitude/height) system. The relationship between camera coordinates and ground coordinates is defined by the exterior orientation parameters through the rotation matrix M\mathbf{M} and translation vector.

Transformation Between Systems

The collinearity condition equations embody the transformation from ground coordinates to image coordinates. The inverse problem -- computing ground coordinates from image measurements -- requires at least two photographs (stereo) because a single image point defines a ray in space but not a unique point along that ray. The intersection of two such rays from overlapping photos determines the three-dimensional position of the ground point.

Coordinate SystemDimensionsOriginUnitsPurpose
Image (photo)2DPrincipal pointmmMeasuring image positions
Camera (sensor)3DPerspective centermmRelating image to camera geometry
Object (ground)3DDatum originm / ftFinal mapping coordinates
Model3DArbitraryrelativeStereomodel before absolute orientation

The transformation chain for a full photogrammetric workflow proceeds: image coordinates \rightarrow camera coordinates \rightarrow model coordinates (via relative orientation) \rightarrow ground coordinates (via absolute orientation). In modern bundle adjustment, the intermediate model coordinate step is bypassed -- the collinearity equations relate image coordinates directly to ground coordinates.

Key Takeaways#

  • Photogrammetry is the science of obtaining reliable spatial measurements from photographs, with applications spanning topographic mapping, engineering surveys, and cultural documentation.
  • The collinearity condition is the mathematical foundation: at the instant of exposure, the object point, image point, and perspective center are collinear. The collinearity equations relate image coordinates to ground coordinates through six exterior orientation parameters per photograph.
  • Interior orientation (focal length, principal point, lens distortion) defines the camera's internal geometry; exterior orientation (XLX_L, YLY_L, ZLZ_L, ω\omega, ϕ\phi, κ\kappa) defines the camera's position and attitude in space.
  • Stereoscopic parallax -- the shift in x-coordinates between overlapping photographs -- is the basis for height measurement. The parallax equation h=HBf/ph = H - Bf/p enables elevation determination from stereo pairs.
  • Photo scale varies with terrain elevation: S=f/(Hh)S = f/(H - h). Higher terrain yields larger scale; lower terrain yields smaller scale on the same photograph.
  • Relief displacement causes elevated objects to appear to lean radially outward from the photo center, with magnitude d=rh/Hd = rh/H. This effect is exploited for height measurement but must be corrected for planimetric accuracy.
  • Multiple coordinate systems (image, camera, model, ground) must be carefully managed and related through orientation parameters and transformations.
  • The base-to-height ratio (B/HB/H) controls the strength of height determination -- larger ratios yield better elevation precision.

References#

  1. ASPRS. Manual of Photogrammetry (5th Ed.). American Society for Photogrammetry and Remote Sensing, 2004.
  2. ASPRS. Manual of Photogrammetry (6th Ed.). American Society for Photogrammetry and Remote Sensing, 2013.
  3. Wolf, P.R., Dewitt, B.A. & Wilkinson, B.E. Elements of Photogrammetry with Applications in GIS (4th Ed.). McGraw-Hill, 2014.
  4. Ghilani, C.D. & Wolf, P.R. Elementary Surveying: An Introduction to Geomatics (13th Ed.). Pearson, 2012. Chapter 27.
  5. Ghilani, C.D. & Wolf, P.R. Elementary Surveying: An Introduction to Geomatics (15th Ed.). Pearson, 2018. Chapter 27.
  6. Mikhail, E.M., Bethel, J.S. & McGlone, J.C. Introduction to Modern Photogrammetry. John Wiley & Sons, 2001.
  7. Kraus, K. Photogrammetry: Geometry from Images and Laser Scans (2nd Ed.). Walter de Gruyter, 2007.