This article introduces basic operations on vectors.
Before beginning, a note about terminology is necessary. For historical reasons, mathematics and physics use many different translations for the terms “inner product” and “outer product”.
In physics, they are generally translated as “scalar product” and “vector product”, indicating that the results of the operations are a scalar and a vector. High-school mathematics textbooks likewise use the semantically translated terms “scalar product” and “vector product”.
In mathematics, they can also be translated as “inner product” and “outer product”, which are direct translations of the two nouns. “Dot product” and “cross product” are informal names derived from the operation symbols, and these names are also very common.
In the “dot product” operation, the dot symbol is often omitted. In linear algebra, it is even treated directly as matrix multiplication, without writing the dot symbol.
Inner Product
The concept of an inner product applies to vectors of any dimension.
Definition
There are different but equivalent ways to define an inner product. Some of them are introduced below.
Geometric Definition
In the n-dimensional Euclidean space Rn, let two vectors be a,b and let the angle between them be θ. Then
a⋅b=∣a∣∣b∣cosθ
is the inner product of the two vectors, also called the dot product or scalar product. The quantity ∣b∣cosθ is called the projection of b in the direction of a. The geometric meaning of the inner product is that the inner product a⋅b equals the product of the magnitude of a and the projection of b in the direction of a.
Algebraic Definition
In the n-dimensional Euclidean space Rn, let a=(a1,a2,…,an),b=(b1,b2,…,bn) be two vectors. Then
a⋅b=i=1∑naibi
is the inner product of the two vectors, also called the dot product or scalar product. The geometric and algebraic definitions of the inner product are equivalent in Euclidean space, while the latter is more convenient to use.
When there is no risk of confusion, the dot in an inner product may be omitted. If a vector has a superscript 2 at its upper right, this is shorthand for the inner product of the vector with itself, namely the square of the vector's magnitude, with the magnitude notation omitted. This superscript 2 cannot be interpreted as the square of a vector, because the result of an inner product is a scalar, and the inner product of a vector with any number other than 2 of vectors does not exist. Similarly, the square of the square of a vector's magnitude cannot be abbreviated with a superscript 4; instead, the result represented by the superscript 2 must be treated as a whole, and so on.
Properties
The result of an inner product is a scalar. Its special feature is that it is a bilinear operation, linear in each of the two vectors separately. Specifically, the inner product satisfies
Some common applications of the inner product are introduced below.
Determine whether two vectors are perpendicular:
a⊥b⟺a⋅b=0
The inner product of two perpendicular vectors is 0; the inner product of a vector and the zero vector is 0. If zero inner product is used as the definition of perpendicularity, then the zero vector is perpendicular to every vector.
Determine whether two vectors are collinear:
∃λ∈R(a=λb)⟺∣a⋅b∣=∣a∣∣b∣
Compute the magnitude of a vector:
∣a∣=a⋅a
Compute the angle between two vectors:
θ=arccos∣a∣∣b∣a⋅b
Second- and Third-Order Determinants
Second- and third-order determinants can be given special definitions as relatively simple cases of determinants. In the final part of calculus, the field theory section, Green's formula uses second-order determinants, Gauss's formula uses the dot product, and Stokes' formula uses third-order determinants.
A second-order determinant can be viewed as a function of four variables, defined by
acbd=ad−bc
A third-order determinant can be viewed as a function of nine variables, defined by
adgbehcfi=aei+dhc+gbf−ahf−dbi−gec
A special way to remember these is the “diagonal rule”, which applies only to second- and third-order determinants.
Be especially careful: expanding a fourth-order determinant gives 24 terms, and the term on the secondary diagonal has a positive sign. If the “diagonal rule” for third-order determinants is forcibly applied, there are not enough terms and the sign of the secondary-diagonal term is also incorrect. Therefore, the “diagonal rule” for third-order determinants does not apply to higher-order determinants, and higher-order determinants are also unsuitable for computation by direct expansion.
Cross Product
The cross product is an operation specific to three-dimensional vectors.
In physics, three-dimensional vectors are by default vectors related to positions in space and are always written in bold. However, four-dimensional vectors related to relativity in physics are not written in bold; special notation and subscripts are used instead.
In linear algebra, all vectors are written in bold. Since this is inconvenient, and since most operations in linear algebra are between vectors and matrices and are unlikely to be ambiguous, the vector notation may be omitted in handwriting.
Definition
There are different but equivalent ways to define the cross product. Some of them are introduced below.
Geometric Definition
In the three-dimensional Euclidean space R3, define the cross product of vectors a,b to be a vector, denoted by a×b, whose magnitude and direction are defined as follows:
∣a×b∣=∣a∣∣b∣sin⟨a,b⟩;
a×b is perpendicular to a,b, and the directions of a,b,a×b follow the right-hand rule.
Notice that the magnitude of the cross product is reminiscent of the triangle-area formula S=21absinC. Thus, the geometric meaning of the cross product is: ∣a×b∣ is the area of the parallelogram whose adjacent sides are a,b.
Algebraic Definition
In the three-dimensional Euclidean space R3, define the cross product of a=(x1,y1,z1),b=(x2,y2,z2) to be a vector c, written as c=a×b. It can be represented by the third-order determinant
ix1x2jy1y2kz1z2
where i,j,k are unit vectors pointing in the directions of the coordinate axes x,y,z, respectively, and are placed at the corresponding coordinates. Expanding gives
Some common applications of the cross product are introduced below.
Determine whether two vectors are collinear:
∃λ∈R(a=λb)⟺a×b=0
The cross product of two collinear three-dimensional vectors is 0; the cross product of a three-dimensional vector with itself is 0; and the cross product of a three-dimensional vector with the zero vector is 0. If zero cross product is used as the definition of collinearity, then the zero vector is collinear with every vector.
Compute the area of the parallelogram spanned by two vectors:
S⟨a,b⟩=∣a×b∣
The Two-Dimensional Case
For two-dimensional vectors, the cross product cannot be computed, but the area of the parallelogram spanned by two vectors can still be computed.
Let a=(m,n),b=(p,q). Extend the plane rectangular coordinate system to a spatial rectangular coordinate system, with the original plane as the xOy plane of the new system. The original coordinates (m,n) and (p,q) become (m,n,0) and (p,q,0).
The cross product of the two vectors is then (0,0,mq−np), so the area of the parallelogram is ∣mq−np∣, which can be viewed as the absolute value of the result of a second-order determinant.
At this point, from the sign of the z coordinate and the right-hand rule, we can infer the direction of b relative to a: if it is counterclockwise, the z coordinate is positive; otherwise it is negative. This can be remembered as clockwise negative, counterclockwise positive.
Scalar Triple Product
Like the cross product, the scalar triple product of vectors is an operation specific to three-dimensional vectors.
Definition
Let a,b,c be three vectors in three-dimensional space. Then (a×b)⋅c is called the scalar triple product of a,b,c, denoted by [abc], (a,b,c), (abc), or det(a,b,c). The geometric meaning of the absolute value ∣(a×b)⋅c∣ is the volume of the parallelepiped whose edges are a,b,c.
The scalar triple product can be represented by a third-order determinant:
This also gives the following relation between the inner and cross products:
(a×b)⋅c=a⋅(b×c)
Applications
Some common applications of the scalar triple product are as follows.
Compute the volume of tetrahedron ABCD:
V=61det(AB,AC,AD)
Determine whether a,b,c are coplanar;
Three three-dimensional vectors a,b,c are coplanar if and only if det(a,b,c)=0.
Determine the handedness of the coordinate system formed by a,b,c;
Whether the scalar triple product det(a,b,c) is positive or negative depends on whether the angle formed by a×b and c is acute or obtuse, that is, whether they point to the same or opposite sides of the plane spanned by a and b. Equivalently, the vectors a,b,c form a right-handed or left-handed system in that order. Specifically:
det(a,b,c)<0 is equivalent to a,b,c forming a left-handed system in that order;
det(a,b,c)>0 is equivalent to a,b,c forming a right-handed system in that order.
Double Cross Product
The scalar triple product of three-dimensional vectors is a combination of the inner and cross products and has cyclic symmetry. The cross product of two three-dimensional vectors is still a three-dimensional vector, so does the cross product of cross products have a related result?
We first prove a lemma.
(a×b)×a=(a⋅a)b−(a⋅b)a
Proof: by the right-hand rule, a×b is perpendicular to both a and b. The left-hand side of the desired equality is perpendicular to a×b, so it is coplanar with a and b.
Therefore, we may assume
(a×b)×a=λa+μb
Taking inner products of both sides with a and b, respectively, and using the relevant result for the scalar triple product, gives
The proof above noted that taking the cross product of a×b with any vector produces a vector coplanar with a and b. We now prove the result for the double cross product:
(a×b)×c=(a⋅c)b−(b⋅c)a
The coplanarity above helps us remember the double-cross-product result. The lemma above is a special case of the double cross product.
Proof: it suffices to consider the case where the three vectors are all nonzero and not collinear; the other special cases are immediate.
The three-dimensional vectors a, b, and a×b are not coplanar, so we may assume