1. Introduction
Computer vision is an essential guest in our life [
1,
2,
3,
4,
5,
6,
7,
8,
9]. In the last 10 years many authors have written important contributions to mathematical problems related to computer vision using algebraic geometry. They addressed one of its key problems: the reconstruction of algebro-geometric objects (lines, conics, and even more general algebraic curves) from their linear projections into a plane. As usual in algebraic geometry, first one proves a theorem over an algebraically closed field, here the field
of the complex numbers, and then, explains why/how this theorem over
helps to prove something interesting about a picture over
, i.e., a real curve of a projective plane
. We are in the setup of pin-hole cameras. Take as
either
or
. For a single picture there is a projective plane
and we always project on
from a point of
. In the abstract algebro-geometric setting there is no specific screen, just the notion of a projection from one or more points to an abstract plane [
10,
11,
12,
13,
14,
15,
16,
17]. We are aware that in most textbooks there is a screen for each camera and the reconstruction of each screen is an important task [
3].
As in [
10,
11,
12,
13,
15,
16,
17], we assume we know the projection points
and call
the minimal cone with vertex
containing
X. The cone
is often called the back-projection of the image of
X by the camera
. We are aware that a very important task is the recovering of the pin-hole centers
[
1,
2,
3,
6]. However, this part is not considered in our paper.
We say that X is -reconstructible using the pin-holes if . Now, assume that X is defined over and that . We say that X is -reconstructible over if and each is uniquely determined by the images by of the real part, , of the complex curve . More precisely, we say that X is set-theoretically (resp., scheme-theoretically) -reconstructible by if as sets (resp., as algebraic schemes). Over for scheme-theoretic -reconstruction we add the condition that the set-theoretic images of determine the schemes . In all our examples, the latter condition is always satisfied.
In one short section, we prove the following results.
Theorem 1. Take a positive integer s. Let , , be integral curves such that for all . Set . There is a non-empty Zariski open subset U of such that X is set-theoretically α-reconstructible by all cameras .
We recall that Zariski open subsets U of are very large. Indeed, the set has complex dimension at most 11, it is a finite union of differentiable manifolds of dimension at most 22, and hence, it has measure zero for any measure on locally equivalent to the Lebesgue measure. Thus, “random” choices of the centers should give centers in U. Anyway, given any it is easy to obtain , and then, choose four other centers if seems not to be the correct answer or to independently check the answer .
Question 1: Give conditions on X assuring that -reconstruction is not possible only using three general centers or three non-birational centers.
Theorem 2. Take a positive integer s. Let , , be integral curves such that for all , each is defined over and each is infinite. Set . There is a non-empty Zariski open subset U of such that X is set-theoretically α-reconstructible over by all cameras .
Theorem 3. Let be a smooth and connected curve. Then, X is scheme-theoretically α-reconstructed by four general cameras.
By §7 in [
18] there are smooth curves
which are not scheme-theoretically the intersection of three surfaces. Hence, in many cases scheme-theoretical
-reconstruction is not possible using only three cameras. Every space curve (even singular and reducible) is set-theoretically the intersection of three surfaces by a theorem of Kneser or its higher dimensional generalizations due to Eisenbud and Evans [
19,
20]. D. Jaffe gave a non-tautological description of the space curves which are the intersection of a cone with another surface [
21]. We do not have a non-tautological description of all curves which are complete intersections of two cones, i.e., of the curves which scheme-theoretically may be
-reconstructed using two cameras.
A large part of the paper is devoted to the study of three classes of curves X to be projected:
Refs. [
11,
14] study the algebraic geometry of
n projections of a single curve. F. Rydell and I. Sundeliu study plane curves and rational normal curves [
17]. The latter are exactly the irreducible space curves of degree 3 not contained in a plane. See Example 5 for our discussion of these curves.
Recently, the classical trifocal tensor (Ch. 14 in [
3]) was deeply studied and extended to linear projections of linear subspace of any dimension [
22,
23,
24,
25,
26,
27,
28,
29].
In
Section 2, we fix the notation, collect from the references several results we need, and recall (Remark 5): how to obtain from a planar picture the equation of the plane curve. We will need this step several times.
In
Section 3, we recall the known facts about real algebraic curves we use and see how to use a real “arc” (diffeomorphic to an open interval) to
-reconstruct a curve over
. We show that with the official algebro-geometric definition of a real curve there are real curves
X and
such that
, but the image of
by
o intersects
in a circle. We prove that this is not the case for a general pin-hole (Theorem 4).
In
Section 4, we prove Theorems 1, 2, and 3 and discuss them.
In
Section 5, we study the images by
n cameras of the union of
m lines,
.
In
Section 6, we study plane curves. The aim is to reconstruct them using only two cameras: one general and one special. We perform a test on the images which implies that we started with a smooth plane curve (Proposition 4). We give a criterion to obtain the plane curve using two cameras (not for
-reconstruction, but to identify the curve from the two cones
and
) if the curve has no nontrivial automorphism (Proposition 5).
In
Section 7, we discuss space curves lying on an irreducible quadric surface. This section is used for curves of low degree and for the reconstruction of an irreducible curve whose genus is high with respect to its degree.
In
Section 8, we discuss the linear projection of curves of degree at most 4 and give parameter spaces for finite unions of easy objects, for instance, smooth conics. In
Section 11 (Conclusions), we recall the key points obtained in this paper.
Many thanks to the reviewers for useful suggestions. These suggestions improved the exposition of the paper and, perhaps, future papers.
2. Notation and Preliminary Results
Notation 1. For each let denote the linear projection from p.
Note that if , then induces a surjection whose fibers are diffeomorphic to .
Let , , denote the complex conjugation. We have .
For any subset S of a projective space, let denote its linear span.
For any curve and any the set is well-defined. Now, assume and let be the union of all irreducible components of X which are not lines containing o. The set is well-defined and we call the closure of in . Here, closure in the Euclidean sense or in the sense of the Zariski topology gives the same set by a theorem of Chevalley. If , set . If either or and , then is a curve and we call the cone with vertex o and as its base. Note that . To obtain the integer we apply the next observation to the irreducible components of X.
Remark 1. Let be an integral projective curve. Fix and assume that X is not a line containing o. Set and let μ be the multiplicity of X at o, with the convention if and only if . We have if and only if o is a smooth point of X. Set . Let be the normalization of X and the normalization of . and are smooth and connected projective curves and induces a surjective map . We have .
Remark 2. Let be an integral and non-degenerate curve. The set of all such that is not birational onto its image and is finite [30,31]. The recent paper [31] contains an upper bound for the number of these exceptional points. Set . By Th. 1.3 in [31], there are at most such points. Note that this is not true if spans a plane M, because for each the curve is a line. Remark 3. Let be an integral curve. Set . Assume the existence of such that scheme-theoretically. The theorem of Bezout gives , and hence, either , i.e., X is a line, or at least one among and is not birational onto its image. Moreover, exactly one among and is not birational onto its image if and only if X is a plane curve. Let X be a plane curve, but not a line, and let be the plane spanned by X. We have if we take and . Here, there is a non-planar example. Let be a smooth degree 4 elliptic curve. By case 2 of Th.1 in [32], X is contained in four quadric cones and none of their vertices is a point of X. Thus, the theorem of Bezout gives if and are the vertices of two different quadric cones containing X. Remark 4. Let be an integral degree d curve. Let denote the normalization map. Let q be the genus of X. If Y is the image of a degree d smooth curve , then (Th. 3.7 in [33]). Moreover, if , then X is contained in an integral quadric surface (Th. 3.11 in [33]). This quadric surface is unique, unless and . Assume and set if and if . If , then (Th. 3.13 in [33]). Remark 5. Let be a plane curve without multiple components. At several places it would be essential to obtain the equation of Y from some of its points. If Y is defined over we will only use real points of Y. In the next section, we show why we can use the objects usually called open arcs. Take homogeneous coordinates of . For each integer let (resp., ) denote the set of all homogeneous polynomials of degree k with complex (resp., real) coefficients, i.e., the linear span of all monomials with a, b, and c non-negative integers and . Since these monomials are linearly independent, . To obtain a homogeneous equation of Y (unique up to a non-zero multiplicative constant), we assume we have a set such that each irreducible component of contains infinitely many points of A. These assumptions are equivalent to assuming that A is Zariski dense in . Thus, if , up to a non-zero constant, there is a unique such that ; just find a non-zero solution of a linear homogeneous system with equations. If , then we find f with real coefficients.
From an equation f of Y, we easily obtain the set of singular points of Y and other geometric information which will be important in Section 6, with X a plane curve. Almost always we use the case in which is known, often the integer . In other cases, we use Remark 1 and test the possible integers .
3. Over the Real Numbers
Let X be a smooth and connected curve of genus g defined over . Let be the set of its complex points and let denote the complex conjugation. Each connected component of is a one-dimension connected and compact manifold, and hence, it is diffeomorphic to a circle.
Proposition 1 (Prop. 3.1 in [
34])
. Let be the number of connected components of . The topological space has at most two connected components. Set if is connected and if has two connected components. Then:- 1.
.
- 2.
If , then . If , then .
- 3.
If , then .
F. Klein proved that all pairs allowed by Proposition 1 are realized by some genus g smooth curve defined over .
We recall that the real projective space is a compact 2-dimensional connected but not simply connected differential manifold with the 2-dimensional sphere as its universal cover and with a degree 2 covering map . Let denote the complex conjugation. For any algebraic curve (or ) defined over set . Set . We recall that any degree d plane curve has arithmetic genus . Note that if d is odd, then and each real line meets . For each even d there is a smooth planar curve with , e.g., take the Fermat curve .
Remark 6. Let be a complex degree d plane curve. Take such that . Let denote the polynomial obtained applying the complex conjugation to all coefficients of f. The curve is well-defined, i.e., for all we have . Note that . Since is the fixed-point set of the complex conjugation , , the curve Y is defined over if and only if .
Definition 1. Take with the Euclidean topology. An open arc is a locally closed set such that there is a homeomorphism u from to the closed interval , , such that induces a homeomorphism . An open arc is said to be an open arc of degree d or an open arc of a degree d algebraic curve if the Zariski closure of A in is a degree d plane curve without multiple components.
Circles appear as a connected component of in Proposition 1. Each such circle is the union of two open arcs.
Remark 7. Let A be an open arc of and let Y be the Zariski closure of A in . Since A is an infinite set, the definition of the Zariski topology of shows that either or Y the union of finitely many points, say a finite set S, and a curve without multiple components. Since a finite subset of is closed and it has the discrete topology, then , i.e., it is a curve with no multiple component. Note that if Y is a curve without multiple components, then the integer is uniquely determined by A.
Lemma 1. Let A be a degree d open arc of and let Y be the Zariski closure of A in . Then:
- 1.
Y is an irreducible curve of degree d;
- 2.
Y is defined over and .
Proof. Remark 7 gives that Y is a curve. By Remark 6, the degree d complex curve is well-defined. Since , the degree d curve is the Zariski closure of A. Thus, . By Remark 6, Y is defined over . Since is the fixed-point set of the complex conjugation. Assume that Y is not irreducible and let , , be the decomposition over of Y into its irreducible components, i.e., each is irreducible and for all . Since , either or there is an integer such that . Assume the existence of such that and let be the closure of . Since is continuous for the Euclidean topology and two different irreducible curves have only finitely many common points, . Note that either (case ) or is a curve of degree . Since is finite, A is contained in , contradicting the definition of degree of an open arc. □
In the next example, we see that if we use the standard definitions of algebraic geometry sometimes ghosts appear.
Example 1. Take a plane defined over . Let be a smooth conic defined over . We also assume , so that is diffeomorphic to a circle. Thus, is a smooth conic. Fix and let be the cone with vertex c and as a base. The quadric cone T is defined over and is the cone with vertex c and base . Take a general plane , i.e., a plane with an equation with general complex coefficients. We have and is not defined over . To be sure that is not defined over it is sufficient that one of its equations has 1 as a coefficient and an element of as another coefficient, i.e., that an equation of has two non-zero coefficient whose ratio is not real. Thus, is a line. The degree 4 curve is defined over . Since , is defined over . Note that is formed by two points. Thus, is finite. The real camera with c as its pin-hole has the circle as the real part of the image of .
Lemma 2. Take . Let be a reduced curve defined over and such that . Assume , i.e., assume that is birational onto its image. Then, is a finite set.
Proof. Set . Let T be the cone with vertex c and as a base. T is defined over and . By assumption . Set and assume . Fix . The set is the unique complex line containing c and with . Since both p and c are defined over , is defined over . Thus, is -invariant. Since is algebraically closed, . By the definition of E, we have . Since is -invariant, . Since is birational onto its image, E is finite. □
Example 1 shows that the birationality of is required in Lemma 2. In Example 2, X is irreducible over , but not over . The following example works with X irreducible and smooth over , , , and diffeomorphic to a circle.
Example 2. Take and a smooth real conic such that and . The set is diffeomorphic to a circle. Let be the cone with base D and c as its vertex. Take as X the complete intersection of D with a general smooth quadric surface Q defined over , but with .
Proposition 2. Let be an integral curve. Let be an integral curve such that . There is a non-empty Zariski open subset such that for all .
Proof. Set . Since and X, Y are irreducible curves, is finite. By Remark 2, there is a finite set such that and are birational onto their images for all . Fix and assume . We have and . Thus, . Fix a general . Since Y has only finitely many singular points, p is a smooth point of Y. Since is finite, . Remark 2 gives and . Thus, and have only finitely many common points. There is a Zariski open neighborhood U of p in such that is finite for all . □
Proposition 3. Let be an integral curve defined over and such that is infinite. Let be an integral curve such that , and Y is defined over . There is a non-empty Zariski open subset such that for all .
Proof. The proposition is obvious if is finite. Thus, we may assume that is infinite. Thus, (resp., ) is Zariski dense in (resp., ). By Remark 2, there is a finite set such that and for all . Thus, . Since is infinite, there is such that and p is contained in an open arc of . We use this point p to adapt the proof of Proposition 2. □
Theorem 4. Let be a reduced curve defined over . Then, there is a non-empty Zariski open subset V of such that is finite for all .
Proof. Let , , be the decomposition of X into its irreducible components. Since X is real, , i.e., up to a permutation of the indices, there is an integer e such that , is even, , i.e., is defined over , for , and for , the complex conjugation permutes and , i.e., neither not is defined over , while is defined over . Apply Remark 1 to each irreducible component of X, and then, apply Proposition 2 to any pair of irreducible components of X. □
4. Proofs of Theorems 1, 2 and 3
Proof of Theorem 1: Set . By Remark 2, there is a finite set such that is birational onto its image for all and all . By Proposition 2, there is a non-empty Zariski open subset V of such that is birational onto its image for all , i.e., for all . Fix a general and let and be the corresponding cones. The scheme is scheme-theoretically a complete intersection of degree , perhaps with multiple components, containing X. □
Claim 1: The scheme contains each with multiplicity 1.
Proof of Claim 1: Fix a general . Hence, is smooth at p. Since , , is birational onto its image and p is general in , for some implies . If , we also obtain that is smooth at p. Thus, the cones and are smooth at p. The tangent space of at p is the plane spanned by and . Thus, and are transversal at p for a general .
Applying Proposition 2 to the irreducible components of not contained in X we obtain that is the union of X (counted with multiplicity one) and a finite set E. Taking not contained in one of the finitely many cones with base X and vertex a point of E, we obtain (set-theoretically). □
Proof of Theorem 2: Mimic the proof of Theorem 1 quoting Proposition 3 instead of Proposition 2. □
Proof of Theorem 3: Take a general as in the proof of Theorem 1. With the assumption of Theorem 1 we prove that are scheme-theoretically the same in a neighborhood of each point of X, which would obviously prove Theorem 3. For a general the scheme is singular at only finitely many points of X. For a general the scheme is smooth at all points of with S finite and at each the Zariski tangent space of has dimension 2. Since , for a general the cone at no has a tangent plane containing the plane . □
Remark 8. If in Theorem 2 it is not sufficient to assume that each is defined over and that is infinite. For instance, take infinite and for all . A real and smooth projective curve has either or infinite and a union of finitely many disjoint circles, each of them being the union of two open arcs (Proposition 1). Odd-degree curves have infinite, but there is a degree 4 singular rational curve Y with a unique singular point, p, which is an ordinary node and . Reconstruction over by any number of real cameras is also impossible if X is defined over , but some of its irreducible components are not, e.g., if and , because the real part of the real curve is contained in , and hence, it is finite.
Example 3. Let be a smooth conic and let be the plane spanned by X. Take . The map is birational onto its image if and only if . Take such that . The scheme is a degree 4 curve which is the union of X and another conic Y with . Indeed, , i.e., is not a multiplicity 2 structure on X, because both and are smooth along X and their tangent planes along C are not always the same. Take . Since , while , is not scheme-theoretically equal to X.
5. Multiview of m Distinct Lines
In this section, we consider the case of m lines and n cameras.
Let
be the Grassmannian of all lines of a 3-dimensional projective space. The algebraic variety
is irreducible and projective and
. The compact complex manifold
is isomorphic to a smooth quadric hypersurface of
and
is a compact and connected 4-dimensional manifold. See [
11,
14] for a detailed description of
and how to obtain from a line as an element of
its image in the screen
using the camera
o. See Ch. 10 in [
35] for a detailed study.
Call
the
matrix obtained stacking the
matrices. Given homogeneous coordinates
the matrix
gives a morphism
. In only using
there is an explicit way to obtain o, a rational map
which is not defined exactly at the lines
containing at least one point
[
11]. The closure of the image of
is called the
line multiview variety associated to
. This variety is deeply studied in [
11,
14]. The former paper also gives easy conditions on
, say
, to say if a general fiber of
is a single point, i.e., “generic reconstruction” holds (prop. 2.4 in [
11]) and which line
L in the domain of
we have
, i.e.,
L maybe reconstructed (in their sense) from its
m pictures (Th. 2.6 in [
11]).
Remark 9. Fix and take lines such that and . We have if and only if the planes and are the same. Note that if , then . Thus, this problem (less lines in a screen even if no line contains the center of one camera) does not arise if we start with m pairwise disjoint lines.
Lemma 3. Fix such that . Let A be the set of all such that . Let and denote the maps associated to the cameras , with being defined only if . Then:
(a) γ and are surjective.
(b) Take . If , then . If is a plane, then (resp., is the set of all lines (resp., real lines) in containing neither nor .
(c) Take such that . Then, .
Proof. Fix and let denote the back-projection of with respect to . Either or is a line. In the latter case, . Now, assume and take any line R such that and . By Remark 9, we have , concluding the proof of part (a).
Remark 9 gives which lines V satisfies , proving part (b).
Part (b) implies part (c). □
To discuss the reconstruction of lines we need to discuss several options. We start with the union of n lines. To determine the domain of the multiple-view map for m lines we distinguish if we just start with A or the ordered set . In the latter case, the natural parameter space is the Zariski open subset of formed by all such that . The quasi-projective variety has as its natural compactification. In the next section, we discuss and solve the easiest case: m ordered lines in which we may also distinguish their images, i.e., m distinct lines with m distinct colors. Of course, in this setup it is not sufficient to reconstruct A, for a perfect reconstruction we also need to reconstruct the name of each of the m irreducible components of A. In this setup the natural domain is the quotient of by the action of the symmetric group with m elements. The set is a smooth irreducible quasi-projective variety of dimension defined over .
Remark 10. Assume and set . Both and are defined over and so their real part and are well-defined. As expected, is the set of all m distinct lines of , which is a Zariski open subset of the compact -dimensional differential manifold . However, in algebraic geometry has an official definition. With this official scheme-theoretic definition is the set of all such that . With this definition has connected components, , , each of them a differentiable manifold of dimension , with parametrizing the set of all with A union of real lines and i pairs of lines L and with L not real. Note that has a real point if and only if L and are coplanar, and hence, is a real point. Note that a perfect real screen, say , see as the union of at most real lines (exactly real lines if A is formed by m pairwise disjoint lines) and i real points. The same image would appear using a perfect camera from with each a real line and exactly lines containing o. With at least three non-collinear pin-hole cameras we always see if is an element of the unique connected component, , we are interested in.
In the next observation, we collect several useful practical suggestions coming from [
11].
Remark 11. Call n cameras , , with, say, at least three not collinear cameras. Call M the associated matrix. There is a complete description of the closed variety of line views of in terms of the matrix M and the Plücker coordinates of (Th. 2.5 in [11]). The explicit equations of inside give an easy test to say if or not. The explicit description of also gives if comes from not containing any . The subvariety of has dimension 4
and so its has measure 0
in . Thus, a small modification of is not an element of . We should take as image some nearby . 5.1. Two Compactifications of the Set of m Lines in
We explain two possible compactifications of the set of unions of m distinct lines of , i.e., of the subset of the dual complex projective plane with cardinality m. Then, if we have n screens we just take the product of n copies of the same compactification. We prefer the second one, often called the Hilbert scheme compactification.
(a) The symmetric product.
We do not need to take
. Let
W be a smooth and connected complex projective variety. Take the quotient
of
by the symmetric group
permuting the factors. The set
is an irreducible projective variety of dimension
. If
W is defined over
, then
is defined over
. If
(as in our cases with
and
), for any
the variety
is singular. This is the main reason for not using it for algebro-geometric calculations, as in §4 in [
11].
(b) The Hilbert scheme compactification.
This compactification exists for all
W, but it is nice, i.e., it smooth and irreducible, only if
. If
W is a smooth and connected projective curve, then the Hilbert scheme compactification is
. Now, assume that
W is a smooth and connected projective surface. This is the only case we need. Let
denote the set of all subset
such that
. The Hilbert scheme compactification
of
parametrizes the set of all degree
m zero-dimensional schemes of
W. The set
is irreducible and smooth [
36],
and, if
,
is an irreducible hypersurface of
. If
we have
[
37]. Thus, for
we have
.
5.2. The Practical Suggestion
Fix . Take cameras and assume for the moment that all pictures are formed by m distinct lines, say , , . Fix and . Lemma 3 gives a family B of lines not containing and mapping to and . In almost all cases B is a singleton. Take . See if the cameras give components of . If all these tests work, L is an irreducible component and we reduce to the case of lines. If at least one of these test fails, use instead of and continue.
The main problem is when B is not a singleton.
We use the setup with screen with projecting on the plane . We assume , which is not a strong restriction from the abstract point of view. With this assumption for all such that , the set is a single point, . If , then for any choice of (Lemma 3). To conclude, it is sufficient that for at most indices.
5.3. m-Lines of Different Colors
We assume that we start with m ordered lines, say , and that these lines have different colors (m lines of m distinct colors) and that these different colors are distinguished by our m screens. Here, it is the same over or over and we use to denote that both possibilities occur. We also assume that if in one screen two lines map to the same line we see that the image gives both colors, so this is not a problem for the reconstruction of the m ordered lines. So, if no pass through the screen associated to gives m lines, each of them associated (by its color) to a unique . In this extreme situation, one has essentially m times the single line case. When we have colors and we know how many lines have a given color, then we reduce to a times the situation described in the first part of this section.
6. Plane Curves
Smooth plane curves
of degree
d are one of the main characters in [
17]. In this section, we consider the reconstruction of a smooth plane curve
X over the complex numbers, leaving the case of real plane curves to a subsection in which we may use everything we said over
to obtain useful results over
. We always assume that
X has no multiple component, because the set
cannot distinguish multiple components.
Remark 12. Let be a degree d plane curve without multiple components. We recall that in Remark 5 we explained how to obtained an equation of C and that if C is irreducible and defined over and is infinite, then an equation of C with real coefficients may be obtained just by one open arc contained in (Remark 1).
Several times we use the following strategy to reconstruct X.
Remark 13. Suppose we know that the degree curve X is a plane curve. If in some way we identify the plane , then one camera is sufficient to reconstruct X as a scheme, because . To identify a plane M it is sufficient to know three non-collinear points of M. Thus, there is the following test to check if X is a plane curve, if we know how to produce some of its points. Take three non-collinear points of X and obtain its linear span, N. If , then X is not a plane curve. Using cameras would be sufficient to reconstruct at least three non-collinear points of X.
Remark 14. Suppose X is a degree plane curve. If , then . If and X is not the union of d lines passing through o, then is a line. If X is the union of d lines through o, then is the union of d collinear points, the line containing them being .
Remark 14 shows that it is very useful if one camera sends X to a line. No number of cameras would be sufficient if their position is “bad”, i.e., all of them map the plane to a line.
Remark 15. Take a plane curve . For any each is a line and their back-projected images would only give , information we obtained just using camera .
6.1. Using a Unique Camera to Prove That X Is a Plane Curve
Remark 16. Fix X and o with the only restriction that no line containing o is an irreducible component of X. If is a line, then X is contained in the back-projection of , which is a plane.
Proposition 4. Take o and X. Set and assume that is a smooth degree d plane curve. Then, X is contained in a plane.
Proof. Since has degree , (Remark 1), and hence, .
First, assume . If X is a conic, then it is contained in a plane. If with lines, then , and hence, is not a smooth conic.
From now on, we assume . By Remark 1, X is smooth and connected and X is isomorphic as an abstract curve to . The genus formula for degree smooth plane curves gives that X has genus . Remark 4 gives that X is a plane curve. □
6.2. Reconstructing X from Two Cameras
We assume we have such that . We assume that we know that X is a plane curve. If , then is a line and the back-projection of this line is the plane M containing X (Remark 13). Thus, to reconstruct X in this case it is sufficient to use that with any point of .
Remark 17. In Section 5, we made a practical suggestion, given the pictures of m lines in two screens. The same suggestion works for recovering a set with from its image and in two screens. We first show the case .
Remark 18. Take a smooth conic and such that . The set is the union of X and another conic . is smooth if and only if . If is smooth, to distinguish between X and we need another camera.
From now on we assume . We explain how to use and to find a finite such that , and then, use that .
Remark 19. Let be a degree plane curve. From C we obtain an equation, f, of C (Remark 5). Take homogeneous coordinates of . The set is the solution set of the system of three homogeneous degree equations with one of the partial derivatives, say , being identically zero if and only if C is a union of lines containing the point .
Remark 20. Let be an irreducible curve of degree . From C we obtain an equation, f, of C (Remark 17). Take homogeneous coordinates of . We recall that a smooth point is a flex if and only if the tangent line of C at p has order of contact at least 3
. Let denote the Hessian of f, i.e., the determinant of the symmetric matrix whose entry is the polynomial . The Hessian has degree . Since C is irreducible, is not divisible by f ([35] p. 16) (here we only need that C is not the union of d lines through one point). Since C is irreducible, the system has only finitely many solutions and the set of all solution is the union of the set and the set of all flexes of . Remark 21. Assume X is smooth, so that is a smooth degree d curve. Let A be the set of all flexes of X. Set . If , then , but for the integer a depends on the smooth degree d curve X we need to identify. Since A is the common zero of an equation of X and its Hessian, . On each , there is a set of a points of . For any let be the number of flexes of X with the flex line with order of contact s. We have . By Remark 17, to reconstruct X from and it is sufficient to observe that and that A is not formed by collinear points, which is true by the formula just given. For a general X we have , and this is the worst information we can obtain from the point of view of reconstruction.
Example 4. Take an integral singular degree plane curve X. Set and let A be the flexes of . In a screen we may distinguish between a singular point and a smooth flex. Thus, using two screens and Remark 17 we may reconstruct , and hence, X if and only if is a plane. This is not always true, but the only example we know in which is not a plane is the following curve: a cuspidal cubic curve. Now, we explain this case and show how we are able to overcome the fact that is a line and reconstruct the curve using its geometry. An irreducible cuspidal curve has a unique singular point and a unique flex. Indeed, up to a projective equivalence we may take with . Since , is the singular point of X and its smooth flex point. It is possible to reconstruct for the following reason. The cuspidal tangent line is uniquely determined by X and it does not contain the flex . Hence, from and we identify a line of and another point of not on this line, and hence, we reconstruct the plane , and hence, X. An irreducible nodal curve has one singular point and three flexes. By the theorem of Bezout, these three flexes are not contained in a line containing the node of X.
Remark 22. Let be a degree reducible curve without multiple components. The zero-locus of the Hessian curve of X contains all lines which are irreducible components of X and no other irreducible components of X. We do not see how to fully reconstruct X with two cameras not contained in the plane just with the use of the singular points and the Hessian curve only in the following two cases:
- 1.
d points through a common point;
- 2.
and X is the union of a smooth conic and of one of its tangent lines.
Question 2: Is the cuspidal plane cubic the only case among the irreducible curves for which the union of the singular points and the flexes does not span the plane? Are the two cases described in Remark 22 the only ones among the reducible plane curves?
Proposition 5. Take a plane curve such that no element of , except the identity, induces an automorphism of X. Take such that . Then, X is the only plane curve of degree contained in .
Proof. Assume the existence of another plane curve which is not a line. Since Y is not a line, , , induces an isomorphism . Since , is not the identity map, this is a contradiction. □
A general smooth plane curve of degree at least 4 has no nontrivial automorphism, and hence, we may apply Proposition 5 to this plane curve. The case shows that some assumptions are necessary.
6.3. Real Plane Curves
Now, assume that the degree d plane curve X is defined over . We take and we assume that is not a line, and hence, it has degree d. Since its real part may be finite or empty (even if X is smooth) by Proposition 1, may be larger than , but is always finite (Proposition 3). We assume that is infinite, and hence, it contains an open arc. We showed how to obtain the curve from the open arc (Remark 5). Having two different points not in we may use all suggestions from the reconstruction of . If we know , then we know .
7. Curves in a Smooth Quadric Surface and a Quadric Cone
We use this section to consider the
-reconstruction of curves of degree at most 4 (see
Section 8). However, as explained in Remark 4, this section may also be used to study the
-reconstruction of irreducible curves whose arithmetic genus is very high with respect to their degree, i.e., the next step after plane curves.
Let
Q be a smooth quadric surface defined over
. We have
and we fix homogeneous coordinates
on the first factor of
Q and homogeneous coordinates
on the second factor of
Q. Fix
. Let
denote the set of all bihomogeneous polynomials of bidegree
, i.e., the set of all
-linear combinations of the monomials
with
,
,
,
,
, and
. These monomials are linearly independent, and hence,
is a
-vector space of dimension
. The important result is that all curves
have a bidegree and that the set of all curves
of bidegree
is parametrized one to one by the projective space
(case
of Ch. V.2 in [
38]).
Now, assume that Q is defined over and that each of its two rulings is defined over . Under these assumptions we have and for all the complex conjugation acts on the vector space . For each the bihomogeneous polynomial is obtained from f, taking the complex conjugate of each coefficient of f. Thus, if and only if each coefficient of f is real, i.e., if and only if . A curve , , , is defined over if and only if a non-zero multiple of f is in . Thus, parametrizes all curves defined over and of bidegree .
Now, assume that X is defined over , i.e., , where is the complex conjugation. Since Q is the unique quadric surface containing X, , i.e., Q is a rank 4 quadric surface defined over Q. There are two types of such quadrics: either or , which is diffeomorphic to the product of two circles. The two cases are distinguished by the action of on the two rulings of . We have if and only if exchanges the two rulings of , while if and only if preserves the two rulings, i.e., it sends each line of one ruling to a line of the same ruling. Take an irreducible curve . In the first (resp., second case) (resp., . Since and , we obtain . Since , the second projection of Q induces an isomorphism . Since preserves each ruling, f is defined over , and hence, is diffeomorphic to a circle.
Let denote an irreducible quadric cone. Call o the vertex of T. Take a curve and set . Let be the multiplicity of X at o. Note that if and only if and if and only if o is a smooth point of X. All lines of T contain o and there is a pencil of lines through p. From now on we assume .
We first describe how to use Ex. V.2.9 in [
38] to describe all curves with
. First, assume
, i.e.,
. In this case,
d is even and
X is the complete intersection of
T and a degree
surface not containing
X. Now, assume
. Fix a line
. In this case,
d is odd and the curve
is the complete intersection of
T and a surface of degree
. To solve the quoted exerciseEx. V.2.9 in [
38], and hence, to prove all the claims we just gave, we need a setup which works for an arbitrary
.
Let
be a minimal desingularization of
T. The smooth surface
is one of the Hirzebruch surfaces described in Ch. V, §2 in [
38]. Set
and let
f be the class of an element of a ruling of
. We have
(Prop. 2.3 in [
38]) and we write
,
, for the line bundles on
X. We have
if and only if
and
. Assume
. The linear system
is base-point-free if and only if
(Th. V.2.17 in [
38]). The images by
of the elements of
,
, are the unions of
b lines contained in
T. Now, assume
. If
, then
is formed by the union of
h with multiplicity
and an element of
. Now, assume
. We have
. By the adjunction formula, all
have arithmetic genus
q with
. By a theorem of Bertini and Th. V.2.17 in [
38] and in general,
is smooth and (if
) it is connected. Any
without
h as a component has image
with
and degree
. Moreover,
C may be described as a single equation in a weighted projective plane. Now, assume that
T is defined over
. In this case,
. Take an irreducible
defined over
, with
X not a line, and let
be the strict transform of
X. We have
,
and
Y is obtained as the zero-locus of a single equation in a weighted projective plane. Note that if we project
X from the vertex
o we only obtain a smooth conic.
8. Curves of Degree 3 and 4
Irreducible and non-planar degree 3 space curves are the rational normal curves considered in [
17]. In the next example we consider them from the point of view of
-reconstruction.
Example 5. Let be an integral degree 3 curve not contained in a plane. It is well known that X is unique, up to a projective transformation, and that it is smooth and rational, i.e., isomorphic to , and all possible Xs are projectively equivalent. Moreover, some Xs may be defined over , all of them are projectively equivalent over and is a circle. Since 3 is a prime number and X is not contained in a plane, (not even set-theoretically), but we may reconstruct X from two cameras with a center in in the following way. Fix such that . Each is a smooth conic and is the union of and the line . If we know and , we know the line and we subtract it from .
Now, assume that X is defined over . Since 3 is odd, intersecting with a real plane gives that . Proposition 1 gives that is topologically a circle. We take and obtain that is the union of X and the real line .
The pictures one obtains projecting from are listed in Figure 2 in [17]. Note that to use the recipe in Example 5 we do not need to be clever: any choice of points and of or , , works.
Let be an integral and non-degenerate projective curve. By Remark 4 and the classification of curves on a quadric surface, the curve X is one of the following ones:
X is an elliptic curve, i.e., it is smooth and it has genus 1;
X is singular;
X is smooth and rational, i.e., it is smooth and of genus 0.
We first consider the case in which X is an elliptic curve and prove that for some . We also see that X is contained in exactly four quadric cones.
Example 6. Let be an elliptic curve. The Riemann–Roch theorem gives that X is the complete intersection of two quadric surfaces. By case 2 of the proof of Th. 1 in [32], X is contained in exactly four quadric cones, and hence, there is a set such that and if and only if and are distinct elements of A. Now, assume that X is defined over . By Proposition 1, either or is topologically a circle or is topologically the union of two disjoint circles. We claim that each of these three cases occurs for some X. For the first one, just take a general complete intersection of two quadric surfaces and with , i.e., associated to a definite quadratic form. This case is described in [39] p. 21. For the second and third cases, just take an elliptic curve C defined over , with prescribed (one or two circles) and embed it in by the complete linear system with . In the next example, we prove that every degree 4 singular and irreducible space curve is of the form for some . The general set up at the beginning of Example 7 allows us to describe which reducible Xs are complete intersections of two quadric cones. The union of a rational normal curve and one of its tangent lines is not the intersection of two quadric cones.
Example 7. Pencils of quadrics over or over are uniquely determined by their Segre symbol (§8.6.1 in [35]). See Ex. 3.1 in [40] for a full list in the case of pencils of quadrics in with, for each pencil, the associated degree 4
complete intersection. Let be an irreducible and non-degenerate degree 4
curve with at least one singular point, o. By Remark 4, o is the unique singular point of X, X has either an ordinary node or an ordinary cusp at o, X is rational, and X is the complete intersection of two quadric surfaces. To prove that X may be reconstructed by two (very particular) linear projections it is sufficient to prove that X is contained in at least two quadric cones. Since X has multiplicity 2
at o, and X is non-degenerate, is a smooth conic. Hence, X is contained in a unique quadric cone with vertex o. Up to a projective transformation of there are only two possible Xs, the one with a node at o and the one with a cusp at o. We will call the former the nodal degree 4
curve and the latter the cuspidal degree 4
curve. Thus, it is sufficient to find two pairs, and , such that is a nodal degree 4
curve, is a cuspidal degree 4
curve, and is a quadric cone containing but with vertex not equal to the singular point, , of . Fix and let C be any irreducible quadric cone with vertex p. Fix . The plane is a plane containing the line . Let denote the closed subscheme of C with as its ideal sheaf. The scheme is zero-dimensional, , and . Let denote the set of all quadric surfaces containing . The set is a projective space of dimension 6. We have and for any with , the scheme is a degree 4
connected curve of arithmetic genus 1
with a singular point at o. Each line contained in C contains o. Taking T with , which is easy, we obtain a curve containing no line. The set of all unions of two conics singular at p is parametrized by the pairs of planes containing o, and hence, they form a 4
-dimensional family. Thus, there are T such that is a degree 4
irreducible curve with o as its singular point. We saw that any such is the complete intersection of C and a quadric cone with vertex o. A general T has as a nodal degree 4
curve. For a general the curve is nodal at o. To obtain that the cuspidal degree 4
curves are complete intersection of two cones it is sufficient to observe that their pencil of quadric surfaces contains exactly two quadric cones (case 4 on p. 325 in [40]). Now, we work over and assume that X is defined over . Since o is the unique singular point of and , , i.e., . There are nodal X with (and so nothing can come from a real picture). These curves are obtained in the following way. Let be a degree 4 rational normal curve defined over and such that (such a real rational normal curve exists for all even degrees). Take . Projecting from we obtain a nodal real degree curve with its singular point as the only real point. There are two isomorphism classes as real algebraic curves of nodal degree 4 real curves X with infinite. Both types are obtained in the following way. Let be a degree 4 rational normal curve defined over and with . is topologically a circle. Fix such that and . Consider the linear projection of V from a point of . Thus, the real nodal degree 4 curve X has connected and homeomorphic to a circle with two points identified, i.e., it is homeomorphic to the union of two circles with a common point. The complex line is σ-invariant, and hence, it is defined over with homeomorphic to a circle. Since V is a rational normal curve, , and hence, . The image of V by a point of is a real nodal degree 4 curve W such that has two connected components, one of them being homeomorphic to a circle and the other one being the isolated singular point. There is a unique isomorphism class of real degree 4 cuspidal curves. They are obtained projecting V by a point of . For these curves the real part is homeomorphic to , i.e., to a circle.
The following observation is the converse part of Examples 6 and 7:
Remark 23. A pencil of quadric surfaces not having a plane as a fixed component of all its element has as its common intersection Y a degree 4
connected space curve spanning . Y is either integral (as the default X here) or the union of a line and a degree 3
rational normal curve (described in [17]) or the union of conics and lines with total degree 4
. Example 8. Let be a smooth and rational degree 4
curve. The Riemann–Roch theorem gives that X is contained in a unique quadric surface Q. By ex. V.2.9 in [38], the quadric Q is smooth. Hence, X is contained in no quadric cone. The best we can achieve with low-degree cones is to take sufficiently general and obtain that is the union of X and a finite set with each of degree 3
. Now, assume that X is defined over . By Proposition 1, either or is topologically a circle. We claim that both cases occur. Indeed, the curve X is a linear projection of a rational normal curve C of from a point o not contained in the secant variety of . Since X is defined over , C is defined over and . Moreover, we claim that the converse holds. To prove this claim it is sufficient to find rational normal curves and of defined over with and a circle, and then, take a linear projection of from a general point of . We fix real models of with and a circle (Proposition 1) and embed them in using a degree 4 σ-invariant effective divisor.
Finite Unions of Low-Degree Curves
It would be nice to extend the multiview by n cameras of the union of m lines to the case of finite unions of a prescribed number of low-degree curves, say lines, smooth conics, and rational normal curves. It is a natural assumption that with cameras we are able to distinguish between the image of a line, the image of a smooth conic, and the image of a rational normal curve. We saw that this is the case for general cameras (Theorem 4). It is a natural assumption that in each picture we may separate the lines, smooth conics, and rational normal curves.
In algebraic geometry, one usually starts with a compactification of the data, because in the compact case, i.e., the projective case, we may count the number of solutions with algebro-geometric tools. In the case of multiviews of a single line in
, this is the Grassmannian
, and the explicit way to use it to obtain the image as the first key step in [
11]. An explicit compactification of degree 3 rational normal curves is known [
41] and it was quoted in [
17]. For a single smooth conic (or a single curve of any degree) in
one option is to use the Hilbert scheme compactification. An easy method for conics is to look at pairs
, where
M is a plane and
C is a conic of
M (perhaps reducible or a double line). The set of all planes of
is isomorphic to
. Thus, this compactification is smooth and it is a fiber bundle over
with
as fibers. This compactification works well over
. If instead of conics we take degree
d plane curves, we obtain a compactification of the set of all degree
d plane curves (with the plane not fixed in
), which is a fiber bundle over
with as fibers a projective space of dimension
.
Then, we need the compactification for finite unions of
m objects, say
m conics. There are two natural compactifications, the symmetric product compactification and the Hilbert scheme compactification (
Section 6).
Then, we need to compactify the images. The best method is the Hilbert scheme. For instance, as a compactification of all unions of m distinct smooth conics we obtain the projective space of all degree homogeneous polynomials whose irreducible factors have degree at most 2.
9. Materials and Methods
All the results of this paper are given with a mathematical proof.
10. Discussion
In this paper, we consider the reconstruction of algebro-geometric curves in a projective space (real or complex) using n pin-hole cameras whose location is known. We prove several general theorem in which reconstruction is proved using only four general cameras. The objects considered here are finite union of lines, plane curves, and space curves of degree 3 and 4.
11. Conclusions
In this paper, we study the reconstruction of algebro-geometric objects (finite union of lines, plane curves, low-degree curves) using a low number of pin-hole cameras with known centers. We prove that they can be reconstructed (even over the real numbers) by four general cameras, and hence, hopefully, by four random cameras. We show that sometimes no number of badly put cameras are sufficient. We found examples over the real numbers in which, using in a bad way the algebro-geometric definitions, ghosts occur, i.e., the emptyset may have as its image a circle. We show that ghosts do not occur for general cameras. We suggest the extension of one shown here (union of
m lines using
n cameras) to the case of
m objects, e.g.,
m conics or unions of
lines,
conics, and
rational normal curves. In some cases, we see how two very particular cameras are sufficient or sufficient up to subtracting one specific line which we know will appear in the back-projection of the two images. We gave a few suggestions for further study at the end of
Section 8 and two open questions in earlier sections.