bracket f left parenthesis x right parenthesis right curly bracket"/> (2.11)
That is to say, the value of x that minimizes the function f(x) + α is the same value that minimizes f(x); for this reason, it is typical to neglect the constant α in practical problems.
Example 2.3
Table 2.1 shows some examples of maximum, minimum, supreme, and infimum.
Table 2.1. Bounds of some ordered sets.
| Set | sup | max | inf | min |
|---|---|---|---|---|
| Ω1 = {1, 2, 3, 4} | 4 | 4 | 1 | 1 |
Ω2 = {x ∈  |
2 | 2 | 1 | 1 |
|
Ω3 = {x ∈ |
8 | 8 | 3 | - |
|
Ω4 = {x ∈ |
9 | - | 2 | 2 |
|
Ω5 = {x ∈ |
7 | - | 4 | - |
2.2 Norms
In many practical problems, we may be interested in measuring the objects in a set, either as an objective function or as a way of analyzing solutions. A norm is a geometric concept that allows us to make this measurement. The most common norm is the Euclidean distance given by (Equation 2.12)
However, this function is not the only way to measure a distance. In general, we can define a norm as a function ‖⋅‖:Ω→R that fulfills the following conditions:
The first two conditions indicate that a norm must return a positive value, except when the input is the vector 0→ The third condition indicates that it is scalable; for example, the norm must be twice the original vector’s norm if we multiply all the vector entries by 2. The last condition, known as the triangle inequality, is a generalization of the triangles’ property (therein lies its name). The sum of any two sides’ lengths is greater (or equal) to the remaining side’s length. This property is intuitive for the Euclidean norm, but surprisingly it is general for many other functions, such as (Equation 2.17):
This function is known as p-norm, where p ≥ 1. Three of the most common examples of p-norms in Rnn have a well-defined representation, as presented below:
The Euclidean distance is equivalent to a 2-norm whereas 1-norm, also known as Manhattan distance, consists in measuring the distance along axes at right angles (see Figure 2.2b), and infinity-norm
