The Laplace and Z-Transformations
Two-sided and one-sided Laplace and Z-transforms. Properties: linearity, convolution, shift, differentiation, scaling. Initial and final value theorems. Inverse transforms, systems analysis, causality, stability, and minimum-phase systems.
Why Laplace and Z-Transforms?
The Fourier transform is a powerful tool, but it has a fundamental limitation: it requires the signal to be square-integrable (finite energy). Many signals we encounter in practice -- exponentially growing signals in unstable systems, ramp signals, even simple step functions -- fail this requirement. Their Fourier transforms simply do not exist.
The Laplace transform fixes this by a clever trick: before taking the Fourier transform, multiply the signal by a decaying exponential . If is large enough, the product decays fast enough for the Fourier integral to converge. In other words:
So the Laplace transform is really just the Fourier transform with a damping factor built in. The complex variable packages both pieces together:
- -- the damping/convergence factor, controlling how aggressively we attenuate the signal before analyzing it
- -- the frequency, exactly as in the Fourier transform
The Z-transform plays the same role for discrete-time signals. The complex variable separates into:
- -- the damping factor (analogous to )
- -- the frequency, exactly as in the DCFT
This is why the Fourier transform is a special case of both:
- Laplace: set (no damping), so , and you recover the CCFT. Geometrically, this means evaluating along the imaginary axis.
- Z-transform: set (no damping), so , and you recover the DCFT. Geometrically, this means evaluating on the unit circle.
The extra freedom in choosing or is what lets these transforms handle a much broader class of signals -- but it also means we must keep track of which values of or make the integral/sum converge. This is the region of convergence (ROC), a concept that has no analogue in Fourier analysis and which will be central to everything that follows.
Introduction
The powerful tools of Fourier transforms do not directly generalize to signals which are not square integrable. Laplace and Z-transforms allow for the generalization of the machinery developed for Fourier transformable signals to a more general class of signals. For example, applications in control systems often require the design of control policies/laws which may turn an open-loop unstable system into a stable system; for studying such unstable signals it is essential to expand the class of signals which can be studied using frequency domain methods. Furthermore, one-sided Laplace and Z-transforms will be seen to be useful in studying systems which have non-zero initial conditions.
The Laplace transform generalizes the CCFT and the Z-transform generalizes the DCFT: If a signal is is not in , may be in for some . Likewise, if a signal is is not in , may be in for some . The Fourier transforms of these scaled signals correspond to the Laplace and the Z-transforms of .
A signal is said to be of at-most-exponential growth if there exist real numbers with for some . For such signals, the Laplace transform will be defined for certain parameter values. A similar discussion applies for the Z-transform such that if for some , the Z-transform will be defined for a range of values.
Understanding the Region of Convergence (ROC) in plain English:
- The ROC tells you for which values of (or ) the integral/sum actually converges to a finite number. Outside the ROC, the transform is infinite and meaningless.
- Different ROCs for the same correspond to different time-domain signals. For example, is the Laplace transform of when , but it is also the transform of when . The formula is the same; the ROC tells you which signal you have.
- For causal signals (zero for or ): the ROC is a right half-plane for Laplace, or the exterior of a circle for the Z-transform.
- For BIBO stability: the ROC must include the imaginary axis (Laplace) or the unit circle (Z-transform). This is because stability requires the Fourier transform to exist, and Fourier is the special case on those curves.
The Two-sided Laplace Transform
The two-sided Laplace transform of a continuous-time signal is defined through the pointwise relation:
with
The set is called the region of convergence (ROC).
What each part does:
- -- the original time-domain signal
- -- two factors combined: is a real exponential that "damps" the signal (making divergent signals convergent), and is the Fourier "frequency detector"
- -- integrate over all time to accumulate the contribution at each combination of damping rate and frequency
- -- the result is a function of the complex variable . Each value of probes a different combination of damping rate and frequency
- The Fourier transform is the special case , i.e., evaluating along the imaginary axis
The Two-sided Z-Transform
The two-sided Z-transform of a discrete-time signal is defined through the pointwise relation:
with
The set is called the region of convergence (ROC).
What each part does:
- -- the original discrete-time signal
- -- two factors combined: damps or grows the signal (controlling convergence, just as does for Laplace), and is the Fourier "frequency detector"
- -- sum over all time indices to accumulate each sample's contribution
- -- the result is a function of the complex variable . The magnitude controls the damping, and the angle selects the frequency
- The DCFT (Fourier) is the special case , i.e., evaluating on the unit circle
The One-sided Laplace Transform
The one-sided Laplace transform of a continuous-time signal is defined through the pointwise relation:
with
The set is called the region of convergence (ROC).
One-sided vs. two-sided: The one-sided Laplace transform only integrates over . This is equivalent to applying the two-sided transform to . The key advantage is that it naturally handles initial conditions -- when you apply the differentiation property, the boundary term appears explicitly, which is exactly what you need for solving differential equations with given initial values.
The One-sided Z-Transform
The one-sided Z-transform of a discrete-time signal is defined through the pointwise relation:
with
The set is called the region of convergence (ROC).
One-sided vs. two-sided: The one-sided Z-transform only sums over . Just as with the one-sided Laplace transform, the key advantage is in handling initial conditions for difference equations. When you apply the shift property, terms like appear explicitly, giving you the mechanism to incorporate initial values into the frequency-domain solution.
Properties
Linearity
Provided that is in the ROC for both of the signals and :
This property applies for the other transforms as well.
Convolution
Provided that is in the ROC for both of the signals and :
This property applies for the other transforms as well.
Shift Property
Z-transform (two-sided). Let , then
One-sided Z-transform. For the one-sided transform, let . Then,
The general case for can be computed accordingly. For example, let , then
Laplace transform (two-sided). Likewise, let . Then,
One-sided Laplace transform. For the one-sided transform, let . Then,
Converse Shift Property
Z-transform. Let , then
provided that for .
Laplace transform. Let , then
provided that for .
Differentiation Property (in time domain)
Let denote (assumed to exist), and let for some and that . Then,
for .
Converse Differentiation
Z-transform. Suppose that for some . This implies that is in the ROC. To see this one should note that for every , there exists such that for we have . Then, take to be less than for any given .
Now, let . Then,
for .
Laplace transform. The derivative rule for the Laplace transforms follows from a similar reasoning. Let for some . Let . Then, for with , we have
Note that for , a more subtle argument is needed for pushing the derivative inside the integration in via applying Theorem A.2.1 to imaginary and real parts of an exponential separately. For the Z and Laplace transforms above, we are using the liberty of the region of convergence being outside the critical curves/lines (as in ).
Scaling
If , then
provided that for .
Initial Value Theorem
Discrete-time. Let for all and for some . Then,
for .
Continuous-time. Let and for all and for some . Then,
for . The proof of this result follows from the differentiation property (in time domain) and an application of the dominated convergence theorem (see Theorem A.1.5) if or the Riemann-Lebesgue Lemma (see Theorem) if but the real part does not converge to infinity.
Final Value Theorem
Continuous-time. If , then
We note that we can relax the above to:
To be able to apply the Final Value Theorem, it is important to ensure that the finiteness condition, , holds. Note that if we have that all poles of are in the left half plane, this ensures that exists and is finite.
Discrete-time. For a discrete-time signal, if , then
The proof follows from the same arguments used in the proof above for the Laplace setup. Once again, note that if we have that all poles of are strictly inside the unit circle, then exists and is finite.
Key Properties Reference
This section collects the most important transform properties side by side for quick reference. For each property, we give the Laplace and Z-transform versions, a plain-English description, and when you would typically use it.
Linearity:
- Laplace:
- Z-transform:
- Meaning: The transform of a sum is the sum of the transforms; scaling passes through unchanged.
- Use when: You have a signal that is a weighted combination of simpler signals whose transforms you already know.
Convolution:
- Laplace:
- Z-transform:
- Meaning: Convolution in time becomes multiplication in the transform domain. This is the single most powerful property -- it turns the hardest operation in time (convolution) into the easiest operation in frequency (multiplication).
- Use when: Computing the output of an LTI system (output = input convolved with impulse response).
Time Shift:
- Laplace (two-sided):
- Z-transform (two-sided):
- Meaning: A time delay in the signal just multiplies the transform by a complex exponential. Delays are trivial to handle in the transform domain.
- Use when: You see a time-delayed version of a known signal, or when modeling transport delays in a system.
Converse Shift (Frequency/Exponential Shift):
- Laplace:
- Z-transform:
- Meaning: Multiplying a signal by an exponential in time shifts the transform in the complex plane.
- Use when: You have a known transform but the signal is modulated by an exponential (e.g., a damped sinusoid).
Differentiation in Time:
- Laplace (two-sided):
- Laplace (one-sided):
- Meaning: Differentiation in time becomes multiplication by . The one-sided version also picks up the initial condition .
- Use when: Solving differential equations -- each derivative becomes a power of , turning the ODE into an algebraic equation.
Converse Differentiation (Differentiation in or ):
- Laplace:
- Z-transform:
- Meaning: Multiplying a signal by (or ) in time corresponds to differentiating its transform.
- Use when: You need the transform of or , which arises in computing moments or when partial fractions have repeated roots.
Scaling (Laplace only):
- Laplace:
- Meaning: Compressing a signal in time stretches its transform in frequency (and vice versa). This is the continuous-time time-frequency duality.
- Use when: You know the transform of a signal and need the transform of a time-scaled version.
Initial Value Theorem:
- Laplace:
- Z-transform:
- Meaning: You can read off the initial value of a signal directly from its transform without inverting.
- Use when: You want a quick sanity check on a computed transform, or you need but only have or .
Final Value Theorem:
- Laplace: (provided the limit exists)
- Z-transform: (provided the limit exists)
- Meaning: You can find the steady-state value of a signal directly from its transform. Caution: this only works if (or ) actually converges to a finite limit. Check that all poles of are in the left half-plane (Laplace) or that all poles of are strictly inside the unit circle (Z-transform).
- Use when: Determining the steady-state output of a stable system without computing the full inverse transform.
Computing the Inverse Transforms
There are usually three methods that can be applied depending on a particular problem.
Method 1: Partial Fraction Expansion. One is through the partial fraction expansion and using the properties of the transforms. Typically, for linear systems, this is the most direct approach. All is required is to know that
with and
with , together with the properties we discussed above. One needs to pay particular attention to the regions of convergence: for example both of the signals and have their Laplace transforms as , but the first one is defined for and the second one for .
Compute the inverse transform of where the region of convergence is defined to be . You may want to first write .
Method 2: Power/Laurent Series Expansion. A second method is to try to expand the transforms using power series (Laurent series) and match the components in the series with the signal itself.
Method 3: Contour Integration. The most general method is to compute a contour integration along the unit circle or the imaginary line of a scaled signal. In this case, for Z-transforms:
where the contour integral is taken along a circle in the region of convergence in a counter-clockwise fashion. For the Laplace transform:
where the integral is taken along the line which is in the region of convergence. Cauchy's Integral Formula (see Theorem B.0.2) may be employed to obtain solutions.
However, for applications considered in this course, the partial fraction expansion is the most direct approach.
Systems Analysis using the Laplace and the Z Transforms
For a given convolution system, the property that if is an input, is the impulse response and the output
leads to the fact that
Likewise,
leads to the fact that
As with the complex harmonics, for a continuous-time convolution system with input , the output equals provided that is well-defined. Likewise, for a discrete-time system with input , the output equals provided that is well-defined. In view of this, above is called the transfer function of the convolution system with impulse response (and thus generalizes frequency response introduced earlier).
From these relationships, often one can often compute the transfer functions directly.
Let a convolution system (which defines a moving-average system) be defined with the relation
Show that
by considering as the input.
Besides being able to compute the impulse response and transfer functions for such systems, we can obtain useful properties of a convolution system through the use of Laplace and Z transforms.
Causality, Stability and Minimum-Phase Systems
Recall that a convolution system is causal if for . This implies that if is in the region of convergence, so is for any . Therefore, the region of convergence must contain the entire area outside some circle if it is non-empty.
Recall that a convolution system is BIBO stable if and only if , which implies that must be in the region of convergence.
In particular, let and be polynomials in . Let the transfer function of a discrete-time LTI system be given by
This system is stable and causal if and only if: the degree of is less than or equal to the degree of and all poles of (that is, the zeros of which do not cancel with the zeros of ) are inside the unit circle.
Therefore, a discrete-time causal convolution system of the form noted above is BIBO stable if and only if the region of convergence is of the form for some .
A similar discussion applies for continuous-time systems: Such a system is causal if for . Therefore, whenever the region of convergence includes , then is also in the region of convergence.
Such a system is BIBO stable if and only if which then implies that the imaginary axis is in the region of convergence. Thus, if and are polynomials in and the transfer function of a continuous-time LTI system be given by
this system is stable if poles of are in the left-half plane.
Therefore, a continuous-time system is BIBO stable and causal if the region of convergence is of the form for some .
A practically important property of stable and causal convolution systems is whether the inverse of the transfer function is realizable through also a causal and stable system: Such systems are called minimum-phase systems. Thus, a system is minimum-phase if all of its zeros and poles are inside the unit circle. A similar discussion applies for continuous-time systems, all the poles and zeros in this case belong to the left-half plane.
Such systems are called minimum phase since every rational system transfer function can be written as a product of a minimum phase system transfer function and a transfer function which has unit magnitude for , but which has a larger (positive) phase change as the frequency is varied. To make this more concrete, consider
This system is not minimum-phase. Now, write this system as:
Here, is minimum-phase. is so that its magnitude on the imaginary axis is always 1. However, this term contributes to a positive phase. This can be observed by plotting the Bode diagram, as for small values, the signal has a phase close to which gradually decays to zero.
This phase is associated with delay: To observe this added delay consider the following: Write , and observe that the inverse Laplace of this term is the Dirac delta impulse minus the effect of the inverse Laplace of ; this latter term is or in terms of a linear system it is the solution of a causal system with input whose output is (or generally for appropriate matrices ): This term adds a delayed response compared with the effect of the Dirac delta impulse.
Yet, another interpretation is the following: Let . One has the approximation
for small values through expanding the exponential term. By our analysis earlier in , a negative complex exponential in the Laplace transform contributes to a positive time delay. The approximation above is known as a first-order Pade approximation.
Thus, non-minimum-phase systems have higher delay properties in their impulse responses compared to minimum-phase systems.
Initial Value Problems using the Laplace and Z Transforms
The one-sided Laplace and Z transforms are very useful in finding solutions to differential equations or difference equations with initial conditions.
Exercises
a) Compute the (two-sided) Z-transform of
Note that you should find the Region of Convergence as well.
b) Compute the (two-sided) Laplace-transform of
Find the regions in the complex plane, where the transforms are finite valued.
c) Show that the one-sided Laplace transform of satisfies
d) Compute the inverse Laplace transform of
Hint: Use partial fraction expansion and the properties of the derivative of a Laplace transform.
Find the inverse Z-transform of:
Let and be polynomials in . Let the transfer function of a discrete-time LTI system be given by
a) Suppose the system is BIBO stable. Show that the system is causal (non-anticipative) if and only if is a proper fraction (that is the degree of the polynomial in the numerator cannot be greater than the one of the denominator).
b) Show that the system is BIBO stable if and only if the Region of Convergence of the transfer function contains the unit circle. Thus, for a system to be both causal and stable, what are the conditions on the roots of ?
Let a system be described by:
a) Is this system non-anticipative? Bounded-input-bounded-output (BIBO) stable?
b) Compute the transfer function of this system.
c) Compute the impulse response of the system.
d) Compute the output when the input is
Let a system be described by:
a) Is this system non-anticipative? Bounded-input-bounded-output (BIBO) stable?
b) Compute the transfer function of this system.
c) Compute the impulse response of the system.
d) Compute the output when the input is
a) Let . Given that represents the transfer function (Z-transform of the impulse response) of a causal filter, find .
b) Find the solution to the following sequence of equations:
with initial conditions:
That is, find .