Hostname: page-component-745bb68f8f-mzp66 Total loading time: 0 Render date: 2025-02-05T19:59:46.838Z Has data issue: false hasContentIssue false

SOJOURN TIMES IN THE M/G/1 FB QUEUE WITH LIGHT-TAILED SERVICE TIMES

Published online by Cambridge University Press:  22 June 2005

M. Mandjes
Affiliation:
CWI, Amsterdam, The Netherlands, and, KdV Institute for Mathematics, University of Amsterdam, Amsterdam, The Netherlands, E-mail: michel.mandjes@cwi.nl
M. Nuyens
Affiliation:
Department of Mathematics, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands, E-mail: mnuyens@few.vu.nl
Rights & Permissions [Opens in a new window]

Abstract

The asymptotic decay rate of the sojourn time of a customer in the stationary M/G/1 queue under the foreground–background (FB) service discipline is studied. The FB discipline gives service to those customers that have received the least service so far. We prove that for light-tailed service times, the decay rate of the sojourn time is equal to the decay rate of the busy period. It is shown that FB minimizes the decay rate in the class of work-conserving disciplines.

Type
Research Article
Copyright
© 2005 Cambridge University Press

1. INTRODUCTION

The sojourn time of a customer (i.e., the time between his arrival and departure) is an often used performance measure for queues. In this article, we compute the asymptotic decay rate of the tail of the sojourn-time distribution of the stationary M/G/1 queue with the foreground–background (FB) discipline. This decay rate is then used to compare the performance of FB with other service disciplines like processor-sharing (PS) and first-in first-out (FIFO).

The FB discipline gives service to those customers who have received the least amount of service so far. If there are n such customers, each of them is served at rate 1/n. Thus, when the age of a customer is the amount of service a customer has received, the FB discipline gives priority to the youngest customers. In the literature, this discipline has been called LAS or LAST (least-attained service time first) as well.

Let V denote the sojourn time of a customer in the stationary M/G/1 FB queue. Núñez Queija [6] showed that for service-time distributions with regularly varying tails of index η ∈ (1,2), the distribution of V satisfies

where ρ is the load of the system, B is the generic service time, and ∼ means that the quotient converges to 1. Using Núñez Queija's method, Nuyens [7] obtained (1) under weaker assumptions. In the case of regularly varying service times, the tail of V under the disciplines last-in first-out (LIFO), PS, and shortest remaining processor time (SRPT) satisfies relations similar to (1). For nonpreemptive disciplines however, like FIFO, it is heavier than the tail of B; see Borst, Boxma, Núñez Queija, and Zwart [1].

Additional support for the effective performance of FB under heavy tails is given by Righter [8], Righter and Shanthikumar [9], and Righter, Shanthikumar, and Yamazaki [10]. They show that for certain classes of service times (including, e.g., the Pareto distribution), the FB discipline minimizes the queue length, measured in number of customers, in the class of all disciplines that do not know the exact value of the service times.

For light-tailed service times, the FB discipline does not perform as well, although for gamma densities λαxα−1 exp(−λx)/Γ(α) with 0 < α ≤ 1, FB still minimizes the queue length, and for exponential service times, the queue length is independent of the service discipline. However, for many other light-tailed service times (e.g., those with a decreasing failure rate), the queue shows opposite behavior and the queue length is maximized by FB (see Righter and colleagues [8,9,10]). This undesirable behavior of the FB discipline is very pronounced for deterministic service times. In this extreme case in the FB queue, all customers stay until the end of the busy period, and the sojourn time under the FB discipline is maximal in the class of all work-conserving disciplines.

In this article, we consider the (asymptotic) decay rate of the sojourn time, where the (asymptotic) decay rate dr(X) of a random variable X is defined as

given that the limit exists. Hence, a larger decay rate means a smaller probability that the random variable takes on very large values. In this sense, sojourn times are better when they have larger decay rates.

Assume that the service times for an M/G/1 queue have a finite exponential moment or, equivalently, the Laplace transform is analytic in a neighborhood of zero. In other words, the tail of the service-time distribution decreases exponentially. Our main result is that for the M/G/1 FB queue under the light-tailed assumption, large sojourn times are relatively likely.

Theorem 1: Let V be the sojourn time of a customer in the stationary M/G/1 FB queue and let L be the length of a busy period. If the service-time distribution has a finite exponential moment, then the decay rate of V exists and satisfies

It is shown later that the decay rate of the sojourn time in an M/G/1 queue with any work-conserving discipline is bounded from below by the decay rate of the residual life of a busy period. For service times with an exponential moment, the decay rates for normal and residual busy periods are equal. Hence, (2) is the lowest possible decay rate for the sojourn time under a work-conserving discipline. Using the decay rate of V as a criterion to measure the performance of a service discipline then leads to the following conclusion: For service times with an exponential moment, the FB discipline is the worst discipline in the class of work-conserving disciplines.

The article is organized as follows. In Section 2, we present the notation, some preliminaries, and prove the lower bound for the decay rate of the sojourn time under any work-conserving discipline. In Section 3, Theorem 1 is proved. Section 4 discusses the result and the decay rate of the sojourn time in queues operating under several other service disciplines.

2. PRELIMINARIES

Throughout this article, we assume that the generic service time B with distribution function F in the M/G/1 queue satisfies the following assumption.

Assumption 1: The generic service time B has an exponential moment (i.e., E exp(γB) < ∞ for some γ > 0).

In addition, let the stability condition ρ = λEB < 1 hold, where λ is the rate of the Poisson arrival process. The proofs in this article rely on some properties of the busy-period length L and related random variables, which we derive in this section.

Under Assumption 1, Cox and Smith [3] have shown that P(L > x) ∼ bx−3/2ecx for certain constants b,c > 0. In particular, L has decay rate c. In fact, by expression (46) in Cox and Smith [3, p.154], c = λ − ζ − λg(ζ), where g is the Laplace transform of the service-time distribution and ζ < 0 is such that g′(ζ) = −λ−1. Hence, ζ is the root of the derivative of the function m(x) = λ − x − λg(x). Since m(x) attains its maximum at the point ζ, we can write c in terms of the Legendre transform of B:

Remark: This expression shows up as well in the following context. Consider a Poisson stream, with intensity λ, of independent and identically distributed (i.i.d.) jobs, where every job is distributed according to the random variable B. Let A(x) denote the amount of work generated in an arbitrary time window of length x. It is an easy corollary of Cramér's theorem that

Noting that

we observe that P(L > x) and P(A(x) > x) have the same decay rate. This is somewhat surprising, as {A(x) > x} obviously depends just on A(x) (i.e., the amount of traffic in a window of length x), whereas {L > x} depends on A(y) for all y ∈ [0,x], due to

Here, B1 is the first service time in the busy period L.

In renewal theory, the notion of residual life, also known as excess or forward-recurrence time, is standard. Let

be the residual life of a busy period. Then

; see, for instance, Cox [2]. Using standard calculus, we find

Hence,

has the same decay rate as L.

Another ingredient used in the proofs below is the M/G/1 queue with truncated generic service time B ∧ τ, τ > 0. Call this the τ-queue and let L(τ) denote the length of a busy period (a τ-busy period) in this queue. Let

be its residual life and define L*(τ) to be the length of a τ-busy period in which the first service time B1 is at least τ; that is,

We now show that the random variables

have the same decay rate.

Lemma 2: Let τ > 0 be such that P(B ≥ τ) > 0. Then

Proof: We show that L and L* have the same decay rate. The proof is then completed by using (5). Assume that τ > 0 is such that P(B ≥ τ) > 0. If B1 ≥ τ, then the first service time is maximal in the τ-queue, as all service times are bounded by τ. Hence,

Further,

From (6), it follows that P(L*(τ) > x) and P(L(τ) ≥ x) differ only by a factor independent of x. Hence,

. █

In this article, we need the following lemma about the decay rate of the sum of two independent random variables.

Lemma 3: Let X and Y be nonnegative, independent random variables such that dr(X) = α1 and dr(Y) = α2 for some α12 > 0. Then dr(X + Y) = min12}.

Proof: Since both X and Y are positive, −min{α12} is clearly a lower bound for lim infx→∞ x−1 log P(X + Y > x). For the upper bound, let

be fixed. Then,

For x sufficiently large, for all i ∈ {0,…,n − 1},

Hence,

Since (7) holds for every

, we can take the limits n → ∞ and ε ↓ 0, and the result follows. █

Let D be the time from the arrival of a customer until the first moment that the system is empty. The following proposition is valid even when Assumption 1 does not hold.

Proposition 4: Consider a stationary queue with an arbitrary service-time distribution, Poisson arrivals, and a work-conserving discipline. Then

, where P(A = 1) = ρ = 1 − P(A = 0) and

are independent.

Proof: The value of the random variable D does not depend on the service discipline. There are two possibilities. With probability 1 − ρ, the customer finds the system empty. In this case, D is just the length L of the busy period started by the customer. Second, if our customer enters a busy system, then the server can first finish all the work in the system apart from the work of our tagged customer. The moment the remainder of the original busy period, which has length

, is finished, our customer starts a subbusy period. This length of this subbusy period, which is independent of

, is distributed like L. █

For the stationary τ-queue with Poisson arrivals and a work-conserving discipline, we have the following corollary.

Corollary 5: In the stationary τ-queue, the random variable D satisfies

, where P(A(τ) = 1) = λE(B ∧ τ). If the customer has service time τ in the τ-queue, then

.

Since the system is work-conserving, the sojourn time of a customer is not longer than D. Hence, Vst D for every service discipline. Since

satisfy the conditions of Lemma 3, the following corollary holds.

Corollary 6: For every work-conserving service discipline, the sojourn time V of a customer in the stationary queue satisfies

An immediate consequence of this corollary and Theorem 1, which will be proved in the next section, is the following.

Corollary 7: The FB discipline minimizes the decay rate of the sojourn time in the class of work-conserving disciplines.

In Section 4, we indicate that for service times with a finite exponential moment, there are disciplines with a strictly larger decay rate than FB (e.g., FIFO).

Interestingly, for service times with certain Gamma distributions, the FB discipline stochastically minimizes the queue length, as was mentioned in Section 1, but the sojourn time has the smallest decay rate. This shows that optimizing one characteristic in a queue could have an ill effect on other characteristics.

The existence of a finite exponential moment in the corollary is crucial: For heavy-tailed service times, the tail of V cannot be bounded by that of L. For example, in the M/G/1 FIFO queue with service times satisfying

, where

is a slowly varying function at ∞ and ν > 1, De Meyer and Teugels [4] showed that

It may be seen that in this case, the tail of

, the residual life of the generic service time B, is one degree heavier than that of B. Now, note that for the FIFO discipline, we have

. Hence, the tail of V is at least one degree heavier than that of L; see also Borst et al. [1] for further references. In the light-tailed case, this phenomenon is absent because the tails of

have the same decay rate.

3. PROOF OF THE THEOREM

In this section, Theorem 1 is proved. The results in this section rely on the following decomposition of V. Let V(τ) be the sojourn time in the stationary M/G/1 queue of a customer with service time τ. The sojourn time V of an arbitrary customer in the stationary queue satisfies

Here, F is the service-time distribution. Hence, we may write P(V > x) = EB P(V(B) > x), where B is a generic service time independent of V(τ), and EB denotes the expectation w.r.t. B. Theorem 1 is proved using this representation of V. In Proposition 8, we compute the decay rate of V(τ).

Proposition 8: Let τ > 0 be such that P(B ≥ τ) > 0. If the service-time distribution satisfies Assumption 1, then dr(V(τ)) = dr(L(τ)).

Proof: By the nature of the FB discipline, the sojourn time V(τ) of a customer with service time τ who enters a stationary queue is the time until the first epoch that no customers younger than τ are present. This is the time until the end of the τ-busy period that he either finds in the τ-queue, or starts. By Corollary 5, V(τ) then satisfies

where

is the residual life of a τ-busy period, L*(τ) is a τ-busy period that starts with a customer with service time τ,

and

are independent. By Lemma 2, the random variables

satisfy the condition of Lemma 3. From (9) and Lemma 2, it follows that

This completes the proof. █

Having found the lower bound for the decay rate in Corollary 6, the following lemma provides the basis for finding the upper bound. The endpoint xF ∈ [0,∞] of the service-time distribution F is defined as xF = inf{u ≥ 0 : F(u) = 1}.

Lemma 9: Let V be the sojourn time of a customer in the stationary M/G/1 FB queue. Suppose the service-time distribution satisfies Assumption 1. If τ0 > 0 and P(B ≥ τ0) > 0, then

Here, F is the distribution function of the generic service time B.

Proof: We have

Using the representation (8), we find

Since log x is a concave function, applying Jensen's inequality to the conditional expectation in (13) yields

From (12)–(14), it follows that Θ := lim infx→∞(1/x)log P(V > x) satisfies

Applying Fatou's lemma to (15) yields

The result now follows from Proposition 8. █

The following lemma is used to develop the upper bound for the decay rate of V from Lemma 9. We introduce the notation c(τ) = dr(L(τ)), so that c = dr(L) = c(xF).

Lemma 10: The function c(τ) is decreasing in τ. Furthermore, c(τ) → c(xF) as τ → xF.

Proof: For all τ, the function hτ(θ) = θ − λ(Eeθ(B∧τ) − 1) is concave in θ, since any moment generating function is convex. Furthermore, limθ→−∞ hτ(θ) = limθ→∞ hτ(θ) = −∞. By definition of L(τ) and (3), we can write c(τ) = supθ{hτ(θ)}. Then c(τ) is decreasing in τ, since hτ(θ) is decreasing in τ. Since c(τ) ≥ hτ(0) = 0 for all τ and c(τ) is decreasing, c(τ) converges for τ → xF. Now, note that hτ(θ) is continuous in τ for all θ ∈ [0,sup{η : EeηB < ∞}), even if B has a discrete distribution. Since the supremum of θ − λ(EeθB − 1) is attained in this interval, we have limτ→xF c(τ) = c(xF). █

Proposition 11: Let V be the sojourn time of a customer in the stationary M/G/1 FB queue. If the service-time distribution satisfies Assumption 1, then

Proof: If P(B = xF) > 0, then choosing τ0 = xF in (11) yields

and (16) holds. Assume P(B = xF) = 0 and let ε > 0. By Lemma 10, there exists an xε < xF such that c(τ) ≤ c + ε for all τ ≥ xε. Choosing τ0 = xε in (11) then yields

Since ε > 0 was arbitrary, the lower bound (16) follows. █

Proof of Theorem 1: The lower bound for dr(V) is established in Corollary 6, and the upper bound in Proposition 11. █

4. DISCUSSION

The decay rate of the sojourn time V in the M/G/1 FB queue is the same as for the preemptive LIFO queue. Indeed, the sojourn time of a customer in the stationary M/G/1 queue under the preemptive LIFO discipline is just the length of the subbusy period started by that customer. From Theorem 1, it follows that the decay rates of the sojourn times for LIFO and FB are equal.

The sojourn time of a customer in the stationary queue under FIFO satisfies VFIFO = B + W, where W is the stationary workload. From the Pollaczek–Khinchin formula,

it follows that the decay rate of W is the value of s for which the denominator in (17) vanishes. Hence, dr(W) is the positive root θ0 of h(θ) = θ − λ(EeθB − 1). Furthermore, since dr(B) = inf{θ : h(θ) = −∞}, we have θ0 < dr(B) ≤ ∞. An analog of Lemma 3 then yields that cFIFO := dr(VFIFO) = θ0.

Since h is concave, h(0) = 0, and h′(0) = 1 − λEB < 1, we have by Theorem 1 and (3) that

see also Figure 1. Hence, in the FIFO system, the decay rate of the sojourn time is strictly larger than that in the FB queue. As an illustration, consider the M/M/1 queue in which the service times have expectation 1/μ. For stability, we assume λ < μ. Straightforward computations then yield that

. Since λ < μ, we conclude that for the M/M/1 queue, inequality (18) is satisfied.

The decay rates of the sojourn time under FB and FIFO.

Finally, Mandjes and Zwart [5] consider the PS queue with light-tailed service requests. They show that the decay rate of VPS is equal to dr(L) as well, under the additional requirement that, for any positive constant k,

For deterministic requests, clearly this criterion is not met. Indeed, in [5], it is shown that the decay rate of V in the M/D/1 queue with the PS discipline is larger than dr(L).

Acknowledgments

The authors thank A. P. Zwart for kindly commenting on an earlier version of the article and the referee for his clear suggestions and comments, which have seriously improved the presentation of the article. M. Nuyens research was done while he was at the KdV Institute for Mathematics, University of Amsterdam.

References

REFERENCES

Borst, S., Boxma, O., Núñez Queija, R., & Zwart, A. (2003). The impact of the service discipline on delay asymptotics. Performance Evaluation 54: 175206.Google Scholar
Cox, D. (1962). Renewal theory. London: Methuen.
Cox, D. & Smith, W. (1961). Queues. London: Methuen.
De Meyer, A. & Teugels, J. (1980). On the asymptotic behaviour of the distributions of the busy period and service time in M/G/1. Journal of Applied Probability 17(3): 802813.Google Scholar
Mandjes, M. & Zwart, A. Large deviations for waiting times in processor sharing queues (submitted).
Núñez Queija, R. (2000). Processor-sharing models for integrated-services networks. Ph.D. thesis, Eindhoven University, Eindhoven, The Netherlands.
Nuyens, M. (2004). The foreground–background queue. Ph.D. thesis, University of Amsterdam, Amsterdam.
Righter, R. (1994). Scheduling. In M. Shaked and J. Shanthikumar (eds.), Stochastic orders and their applications. San Diego, CA: Academic Press.
Righter, R. & Shanthikumar, J. (1989). Scheduling multiclass single server queueing systems to stochastically maximize the number of successful departures. Probability in the Engineering and Informational Sciences 3: 323333.Google Scholar
Righter, R., Shanthikumar, J., & Yamazaki, G. (1990). On extremal service disciplines in single-stage queueing systems. Journal of Applied Probability 27: 409416.Google Scholar
Figure 0

The decay rates of the sojourn time under FB and FIFO.