## 1.

## Introduction

In any efficient transmission system there must be visual data of low-cost transmission that enter into a prioritization protocol and are used up. The available low-cost bit streams cannot be increased. In the long run, the limited availability of these exhaustible bit streams would begin to act as a constraint on the performance of the transmission system. Within such a system, the “rent” component of profit for the transmission of visual data at present time $t$ can be defined as the difference between profit and transmission cost. It reflects the opportunity cost of transmitting a unit of visual information at time $t$ rather than conserving it for the future bit allocation. Thus, the time path of this rent has strong implications for the transmission.

Of course, the exhaustibility of bit streams with low-cost transmission could restrict the efficiency at higher bit rates.^{1, 2, 3} Hence there is a concern for this problem and understanding its implications is essential to attaining efficiency in intertemporal models of progressive transmission. In fact, the issue of depletion in low-cost bit resources forces us to think about bit allocation over time: The more we allocate low-cost visual data for transmission at this time, the less that will be available at higher bit rates. For example, assuming that the rent component received from progressive transmission would steadily decrease as the low-cost bit resource is depleted, the system should prefer to transmit data at this time over conserving them for the future. The danger is that if the trends in rent component of profit shift from declining to rising at least temporarily over time, heavy losses may be incurred in the form of foregone transmission opportunities in the future. Therefore, it would be too risky to rely on predictions of a monotonic time path of the rent component for bit resources from models that predict steadily rising rents or steadily declining rents.

Following Ref. 4, here we show the difficulty of predicting the rent component of profit. It warns us not to base long-term bit allocation decisions on extrapolations of the rent component of profit during a transitory phase of the oscillatory long-term path. For example, a progressive transmission scheme seeks the largest distortion reduction by ordering the coefficients by magnitude and transmitting the most significant bits first; whereas zero trees are used to the prediction of insignificant coefficients across scales to be efficiently represented as part of exponentially growing trees.^{5} It assumes therefore a declining rent component since the distortion reduction decreases over time and it becomes increasingly difficult to expect zero trees to occur, even though it is possible that the rent component shifts from declining to rising at least temporarily due to the complexity of the visual data.

## 2.

## Present Satisfaction Derived from Progressive Transmission over the Future

Consider a transmission system that chooses a rate of transmission at time $t$ given by bit allocation ${q}_{t}$ . This system takes as the profit ${p}_{t}\times {q}_{t}$ that would be obtained by ${q}_{t}$ at $t$ , where ${p}_{t}$ is the unit profit derived from the transmission at time $t$ .

Because, in general, most of the coding gain is at lower bit rates, an exponentially decaying factor $\mathrm{exp}(-\delta t)$ , with $\delta >0$ , will be introduced in the analysis to be able to compute the discounted value of profit from transmission at future times using higher bit rates, with $\delta $ being the discount rate. It diminishes the weight given to future profits (at higher bit rates) in the summation of the satisfaction over all the bit rates to form a total score. The smaller the weight, the larger the discount rate $\delta $ . Within this model of transmission, the center is given by this intertemporal conflict between present and future bit use and its profits.

Also, we assume that the total cost of transmission at time
$t$
is given by a twice continuously differentiable function
${C}_{t}=C({q}_{t},{z}_{t},{R}_{t})$
with
${z}_{t}$
being the cumulative bit streams transmitted by time
$t$
:
${z}_{t}={\int}_{0}^{t}{q}_{\tau}\mathrm{d}\tau $
; and
${R}_{t}$
is an index of the state of prioritization and transmission technologies at time
$t$
, with
${\stackrel{\u0307}{R}}_{t}=\mathrm{d}{R}_{t}\u2215\mathrm{d}t>0$
measuring its incremental improvement over time due to optimal exploratory activity to build a knowledge base.^{6}

For a given condition of prioritization and transmission technologies, the total transmission cost ${C}_{t}=C({q}_{t},{z}_{t},{R}_{t})$ increases with the transmission rate ${q}_{t}$ at the present time as well as the cumulative bit streams ${z}_{t}$ transmitted by time $t$ . That is, we have that ${C}_{{q}_{t}}=\partial {C}_{t}\u2215{\partial}_{{q}_{t}}>0$ and ${C}_{{z}_{t}}=\partial {C}_{t}\u2215{\partial}_{{z}_{t}}>0$ . There is also a cost-reducing effect of exploratory activity to increase the knowledge level for prioritization and transmission, and so we have that ${C}_{{R}_{t}}=\partial {C}_{t}\u2215\partial {R}_{t}<0$ .

Then, the transmission system must simultaneously determine transmission rates that balance total profit from bit allocation with transmission costs. The objective is to maximize the present value of the satisfaction (value function) derived from progressive transmission over the future

## 1

$$\mathrm{max}\phantom{\rule{0.2em}{0ex}}{\int}_{0}^{\infty}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}(-\delta t)s\left({q}_{t}\right)\mathrm{d}t$$Pontryagin’s maximum principle^{7} provides a solution to this optimization problem where the variable of control is the rate of transmission
${q}_{t}$
through which we expect to characterize the optimal transmission plan, and the variable of state is the cumulative bit streams
${z}_{t}$
transmitted by time
$t$
. Thus, we can form the Hamiltonian
$H$
of this optimization problem, using the equation of motion 2

## 4

$$H=[{p}_{t}{q}_{t}-{C}_{t}]\mathrm{exp}(-\delta t)+{\lambda}_{t}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}(-\delta t){q}_{t}.$$We can derive the necessary conditions for solving this problem and then use them to establish the behavior of the rent component of profit. The canonical equation of the Pontryagin’s maximum principle,^{7} for the control variable is
$\partial {H}_{t}\u2215\partial {q}_{t}=0$
. Hence, maximizing with respect to the control variable
${q}_{t}$
, we obtain the necessary condition

For the state and costate variables, we have the condition $\partial H\u2215\partial {z}_{t}=-\mathrm{d}\left[{\lambda}_{t}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}(-\delta t)\right]\u2215\mathrm{d}t$ . Hence, differentiating $H$ with respect to the state variable ${z}_{t}$ gives the dynamic equation for ${\lambda}_{t}$

with ${\stackrel{\u0307}{\lambda}}_{t}=\mathrm{d}{\lambda}_{t}\u2215\mathrm{d}t$ and ${C}_{{z}_{t}}=\partial {C}_{t}\u2215\partial {z}_{t}$ . The key to understanding our interpretation of optimal control theory is the shadow value ${\lambda}_{t}$ of the cumulative bit resources ${z}_{t}$ transmitted by time $t$ . The very definition of the shadow value originates from one of the relationships between the maximum principle and dynamic programming, namely, the shadow value (costate variable) ${\lambda}_{t}$ is the rate of change of the satisfaction measure (value function) with respect to the change of the cumulative bit resource ${z}_{t}$ prioritized by time $t$ (state variable). Seen from a different vantage point, $\mid {\lambda}_{t}\mid $ is just the shadow value of an unexploited unit of bit resource still available at time $t$ , or simply, the shadow value of the rent component of profit at time $t$ .For an interior optimum, ${q}_{t}\u2a7e0$ , we must have that

## 7

$$\underset{t\to \infty}{\mathrm{lim}}\phantom{\rule{0.2em}{0ex}}{\lambda}_{t}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}(-\delta t)=0,\phantom{\rule{1em}{0ex}}\text{and}\phantom{\rule{0.3em}{0ex}}0<\underset{t\to \infty}{\mathrm{lim}}\phantom{\rule{0.2em}{0ex}}{z}_{t}=\overline{z}<\infty ,$$By solving the differential equation 6, we have that

## 8

$${\lambda}_{t}=-{\int}_{t}^{\infty}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}[-\delta (\tau -t)]{C}_{{z}_{\tau}}\mathrm{d}\tau .$$Following Ref. 4, we have that, on the optimal transmission path, the profit ${p}_{t}$ for the transmission at any time should cover the marginal transmission cost ${C}_{{q}_{t}}({q}_{t},{z}_{t},{R}_{t})$ plus the shadow rent component of profit $\mid {\lambda}_{t}\mid $

## 9

$${p}_{t}={C}_{{q}_{t}}({q}_{t},{z}_{t},{R}_{t})+{\int}_{t}^{\infty}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}[-\delta (\tau -t)]{C}_{{z}_{\tau}}({q}_{\tau},{z}_{\tau},{R}_{\tau})\mathrm{d}\tau ,$$We can now examine the change of the rent component of profit and the optimal path of bit depletion for the transmission of visual data by differentiating Eq. 5 with respect to time and using Eq. 6

## 10

$$\frac{\mathrm{d}}{\mathrm{d}t}\phantom{\rule{0.2em}{0ex}}\mathrm{ln}({p}_{t}-{C}_{{q}_{t}})=\delta -\frac{{C}_{{z}_{t}}}{{\int}_{t}^{\infty}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}[-\delta (\tau -t)]{C}_{{z}_{\tau}}\mathrm{d}\tau}$$Consider that $f\left(t\right)={\int}_{t}^{\infty}\phantom{\rule{0.2em}{0ex}}\mathrm{exp}(-\delta \tau ){C}_{{z}_{\tau}}\mathrm{d}\tau $ and $g\left(t\right)=\mathrm{exp}(-\delta t)$ . From Eq. 8, it follows that

## 11

$$\underset{t\to \infty}{\mathrm{lim}}\mid {\lambda}_{t}\mid =\underset{t\to \infty}{\mathrm{lim}}\phantom{\rule{0.2em}{0ex}}\frac{f\left(t\right)}{g\left(t\right)}.$$## 12

$$\underset{t\to \infty}{\mathrm{lim}}\mid {\lambda}_{t}\mid =\frac{1}{\delta}\phantom{\rule{0.2em}{0ex}}\underset{t\to \infty}{\mathrm{lim}}\phantom{\rule{0.2em}{0ex}}{C}_{{z}_{t}}({q}_{t},{z}_{t},{R}_{t}),$$Substituting Eq. 8 into Eq. 6 and integrating by parts, it follows that

with## 3.

## Behavior of the Rent Component of Profit

From Eqs. 8, 12, 13, it is evident that the shadow rent component of profit is complex, because it depends on the shape of ${C}_{{z}_{\tau}}$ and its rate of change with time. Thus $\mid {\lambda}_{t}\mid $ can increase monotonically, monotonically decrease, remain constant, or change nonmonotically over time, depending on how the incremental cost of cumulative transmission ${C}_{{z}_{\tau}}$ varies with time, $\tau \u2a7et$ , and not the current marginal transmission cost ${C}_{{q}_{t}}$ at time $t$ . The optimal path of the rent component of profit does not need to have any particular relationship with movements in the marginal transmission cost ${C}_{{q}_{t}}$ .

If ${C}_{{z}_{\tau}}$ increases (respectively, decreases) monotonically over time, $\left({\scriptstyle \frac{\mathrm{d}}{\mathrm{d}\tau}}\right){C}_{{z}_{\tau}}>0$ (respectively, $\left({\scriptstyle \frac{\mathrm{d}}{\mathrm{d}\tau}}\right){C}_{{z}_{\tau}}<0$ ), then from Eq. 13, it follows that $\mid {\lambda}_{t}\mid $ increases (respectively, decreases) monotonically.

In the case that ${C}_{{z}_{\tau}}$ takes a nonmonotonic form, then there exists a ${\tau}^{*}>0$ such that $\left({\scriptstyle \frac{\mathrm{d}}{\mathrm{d}\tau}}\right){C}_{{z}_{\tau}^{*}}=0$ and $\left({\scriptstyle \frac{\mathrm{d}}{\mathrm{d}\tau}}\right){C}_{{z}_{\tau}}\gtrless 0$ in some interval of ${\tau}^{*}$ . From Eq. 12, and the continuity of ${\lambda}_{t}$ and ${C}_{{z}_{t}}$ on $t$ , it follows that

## 14

$$\underset{t\to \infty}{\mathrm{lim}}\phantom{\rule{0.2em}{0ex}}{\stackrel{\u0307}{C}}_{{z}_{t}}=\underset{t\to \infty}{\mathrm{lim}}\mid {\stackrel{\u0307}{\lambda}}_{t}\mid =0,$$Because some state of the art models seem to assume a declining rent component without any consideration to the behavior of the incremental cost of cumulative transmission ${C}_{{z}_{\tau}}$ , an interesting question is whether there exist special cases where the rent component of profit falls monotonically to zero regardless of the incremental cost of cumulative transmission. Effectively, assuming $\delta =0$ in the exponentially decaying factor $\mathrm{exp}(-\delta t)$ that was used to compute the discounted value of profit from transmission at future times (i.e., we do not diminish the weight given to future profits), we have that Eq. 12 reduces to

Then, since ${C}_{{z}_{\tau}}>0$ , we have thatand differentiating with respect to $t$ Thus it follows that, if we do not diminish the weight given to future profits in the summation of the satisfaction over all the bit rates to form a total score, then the rent component of profit falls monotonically to zero regardless of the shape of the incremental cost of cumulative transmission. However, in this special case, the underlying assumption (regarding the intertemporal conflict between present and future bit use and its profits) fails to note that, in general, most of the coding gain is at lower bit rates.Using Eq. 8, the path of the rent component of profit for particular definitions of the incremental cost of cumulative transmission ${C}_{{z}_{t}}$ can be seen:

1. In the case where ${C}_{{z}_{t}}$ is constant over time (i.e., ${C}_{{z}_{t}}=a$ ), substituting this in Eq. 8 and integrating yields a constant path for the rent component of profit over time $\mid {\lambda}_{t}\mid =a\u2215\delta $ .

2. But in the case where ${C}_{{z}_{t}}=a+bt+c{t}^{2}$ , the rent component of profit is obtained from the integration of Eq. 8 as $\mid {\lambda}_{t}\mid =[a\u2215\delta +b\u2215{\delta}^{2}+2c\u2215{\delta}^{3}]+[b\u2215\delta +2c\u2215{\delta}^{2}]t+[c\u2215\delta ]{t}^{2}$ , where the rent component of profit may first increase to a maximum and then decline to a minimum, or alternatively, the rent may also exhibit the reverse nonmonotonic behavior (i.e., it first declines and then increases). This illustrates the oscillatory behavior over time of the rent component of profit, depending on the incremental cost of cumulative transmission.

## 4.

## Conclusion

Under the assumption of either oscillatory or increasing behavior of rent component of profit over time, heavy losses may be incurred in the form of foregone transmission opportunities in the future if the transmission system prefers to transmit data at this time over conserving (at least a part of them) for the future. It calls for a saving rate and an accumulation of low-cost bits at the present time than would be necessary in the case of a steadily declining rent component of profit. The system would then modify the transmission condition accordingly to render it dynamically efficient over time.

## Acknowledgments

This research was sponsored by the Spanish Board for Science and Technology (CICYT) under Grant No. TIC2003-00473. The authors thank Michael Bove for suggesting improvements to the original manuscript.