John N. Tsitsiklis – publications
Book chapters

Error Exponents for Decentralized Detection in Tree Networks. W. P. Tay and J. N. Tsitsiklis;
in Networked Sensing Information and Control, V. Saligrama (Ed.),
Springer Verlag, 2008,
pp. 7392.

A Game Theoretic View of Efficiency Loss in Resource Allocation.
R. Johari and J. N. Tsitsiklis;
in
Advances in Control, Communication Networks, and Transportation Systems: In
Honor of Pravin Varaiya,
E. H. Abed (Ed.), Systems and Control: Foundations and
Applications Series, Birkhauser, Boston, 2005, pp. 203223.

Decentralized
Detection. J. N. Tsitsiklis;
in Advances in Signal Processing, Vol. 2,
H. V. Poor and J. B. Thomas,
editors, JAI Press, 1993, pp. 297344.

Fluctuation Bounds for the MaxWeight Policy, with Applications to State Space Collapse
A. Sharifnassab, J. N. Tsitsiklis, and S. J. Golestani
submitted, October 2018.

A Lower Bound in Resource Constrained Load Balancing
D. Gamarnik, J. N. Tsitsiklis, and M. Zubeldia
submitted, July 2018.

Private Sequential Learning
J. N. Tsitsiklis, K. Xu, and Z. Xu
submitted, May 2018. Extended abstract in COLT 2018.

Sensitivity to Cumulative Perturbations
for a Class of Piecewise Constant Hybrid Systems
A. Sharifnassab, J. N. Tsitsiklis, and S. J. Golestani
submitted, September 2017; revised June 2018, December 2018.

Delay Analysis of the MaxWeight Policy under HeavyTailed Traffic via Fluid Approximations
M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
Mathematics of Operations Research, Vol. 43, No. 2, May 2018, pp. 460493.

DelayPredictability Tradeoffs in Reaching a
Secret Goal
J. N. Tsitsiklis and K. Xu
Operations Research, Vol. 66, No. 2, MarchApril 2018, pp. 587596.

Delay, Memory, and Messaging Tradeoffs in Distributed Service Systems
D. Gamarnik, J. N. Tsitsiklis, and M. Zubeldia
Stochastic Systems, Vol. 8, No. 1, March 2018, pp. 45–74.

Flexible Queueing Architectures
[supplement]
J. N. Tsitsiklis and K. Xu
Operations Research, SeptemberOctober 2017, Vol. 65, No. 5,
pp. 11151428

When is a network epidemic hard to eliminate?
K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
Mathematics of Operations Research,
Vol. 42, No. 1, February 2017, pp. 1–14.

On QueueSize Scaling for InputQueued Switches
D. Shah, J. N. Tsitsiklis, and Y. Zhong
Stochastic Systems,
Vol. 6, No. 1, 2016, pp. 125.

Delay Stability of BackPressure Policies in the
presence of HeavyTailed Traffic
M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
IEEE/ACM Transactions on Networking, Vol. 24, No. 4, 2016, pp. 20462059.

Coordination with Local Information
M. Dahleh, A. TahbazSalehi, J. N. Tsitsiklis, and S. Zoumpoulis
Operations Research, Vol. 64, No. 3, MayJune 2016, pp. 622637.

Optimization of Radiation Therapy Fractionation Schedules in the Presence of Tumor Repopulation
T. Bortfeld, J. Ramakrishnan, J. N. Tsitsiklis, and J. Unkelbach
INFORMS J. on Computing,
Vol. 27, No. 4, Fall 2015, pp. 788803.

The Value of Field Experiments
[ecompanion]
[codes]
J. Li, P. Rusmevichientong, D. Simester, J. N. Tsitsiklis, and S. Zoumpoulis
Management Science, Vol. 61, No. 7, July 2015, pp. 17221740.

Pricing of Fluctuations in Electricity Markets [supplement]
J. N. Tsitsiklis and Y. Xu
European Journal of Operations Research, Vol. 246, No. 1, October 2015, pp. 199–208.

An efficient curing policy for epidemics on graphs
K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis
IEEE Transactions on Network Science and Engineering, Vol. 1, No. 2, JulyDecember 2014, pp. 6775.

Efficiency Loss in a Cournot Oligopoly with Convex Market
Demand
J. N. Tsitsiklis and Y. Xu
Journal of Mathematical Economics,
Vol. 53, 2014, August 2014, pp. 4658.

Allocational flexibility in constrained supply chains
N. Sabbaghi, Y. Sheffi, and J. N. Tsitsiklis
International Journal of Production Economics,
Vol. 153, 2014, July 2014, pp. 8694.

Throughput Optimal Scheduling Over TimeVarying Channels in the Presence of HeavyTailed Traffic
K. P. Jagannathan, M. Markakis, E.
Modiano, and J. N. Tsitsiklis
IEEE Transactions on Information Theory, Vol. 60, No. 5, May 2014, pp. 28962909.

Qualitative Properties of alphaFair Policies in BandwidthSharing Networks
D. Shah, J. N. Tsitsiklis, and Y. Zhong Annals of Applied Probability, Vol. 24, No. 1, February 2014, pp. 76113.

MaxWeight Scheduling in Queueing Networks with
HeavyTailed Traffic
M. G. Markakis, E. Modiano, and J. N. Tsitsiklis
IEEE/ACM Transactions on Networking,
Vol. 22, No. 1, February 2014, pp. 257270.

Degree Fluctuations and the Convergence Time of Consensus Algorithms
A. Olshevsky, and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 58, No. 10, October 2013, pp. 26262631.

On Learning with Finite Memory
K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis IEEE Transactions on Information Theory, Vol. 59, No. 10, October 2013, pp. 68596872.

Algorithmic Aspects of MeanVariance Optimization in Markov Decision Processes
S. Mannor and J. N. Tsitsiklis European Journal of Operational Research, Vol. 231, 2013, pp. 645653.

Profit Loss in Cournot Oligopolies
[extended version]
J. N. Tsitsiklis and Y. Xu
Operations Research Letters, Vol. 41, 2013, pp. 415420.

NPhardness of Deciding Convexity of Quartic Polynomials and Related Problems
A. A. Ahmadi, A. Olshevsky, P. A. Parrilo, J. N. Tsitsiklis Mathematical Programming, Ser. A, Vol. 137, No. 12,
February 2013, pp. 453476.

Properties of cell death models calibrated and compared using Bayesian approaches
[supplementary material]
H. Eydgahi, W. W. Chen, J. L. Muhlich, D. Vitkup, J. N. Tsitsiklis, and P. K. Sorger
Molecular Systems Biology, Vol. 9, article 644, February 2013, pp. 117 (electronic).

Convergence of TypeSymmetric and CutBalanced Consensus
Seeking Systems
[extended version]
J. M. Hendrickx and J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 58, No. 1, January 2013, pp. 214218.

On the Power of (Even a Little) Resource Pooling
[correction]
J. N. Tsitsiklis and K. Xu
Stochastic Systems, Vol. 2, 2012, pp. 166.

Queue Length Asymptotics for Generalized
MaxWeight Scheduling in the Presence of
HeavyTailed Traffic"
K. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis
IEEE/ACM Transactions on Networking,
Vol. 20, No. 4, August 2012, pp. 10961111.

A Dynamic Programming Approach to Adaptive Fractionation
J. Ramakrishnan, D. Craft, T. Bortfeld, and J. N. Tsitsiklis
Physics in Medicine and Biology, Vol. 57, No. 5, 2012, pp. 12031216.

Hardness of Low Delay Network Scheduling
D. Shah, D. N. C. Tse, and J. N. Tsitsiklis
IEEE Transactions on Information Theory, Vol. 57, No. 12, December 2011, pp. 78107818.

A Lower Bound for Distributed Averaging Algorithms on the Line Graph
A. Olshevsky and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 56, No. 11, November 2011, pp. 26942698.

Distributed Anonymous Discrete Function Computation and Averaging [extended version]
J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis IEEE Transactions on Automatic Control,
Vol. 56, No. 10, October 2011, pp. 22762289.

Parameterized Supply Function Bidding:
Equilibrium and Efficiency
R. Johari and J. N. Tsitsiklis
Operations Research,
Vol. 59, No. 5, SeptemberOctober 2011, pp. 10791089.

Convergence Speed in Distributed Consensus and Averaging
A. Olshevsky and J. N. Tsitsiklis SIAM Review,
Vol. 53, No. 4, 2011, pp. 747772.

Optimal Scaling of Average Queue Sizes in an InputQueued
Switch: an Open Problem
D. Shah, J. N. Tsitsiklis, Y. Zhong
Queueing Systems: Theory and Applications, Vol. 68, No. 34, August 2011, pp. 375384.

On Decentralized Detection with Partial Information
Sharing among Sensors
O. P. Kreidl, J. N. Tsitsiklis, and S. Zoumpoulis,
IEEE Transactions on Signal Processing,
Vol. 59, No. 4, 2011, pp. 17591765.

ContinuousTime AveragePreserving Opinion Dynamics with OpinionDependent Communications
[supplement
]
V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis SIAM Journal on Control and Optimization,
Vol. 48, No. 8, 2010, pp. 52145240.

Linearly Parameterized Bandits
[extended version]
P. Rusmevichientong, and
J. N. Tsitsiklis
Mathematics of Operations Research,
Vol. 35, No. 2, May 2010, pp. 395411.

When is it Important to Know You've Been
Rejected? A Search Problem with Probabilistic
Appearance of Offers
S. Das and J. N. Tsitsiklis Journal of Economic Behavior and Organization,
Vol. 74, No. 12, 2010, pp. 104122.

Perspectives on Stochastic Optimization Over Time
J. N. Tsitsiklis
INFORMS Journal on Computing, Vol. 22, No. 1, 2010, pp. 1819.

Optimal Margin and EdgeEnhanced Intensity Maps
in the Presence of Motion and Uncertainty"
T. C. Y. Chan, J. N. Tsitsiklis, and T. Bortfeld
Physics in Medicine and Biology,
Vol. 55, No. 2, 2010, pp. 515533.

A Structured Multiarmed Bandit Problem
and the Greedy Policy
A. J. Mersereau,
P. Rusmevichientong, and
J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 54, No. 12, December 2009, pp. 27872802.

On Krause's MultiAgent Consensus Model with
StateDependent Connectivity
[extended version]
V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 54, No. 11, November 2009, pp. 25862597.

On Distributed Averaging Algorithms and
Quantization Effects
A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis IEEE Transactions on Automatic Control,
Vol. 54, No. 11, November 2009, pp. 25062517.

Bayesian Detection in Bounded Height Tree
Networks
W. P. Tay, J. N. Tsitsiklis, and M. Z. Win IEEE Transactions on Signal Processing,
Vol. 57, No. 10, October 2009, pp. 40424051.

Efficiency of ScalarParameterized Mechanisms
[electronic companion]
R. Johari and J. N. Tsitsiklis
Operations Research,
Vol. 57, No. 4, JulyAugust 2009, pp. 823839.

Approachability in Repeated Games: Computational Aspects and a Stackelberg Variant
S. Mannor and J. N. Tsitsiklis Games and Economic Behavior, Vol. 66, No. 1, 2009, pp. 315325.

Online Learning with Sample Path Constraints,
S. Mannor, J. N. Tsitsiklis, and J. Y. Yu
Journal of Machine Learning Research, Vol. 10, March 2009,
pp. 569590.

Convergence Speed in Distributed Consensus and Averaging"
A. Olshevsky and J. N. Tsitsiklis
SIAM Journal on Control and Optimization,
Vol. 48, No. 1, 2009, pp. 3355.

Bin Packing with Queues,
D. Shah and J. N. Tsitsiklis
Journal of Applied Probability, Vol. 45, No. 4, December 2008, pp. 922939.

On the Nonexistence of Quadratic Lyapunov
Functions for Consensus Algorithms
A. Olshevsky and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 53, No. 11, December 2008, pp. 26422645.

Robust Management of Motion Uncertainty in IntensityModulated Radiation Therapy
T. Bortfeld, T. C. Y. Chan, A. Trofimov, and J. N. Tsitsiklis Operations Research, Vol. 56, No. 6, NovemberDecember 2008, pp. 14611473.

A SingleUnit Decomposition
Approach to MultiEchelon Inventory Systems
[electronic companion]
A. Muharremoglu and J. N. Tsitsiklis Operations Research,
Vol. 56, No. 5, SeptemberOctober 2008, pp. 10891103.
.

On the Subexponential Decay of Detection Error Probabilities in Long Tandems
W. P. Tay, J. N. Tsitsiklis, and M. Z. Win IEEE Transactions on Information Theory, Vol. 54, No. 10, October 2008, pp. 47674771.

Data Fusion Trees for Detection: Does Architecture Matter?
W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
IEEE Transactions on Information Theory,
Vol. 54, No. 9, September 2008, pp. 41554168.

On the Impact of Node Failures and Unreliable
Communications in Dense Sensor Networks
W. P. Tay, J. N. Tsitsiklis, and M. Z. Win
IEEE Transactions on Signal processing, Vol. 56, No. 6, June 2008, pp. 25352546.

Asymptotic Performance of a Censoring Sensor Network
W. P. Tay, J. N. Tsitsiklis, and M. Z. Win IEEE Transactions on Information Theory, Vol. 53, No. 11, pp. 41914209, November 2007.

Stochastic Search in a Forest Revisited
J. Sethuraman and J. N. Tsitsiklis
Mathematics of Operations Research,
Vol. 32, No. 3, August 2007, pp. 589593.

Comment on "Coordination of Groups of Mobile
Autonomous Agents Using Nearest Neighbor Rules"
D. P. Bertsekas and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 52, No. 5, May 2007, pp. 968969.

NPHardness of Checking the Unichain Condition in Average Cost MDPs
J. N. Tsitsiklis
Operations Research Letters, Vol. 35, No. 3, May 2007, pp. 319323.

Optimal Transmission Scheduling in Symmetric Communication
Models with Intermittent Connectivity
A. Ganti, E. Modiano, and J. N. Tsitsiklis IEEE Transactions on Information Theory, Vol. 5, No. 3, March 2007, pp. 9981008.

Bias and Variance Approximation in Value Function Estimates
[appendix]
S. Mannor, D. I. Simester, P. Sun, and J. N. Tsitsiklis
Management Science, Vol. 53, No. 2, February 2007, pp. 308322

A ContractBased Model for Directed Network Formation
R. Johari, S. Mannor, and J. N. Tsitsiklis
Games and Economic Behavior,
Vol. 56, 2006, pp. 201224.

A Scalable Network Resource
Allocation Mechanism with Bounded Efficiency Loss
R. Johari and J. N. Tsitsiklis
IEEE JSAC Special issue: PriceBased Access Control and Economics for Communication Networks, Vol. 24, No. 5, May 2006, pp. 992999.
Expanded version: "Efficiency Loss in Cournot Games," technical report LIDSP2639, LIDS, MIT, January 2005.

Dynamic Catalog Mailing
Policies
D. I. Simester, P. Sun, and J. N. Tsitsiklis Management Science, Vol. 52, No. 5, May 2006, pp. 683696.

A Robust Approach to IMRT Optimization
T. C. Y. Chan, T. Bortfeld, and J. N. Tsitsiklis Physics in Medicine and Biology, Vol. 51, 2006, pp. 25672583.

Optimal Transmission Scheduling
over a Fading Channel with Energy and Deadline
Constraints
A. Fu, E. Modiano, and J. N. Tsitsiklis
IEEE Transactions on Wireless Communications,
Vol. 5, No. 3, March 2006, pp. 630641.

Efficiency Loss in a Network Resource Allocation Game:
The Case of Elastic Supply
R. Johari, S. Mannor, and J. N. Tsitsiklis IEEE Transactions on Automatic Control, Vol. 50, No. 11, November 2005, pp. 17121724.
expanded version, technical report LIDSP2605,
June 2004.

On the Empirical StateAction
Frequencies in Markov Decision Processes Under General Policies
S. Mannor and J. N. Tsitsiklis
Mathematics of Operations
Research, Vol. 30, No. 3, August 2005, pp. 545561.

Efficiency Loss in a Network Resource Allocation
Game,
R. Johari and J. N. Tsitsiklis Mathematics of Operations Research,
Vol. 29, No. 3, August 2004, pp. 407435.

The Sample Complexity of Exploration in the MultiArmed Bandit
Problem,
S. Mannor and J. N. Tsitsiklis, Journal of Machine Learning
Research, Vol. 5, June 2004, pp. 623648.

Convergence Rate of Linear TwoTime
Scale Stochastic Approximation
V. R. Konda and J. N. Tsitsiklis
Annals of Applied
Probability, Vol. 14, No. 2, 2004,
pp. 796819.

ActorCritic Algorithms [appendix]
V. R. Konda and J. N. Tsitsiklis SIAM Journal on Control and Optimization,
Vol. 42, No. 4, 2003,
pp. 11431166.
Preliminary version in NIPS 1999.

Optimal Energy Allocation and Admission Control for
Communications Satellites
A. Fu, E. Modiano, and J. N. Tsitsiklis IEEE/ACM
Transactions on Networking, Vol. 11, No. 3, June 2003, pp.
488500.

Linear Stochastic
Approximation Driven by Slowly Varying Markov Chains
V. R. Konda and J. N. Tsitsiklis Systems and
Control Letters, Vol. 50, No. 2, 2003, pp. 95102.

Approximate Gradient Methods in PolicySpace Optimization of
Markov Reward Processes
P. Marbach and J. N. Tsitsiklis Journal of Discrete
Event Dynamical Systems,
Vol. 13, pp. 111148,
2003.

Algorithms for GPS
Operation Indoors and
Downtown
N. Agarwal, J. Basch, P. Beckmann, P. Bharti, S. Bloebaum, S. Casadei,
A. Chou, P. Enge, W. Fong, N. Hathi, W. Mann, A. Sahai, J. Stone, J.
Tsitsiklis, and B. Van Roy GPS Solutions, Vol. 6, No. 3,
pp. 149160,
December 2002.

On the Convergence of
Optimistic Policy Iteration
J. N. Tsitsiklis
Journal of Machine Learning Research, Vol. 3, July 2002, pp. 5972.

On Average Versus Discounted Reward TemporalDifference Learning
J. N. Tsitsiklis and B. Van Roy Machine Learning, Vol. 49, No. 2, pp. 179191, November
2002.

Performance of Multiclass Markovian Queueing Networks via
Piecewise Linear Lyapunov Functions [correction]
D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
Annals of Applied Probability, Vol. 11, No. 4, pp.
13841428,
2001.

Regression Methods
for Pricing Complex AmericanStyle
Options,
J. N. Tsitsiklis and B. Van Roy IEEE Transactions on Neural Networks,
Vol. 12, No. 4, July 2001, pp. 694703.

The stability of saturated linear systems
is undecidable
V. D. Blondel, O. Bournez, P. Koiran, and
J. N. Tsitsiklis
Journal of Computer
Systems Science,
Vol. 62, pp. 442462, 2001.

Deciding stability and mortality of piecewise
affine systems
V. D. Blondel, O. Bournez, P. Koiran, C. H.
Papadimitriou, and J. N. Tsitsiklis
Theoretical Computer Science, Vol. 255, No. 12, pp.
687696, 2001.

SimulationBased Optimization
of Markov Reward Processes
P. Marbach and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 46, No. 2, pp.
191209, February 2001.

Approximating the spectral radius of sets of matrices in the
maxalgebra is NPhard
V. D. Blondel, S. Gaubert, and J. N. Tsitsiklis IEEE Transactions on Automatic
Control,
Vol. 45, No. 9, pp. 17621765, September 2000.

The boundedness of all products of a pair of matrices
is undecidable
V. D. Blondel and J. N. Tsitsiklis
Systems and Control Letters, Vol. 41, No. 2,
pp. 135140, 2000.

A Survey of Computational Complexity Results in
Systems and Control
V. D. Blondel and J. N. Tsitsiklis Automatica,
Vol. 36, No. 9, pp. 12491274, September 2000.

Gradient Convergence in Gradient Methods with Errors
D. P. Bertsekas and J. N. Tsitsiklis SIAM Journal in Optimization, Vol. 10, No. 3, 2000,
pp. 627642.

CongestionDependent Pricing of Network Services
I. C. Paschalidis and J. N. Tsitsiklis
IEEE/ACM Transactions on Networking, Vol. 8, No. 2,
April 2000, pp. 171184.

Call Admission Control and Routing in
Integrated Service Networks Using NeuroDynamic Programming
P. Marbach, O. Mihatsch, and J. N. Tsitsiklis
IEEE Journal on Selected Areas
in Communications, Vol. 18, No. 2, February 2000, pp. 197208.

Large Deviations Analysis of the Generalized Processor Sharing Policy
D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
Queueing Systems, Vol. 32, 1999, pp. 319349.

Average Cost TemporalDifference
Learning
J. N. Tsitsiklis, and B. Van Roy Automatica,
Vol. 35, No. 11, November 1999, pp. 17991808.

Optimal Stopping of Markov
Processes: Hilbert Space Theory, Approximation Algorithms, and an Application
to Pricing Financial Derivatives
J. N. Tsitsiklis and B. Van Roy
IEEE Transactions on Automatic Control,
Vol. 44, No. 10, October 1999, pp. 18401851.

Estimation of TimeVarying Parameters in Statistical Models; an
Optimization Approach
D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
Machine Learning,, Vol. 35, No. 3, 1999, pp. 225245.

The Complexity
of Optimal Queueing Network Control
C. H. Papadimitriou and J. N. Tsitsiklis Mathematics
of Operations Research, Vol. 24, No. 2, May 1999, pp. 293305.

Complexity of Stability and Controllability of Elementary Hybrid Systems
V. D. Blondel, and J. N. Tsitsiklis
Automatica, Vol. 35, No. 3, March 1999.

On the Large Deviations Behavior of Acyclic Networks of
G/G/1 Queues
D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
Annals of Applied Probability ,
Vol. 8, No. 4, November 1998, pp.
10271069.

Asymptotic Buffer Overflow Probabilities in Multiclass
Multiplexers: An Optimal Control Approach
D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
IEEE Transactions on Automatic Control.
Vol. 43, No. 3, March 1988, pp. 315335.

Implementation of
Efficient Algorithms for Globally Optimal Trajectories
L. C. Polymenakos, D. P. Bertsekas, and J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 43, No. 2,
February 1998, pp. 278283.

NPhardness of some linear control
design problems
V. Blondel and J. N. Tsitsiklis SIAM J. on Control and Optimization
,
Vol. 35, No. 6, November 1997, pp. 21182127.

Rollout Algorithms
for Combinatorial Optimization
D. P. Bertsekas, J. N. Tsitsiklis, and C. Wu Journal
of Heuristics, Vol. 3, 1997, pp. 245262.

When is a Pair of
Matrices Mortal?
V. D. Blondel and J. N. Tsitsiklis
Information Processing Letters ,
Vol. 63, No. 5, 1997, pp. 283286.

The Lyapunov exponent and joint spectral
radius of pairs of matrices are hard  when not impossible  to
compute and to approximate
J. N. Tsitsiklis and V. D. Blondel
Mathematics of Control, Signals and Systems,
Vol. 10, No. 1, 1997, pp. 3140.
[correction in Vol. 10, No. 4, p.
381]

An Analysis of TemporalDifference
Learning with Function Approximation
J. N. Tsitsiklis and B. Van Roy
IEEE Transactions on Automatic Control,
Vol. 42, No. 5, May 1997, pp. 674690.

Stability Conditions
for Multiclass Fluid Queueing Networks
D. Bertsimas, D. Gamarnik, J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 41, No. 11, November 1996, pp. 16181631.

Stochastic Shortest
Path Problems with Recourse
G. H. Polychronopoulos and J. N. Tsitsiklis
Networks, Vol. 27, No. 2, 1996,
pp. 133143.

FeatureBased Methods for Large
Scale Dynamic Programming
J. N. Tsitsiklis and B. Van Roy Machine Learning, Vol. 22, 1996,
pp. 5994. 
Branching
Bandits and Klimov's Problem: Achievable Region and Side Constraints
D. Bertsimas, I. Paschalidis and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 40, No. 12,
December 1995, pp. 20632075.

Efficient
Algorithms for Globally Optimal Trajectories
J. N. Tsitsiklis IEEE Transactions
on Automatic Control, Vol. 40, No. 9, September 1995, pp. 15281538.

On the Average Communication
Complexity of Asynchronous Distributed Algorithms
J. N. Tsitsiklis and G. D. Stamoulis
Journal of the ACM, Vol. 42, No. 2, March 1995, pp. 382400.

Statistical Multiplexing of Multiple TimeScale Markov Streams
D. N. C. Tse, R. G. Gallager, and J. N. Tsitsiklis
IEEE Journal on Selected Areas in
Communications, Vol. 13, No. 6, August 1995, pp. 10281038.

WorstCase Identification of Nonlinear Fading Memory Systems
M. A. Dahleh, E. D. Sontag, D. N. C. Tse, and J. N. Tsitsiklis
Automatica, Vol. 31, No. 3, March 1995, pp. 503508.

The
Efficiency of Greedy Routing
in Hypercubes and Butterflies
G. D. Stamoulis and J. N. Tsitsiklis
IEEE Transactions on Communications, Vol. 42, No. 11, November 1994,
pp. 30513061.

Data Fusion with Minimal
Communication
Z.Q. Luo and J. N. Tsitsiklis IEEE Transactions on
Information Theory, Vol. 40, No. 5, September 1994, pp. 15511563.

Asynchronous Stochastic Approximation and
Qlearning [correction]
J. N. Tsitsiklis Machine Learning, 16, 1994, pp. 185202.

Local versus NonLocal Computation of Length of
Digitized Curves
S. R. Kulkarni, S. K. Mitter, T. J. Richardson, and J. N.
Tsitsiklis
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol. 16, No. 7, July 1994.

Some Properties of Optimal Thresholds in Decentralized Detection
W. W. Irving and J. N. Tsitsiklis
IEEE Transactions on Automatic Control,
Vol. 39, No. 4, April 1994, pp. 835838.

Optimization of Multiclass Queueing Networks: Polyhedral and
Nonlinear Characterizations of Achievable Performance
D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis
Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 4375.

A Short Proof of the Gittins Index Theorem
J. N. Tsitsiklis
Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 194199.

On the Communication
Complexity of Distributed Algebraic Computation
Z.Q. Luo and J. N. Tsitsiklis
Journal of the ACM, Vol. 40, No. 5, pp. 10191047, November 1993.

PAC Learning with Generalized Samples and an Application to Stochastic
Geometry
S. R. Kulkarni, S. K. Mitter, J. N. Tsitsiklis, and O. Zeitouni IEEE Transactions on Pattern Analysis
and Machine Intelligence, Vol. 15, No. 9, September 1993.

Simulated Annealing
D. Bertsimas and J. N. Tsitsiklis
Statistical Science, Vol. 8, No. 1, 1993, pp. 1015.

Efficient Routing
Schemes for Multiple Broadcasts in Hypercubes
G. D. Stamoulis and J. N. Tsitsiklis
IEEE Transactions on Parallel and Distributed Systems,
Vol. 4, No. 7, July 1993, pp. 725739.

Optimal Asymptotic Identification under Bounded Disturbances
D. N. C. Tse, M. A. Dahleh, J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. AC38, No. 8,
1993, pp. 11761190.

An Efficient Algorithm
for Multiple Simultaneous Broadcasts in the Hypercube
G. D. Stamoulis and J. N. Tsitsiklis
Information Processing Letters, Vol. 46, 1993, pp. 219224.

Extremal Properties of LikelihoodRatio
Quantizers
J. N. Tsitsiklis
IEEE Transactions on
Communications, Vol. 41, No. 4, 1993, pp. 550558.

Active Learning
Using Arbitrary Binary Valued Queries
S. R. Kulkarni, S. K. Mitter and J. N. Tsitsiklis
Machine Learning, Vol. 11, 1993, pp. 2335.

The Sample Complexity of WorstCase Identification of F.I.R.
Linear Systems
M. A. Dahleh, T. Theodosopoulos, and J. N. Tsitsiklis Systems and Control Letters, Vol. 20,
1993, pp. 157166.

Dynamic Shortest Paths
in Acyclic Networks
with Markovian Arc Costs
H. N. Psaraftis and J. N. Tsitsiklis
Operations Research, Vol. 41, 1, 1993, pp. 91101.

Special Cases of Traveling Salesman and
Repairman Problems with Time Windows
J. N. Tsitsiklis Networks., Vol. 22,No. 3, 1992, pp. 263282.

On the Predictability of Coupled Automata: an Allegory about Chaos
S. Buss, C. H. Papadimitriou, and J. N. Tsitsiklis
Complex Systems, Vol. 5, No. 5, 1991, pp. 525539.

On the Communication Complexity
of Solving a Polynomial Equation
Z.Q. Luo and J. N. Tsitsiklis SIAM J. on
Computing, Vol. 20, No. 5, October 1991, pp. 936950.

An Analysis of Stochastic
Shortest Path Problems
D. P. Bertsekas and J. N. Tsitsiklis Mathematics of Operations
Research, Vol. 16, No. 3, August 1991, pp. 580595.

An Optimal OneWay Multigrid
Algorithm for DiscreteTime Stochastic Control
C.S. Chow and J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. AC36, No. 8,
1991, pp. 898914.

On a Lower Bound for the Redundancy of Reliable Networks with Noisy
Gates
N. Pippenger, G. D. Stamoulis, and J. N. Tsitsiklis IEEE Transactions on Information Theory,
Vol. IT37, May 1991, pp. 639643.

Optimal Communication Algorithms for Hypercubes
D. P. Bertsekas, C. Ozveren, G. D. Stamoulis, P. Tseng,
and
J. N. Tsitsiklis
Journal of Parallel and Distributed
Computing, Vol. 11, 1991, pp. 263275.

Some
Aspects of Parallel and Distributed
Iterative Algorithms  A Survey
D. P. Bertsekas and J. N. Tsitsiklis
Automatica, Vol. 27, No. 1, 1991, pp. 321.

On the Settling Time of
the Congested GI/G/1 Queue
G. D. Stamoulis and J. N. Tsitsiklis Advances in
Applied Probability, Vol. 22, 1990, pp. 929956.

Partially
Asynchronous, Parallel Algorithms for Network Flow and other
Problems
P. Tseng, D. P. Bertsekas, and J. N. Tsitsiklis SIAM Journal on Control and Optimization, Vol. 28,
No. 3, May 1990, pp. 678710.

Explicit
Solutions for some
Simple Decentralized Detection Problems
G. Polychronopoulos and J. N. Tsitsiklis
IEEE Transactions on Aerospace and Electronic Systems, Vol. 26,
1990, pp. 282291.

The
Complexity of Dynamic Programming [correction]
C.S. Chow and J. N. Tsitsiklis Journal of
Complexity, Vol. 5, No. 4, 1989, pp. 466488.

A Comparison of Jacobi and GaussSeidel
Parallel Iterations
J. N. Tsitsiklis Applied Mathematics
Letters, Vol. 2, No. 2, 1989, pp. 167170.

On the Use of Random Numbers in
Asynchronous Simulation via Rollback
J. N. Tsitsiklis
Information Processing Letters, Vol. 31, 1989, pp. 139144.

On the Control of Discrete Event Dynamical
Systems
J. N. Tsitsiklis
Mathematics of Control, Signals and Systems, Vol. 2, No.
2, 1989, pp. 95107.

Markov Chains with Rare Transitions and Simulated
Annealing
J. N. Tsitsiklis Mathematics of Operations Research, Vol. 14,
No. 1, 1989, pp. 7090.

A Note
on Strategy Elimination in Bimatrix Games
D. E. Knuth, C. H. Papadimitriou, J. N. Tsitsiklis
Operations Research Letters, Vol. 7, No. 3, 1988, pp. 103107.

Decentralized Detection by a Large Number of
Sensors [with correction included]
J. N. Tsitsiklis Mathematics of Control, Signals and Systems, Vol. 1,
No. 2, 1988, pp. 167182.

On the Stability of Asynchronous Iterative
Processes
J. N. Tsitsiklis
Mathematical Systems Theory, Vol. 20, No. 23,
1987, pp. 137153.

Communication Complexity
of Convex Optimization
J. N. Tsitsiklis and Z.Q. Luo Journal of
Complexity, Vol. 3, No. 3, 1987, pp. 231243.
[1986 IEEE CDC version]

Analysis of a Multiaccess Control Scheme
J. N. Tsitsiklis
IEEE Transactions on Automatic Control, Vol. 32, No. 11,
1987, pp. 10171020.

The Complexity of
Markov Decision Processes
[erratum]
C. H. Papadimitriou and J. N. Tsitsiklis Mathematics of
Operations Research, Vol. 12, No. 3, 1987, pp. 441450.

Stochastic Scheduling with
InTree Precedence Constraints
C. H. Papadimitriou and J. N. Tsitsiklis SIAM Journal
on Computing, Vol. 16, No. 1, 1987, pp. 16.

Distributed
Asynchronous Deterministic and Stochastic Gradient Optimization
Algorithms
J. N. Tsitsiklis, D. P. Bertsekas and M. Athans IEEE Transactions on Automatic
Control, Vol. 31, No. 9, 1986, pp. 803812.

The Performance of a PrecedenceBased
Queueing Discipline
J. N. Tsitsiklis,
C. H. Papadimitriou and P. Humblet Journal of the ACM, Vol. 33, No. 3,
1986, pp. 593602.

Intractable Problems
in Control Theory
C. H. Papadimitriou and J. N. Tsitsiklis SIAM Journal on Control and
Optimization, Vol. 24, No. 4, 1986, pp. 639654.

A Lemma on the MultiArmed Bandit
Problem
J. N. Tsitsiklis IEEE Transactions on Automatic Control, Vol. 31, No. 6,
1986, pp. 576577.

Distributed Asynchronous
Optimal Routing in Data Networks
J. N. Tsitsiklis and D. P. Bertsekas IEEE
Transactions on Automatic Control, Vol. 31, No. 4, 1986, pp. 325332.

A Fast Algorithm for the Linear
Estimation of TwoDimensional Isotropic Random Fields
B. C. Levy and J. N. Tsitsiklis IEEE
Transactions on Information Theory, Vol. 31, No. 5, 1985, pp. 635644.

On the Complexity of Decentralized
Decision Making and Detection Problems
J. N. Tsitsiklis and M. Athans IEEE Transactions on
Automatic Control, Vol. 30, No.5, 1985, pp. 440446.

Periodic Review Inventory Systems with
Continuous Demand and Discrete Order Sizes
J. N. Tsitsiklis
Management Science, Vol.
30, No. 10, 1984, pp. 12501254.

A Simple
Criterion for Structurally Fixed Modes
C. H. Papadimitriou and J. N. Tsitsiklis Systems and Control
Letters, Vol. 4, 1984, pp. 333337.

Convexity and Characterization of Optimal Policies
in a Dynamic Routing Problem
J. N. Tsitsiklis Journal of Optimization Theory
and Applications, Vol. 44, No. 1, 1984, pp. 105136.

Guaranteed Robustness
Properties of Multivariable Nonlinear
Stochastic Optimal Regulators
J. N. Tsitsiklis and M. Athans IEEE Transactions on Automatic
Control, Vol. 29, No. 8, 1984, pp. 690696.

Convergence and
Asymptotic Agreement in Distributed Decision Problems
J. N. Tsitsiklis and M. Athans IEEE
Transactions on Automatic Control, Vol. 29, No. 1, 1984, pp. 4250.

On the Complexity of
Designing Distributed Protocols
C. H. Papadimitriou and J. N. Tsitsiklis Information and Control,
Vol. 53, No. 3, 1982, pp. 211218.

Conditions for Finiteness of a
Constructive Algorithm for Determining Stability
J. N. Tsitsiklis
IEEE
Transactions on Circuits and Systems, Vol. 29, No. 6, 1982, pp.
400402.

Linear Optimization Problems with Dynamical Structure
B.Sc.
Thesis, Department of EECS, MIT, January 1980.

Optimal Dynamic Routing in an Unreliable Manufacturing System
M.Sc. Thesis, Department of EECS, MIT, February 1981; technical report
LIDSTH1069, LIDS, MIT.

Problems in Decentralized Decision Making and Computation
Ph.D. Thesis, Department of EECS, MIT, November 1984; technical report
LIDSTH1424, LIDS, MIT.
The following are technical reports or conference papers that have not been superseded by journal papers.

The Value of Temporal Data for Learning of Influence Networks: a Characterization via KullbackLeibler Divergence
M. A. Dahleh, J. N Tsitsiklis, and S. I. Zoumpoulis
Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

A lower bound on the performance of dynamic curing policies for epidemics on graphs
K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

Fundamental limitations for anonymous decentralized systems with broadcast communications
J. M. Hendrickx and J. N. Tsitsiklis
Proceedings of the 53rd Annual Allerton Conference on
Communication, Control, and Computing, October 2015.

The Value of Feedback for Decentralized Detection
in Large Sensor Networks
W. P. Tay and J. N. Tsitsiklis
Proceedings of the IEEE International Symposium on Wireless Pervasive Computing (ISWPC 2011), Hong Kong, China, February 2011.

Qualitative Properties of alphaWeighted Scheduling Policies
D. Shah, J. N. Tsitsiklis, and Y. Zhong
Proceedings of the ACM Sigmetrics 2010, New York, NY, June 2010.

Weighted Gossip: Distributed Averaging Using
NonDoubly Stochastic Matrices
F. Benezit, V. Blondel, P. Thiran, J. Tsitsiklis, and M. Vetterli
2010 IEEE International Symposium on Information Theory,
Austin, Texas, June 2010.

Distributed Subgradient Methods and Quantization Effects
A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis
Proceedings of the
47th IEEE Conference on Decision
and Control, Cancun, Mexico, December 2008.

Convergence in Multiagent Coordination, Consensus, and Flocking [corrected version]
V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis,
Proceedings of the
Joint 44th IEEE Conference on Decision
and Control and European Control Conference (CDCECC'05), Seville, Spain, December 2005.

Routing and Peering in a
Competitive Internet
R. Johari and J. N. Tsitsiklis
Proceedings of the 2004 IEEE Conference on Decision and Control, Bahamas, December 2004.
Extended version in technical report LIDSP2570, January 2003.

Dynamic Leadtime Management in Supply Chains
A. Muharremoglu and J. N. Tsitsiklis
Unpublished manuscript,
June 2003.

Three Problems on the Decidability and Complexity of Stability
V. D. Blondel and J. N. Tsitsiklis
in
Open Problems in Mathematical Systems and Control Theory,
V.D. Blondel, E.D. Sontag, M. Vidyasagar, J.C. Willems (editors),
Springer, 1999, pp. 4651

Overview of complexity and
decidability results for three classes of elementary
nonlinear systems
V. D. Blondel and J. N. Tsitsiklis
in Learning, Control and Hybrid Systems (LNCIS, volume 241), Y. Yamamoto and S. Hara (Eds),
Springer, 1999, pp. 4658.

Geometric Bounds for Stationary Distributions of Infinite
Markov Chains Via Lyapunov Functions
D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis
Technical report LIDSP2426, September 1998.

A NeuroDynamic Programming Approach
to Call Admission Control in Integrated Service
Networks: The Single Link Case
P. Marbach and J. N. Tsitsiklis
Proceedings of the 2003 IEEE
Conference on Decision and Control, Maui, Hawaii, December 2003.
Extended version
in
technical report LIDSP2402,
November 1997.

A NeuroDynamic Programming Approach to Retailer Inventory Management [extended version]
B. Van Roy, D. P. Bertsekas, Y. Lee, and J. N. Tsitsiklis
Proceedings of the 36th IEEE
Conference on Decision and Control, San Diego, California, December
1997, pp. 40524057.

Stable Linear Approximations to
Dynamic Programming for Stochastic Control Problems with Local
Transitions
B. Van Roy and J. N. Tsitsiklis
Advances in Neural Information
Processing Systems (NIPS) 8, MIT Press, 1996, pp. 10451051.

The Problem of Fringe Acquisition in HighPrecision SpaceBased
Interferometers
C. E. Padilla, V. I. Karlov, J. Li, H. M. Chun, J. N. Tsitsiklis, and R. D. Reasenberg
SPIE
Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida,
April 1995, p. 47.

A Study of Fringe Tracking for HighPrecision SpaceBased
Interferometers
C. E. Padilla, V. I. Karlov, J. Li, H. M. Chun, J. N. Tsitsiklis, and R. D. Reasenberg
SPIE
Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida,
April 1995, p. 63.

Optimal Distributed
Policies for Choosing Among Multiple Servers
G. D. Stamoulis and J. N. Tsitsiklis Proceedings of
the 30th IEEE Conference on Decision and Control, Brighton, England,
December 1991, pp. 815820.

Convergence Rate and
Termination of Asynchronous Iterative Algorithms
D. P. Bertsekas and J. N. Tsitsiklis Proceedings of
the 1989 International Conference on Supercomputing, Irakleion, Greece,
June 1989, pp. 461470.

Lower
Bounds on the Time to Compute a Simple Boolean Function on a Parallel
Random Access Machine
Z.Q. Luo and J. N. Tsitsiklis Technical
Report LIDSP1616, October 1986.

Integral Equations and Resolvents of
Toeplitz plus Hankel Kernels
J. N. Tsitsiklis and B. C. Levy
Technical Report LIDSP1170, December 1981.

Linear Estimation of
Stationary Stochastic Processes, Vibrating Strings,
and Inverse Scattering
B. C. Levy and J. N. Tsitsiklis
Technical Report LIDSP1155, November 1982.
