Book chapters

W. P. Tay and J. N. Tsitsiklis,
"Error Exponents for Decentralized Detection in Tree Networks,"
in Networked Sensing Information and Control, V. Saligrama (Ed.),
Springer Verlag, 2008,
pp. 7392.

R. Johari and J. N. Tsitsiklis,
"A Game Theoretic View of Efficiency Loss in Resource Allocation,", in
Advances in Control, Communication Networks, and Transportation Systems: In
Honor of Pravin Varaiya, E. H. Abed (Ed.), Systems and Control: Foundations and
Applications Series, Birkhauser, Boston, 2005, pp. 203223.

J. N. Tsitsiklis, "Decentralized
Detection", in Advances in Signal Processing, Vol. 2,
H. V. Poor and J. B. Thomas,
editors, JAI Press, 1993, pp. 297344.
Preprints or recent conference papers

K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis,
"When is a network epidemic hard to eliminate?'',
submitted, September 2015.

J. N. Tsitsiklis and K. Xu,
"Flexible Queueing Architectures,'' submitted, May 2015.
Preliminary version:
"Queueing system topologies with limited flexibility,'' Proceedings of ACM SIGMETRICS, Pittsburgh, PA, June 2013. [extended version]

M. G. Markakis, E. Modiano, and J. N. Tsitsiklis,
"Delay Analysis of the MaxWeight Policy under HeavyTailed Traffic via Fluid Approximations,'' submitted, May 2015.

K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis,
"A lower bound on the performance of dynamic curing policies for epidemics on graphs,'' Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

M. A. Dahleh, J. N Tsitsiklis, and S. I. Zoumpoulis,
"The Value of Temporal Data for Learning of Influence Networks: a Characterization via KullbackLeibler Divergence,''
Proceedings of the 54th IEEE Conference on Decision and Control, Osaka, Japan, December 2015.

T. Bortfeld, J. Ramakrishnan, J. N. Tsitsiklis, and J. Unkelbach,
Optimization of Radiation Therapy Fractionation Schedules in the Presence of Tumor Repopulation," submitted December 2013; revised December 2014 and April 2015; to appear in the INFORMS J. on Computing.

D. Shah, J. N. Tsitsiklis, and Y. Zhong,
"On QueueSize Scaling for InputQueued Switches,'' submitted, May 2014; revised May 2015.

M. G. Markakis, E. Modiano, and J. N. Tsitsiklis,
"Delay Stability of BackPressure Policies in the
presence of HeavyTailed Traffic,'' submitted March 2014, revised June 2015; to appear in the IEEE/ACM Transactions on Networking.

M. Dahleh, A. TahbazSalehi, J. N. Tsitsiklis, and S. Zoumpoulis,
"Coordination with Local Information,'', submitted April 2013; revised February 2015;
to appear in Operations Research.
Journal papers

J. Li, P. Rusmevichientong, D. Simester, J. N. Tsitsiklis, and S. Zoumpoulis,
The Value of Field Experiments,'' Management Science, 2015. [ecompanion]

J. N. Tsitsiklis and Y. Xu,
"Pricing of Fluctuations in Electricity Markets,'' European Journal of Operations Research, 2015.
[Supplement]

K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis,
"An efficient curing policy for epidemics on graphs,'' IEEE Transactions on Network Science and Engineering, Vol. 1, No. 2, JulyDecember 2014, pp. 6775;

J. N. Tsitsiklis and Y. Xu, "Efficiency Loss in a Cournot Oligopoly with Convex Market
Demand,'' Journal of Mathematical Economics,
Vol. 53, 2014, August 2014, pp. 4658.

N. Sabbaghi, Y. Sheffi, and J. N. Tsitsiklis,
"Allocational flexibility in constrained supply chains,'' International Journal of Production Economics,
Vol. 153, 2014, July 2014, pp. 8694.

K. P. Jagannathan, M. Markakis, E.
Modiano, and J. N. Tsitsiklis,
Throughput Optimal Scheduling Over TimeVarying Channels in the Presence of HeavyTailed Traffic,
IEEE Transactions on Information Theory, Vol. 60, No. 5, May 2014, pp. 28962909.

D. Shah, J. N. Tsitsiklis, and Y. Zhong,
"Qualitative properties of alphafair policies in bandwidthsharing networks'', Annals of Applied Probability, Vol. 24, No. 1, February 2014, pp. 76113.

M. G. Markakis, E. Modiano, and J. N. Tsitsiklis,
"MaxWeight Scheduling in Queueing Networks with
HeavyTailed Traffic,'', IEEE/ACM Transactions on Networking,
Vol. 22, No. 1, February 2014, pp. 257270.

A. Olshevsky, and J. N. Tsitsiklis,
"Degree Fluctuations and the Convergence Time of Consensus Algorithms,''
IEEE Transactions on Automatic Control, Vol. 58, No. 10, October 2013, pp. 26262631.

K. Drakopoulos, A. Ozdaglar, and J. N. Tsitsiklis, "On Learning with Finite Memory", IEEE Transactions on Information Theory, Vol. 59, No. 10, October 2013, pp. 68596872.

S. Mannor and J. N. Tsitsiklis, "Algorithmic Aspects of MeanVariance Optimization in Markov Decision Processes", European Journal of Operational Research, Vol. 231, 2013, pp. 645653.

J. N. Tsitsiklis and Y. Xu, "Profit Loss in Cournot Oligopolies,''
Operations Research Letters, Vol. 41, 2013, pp. 415420.
[extended version]

A. A. Ahmadi, A. Olshevsky, P. A. Parrilo, J. N. Tsitsiklis,
"NPhardness of Deciding Convexity of Quartic Polynomials and Related Problems", Mathematical Programming, Ser. A, Vol. 137, No. 12,
February 2013, pp. 453476.

H. Eydgahi, W. W. Chen, J. L. Muhlich, D. Vitkup, J. N. Tsitsiklis, and P. K. Sorger,
"Properties of cell death models calibrated and compared using Bayesian approaches,''
Molecular Systems Biology, Vol. 9, article 644, February 2013, pp. 117 (electronic).
[supplementary material]

J. M. Hendrickx and J. N. Tsitsiklis,
"Convergence of TypeSymmetric and CutBalanced Consensus
Seeking Systems", IEEE Transactions on Automatic Control,
Vol. 58, No. 1, January 2013, pp. 214218.
[extended version]

J. N. Tsitsiklis and K. Xu, "On the power of (even a little) resource pooling", Stochastic Systems, Vol. 2, 2012, pp. 166.

K. Jagannathan, M. Markakis, E. Modiano, and J. N. Tsitsiklis,
"Queue length asymptotics for generalized
maxweight scheduling in the presence of
heavytailed traffic", IEEE/ACM Transactions on Networking,
Vol. 20, No. 4, August 2012, pp. 10961111.

J. Ramakrishnan, D. Craft, T. Bortfeld, and J. N. Tsitsiklis,
"A dynamic programming approach to adaptive fractionation",
Physics in Medicine and Biology, Vol. 57, No. 5, 2012, pp. 12031216.

D. Shah, D. N. C. Tse, and J. N. Tsitsiklis,
"Hardness of Low Delay Network Scheduling",
IEEE Transactions on Information Theory, Vol. 57, No. 12, December 2011, pp. 78107818.

A. Olshevsky and J. N. Tsitsiklis,
"A Lower Bound for Distributed Averaging Algorithms on the Line Graph",
IEEE Transactions on Automatic Control, Vol. 56, No. 11, November 2011, pp. 26942698.

J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis,
"Distributed Anonymous Discrete Function Computation and Averaging", IEEE Transactions on Automatic Control,
Vol. 56, No. 10, October 2011, pp. 22762289.
[extended version]

R. Johari and J. N. Tsitsiklis,
"Parameterized Supply Function Bidding:
Equilibrium and Efficiency,''
Operations Research,
Vol. 59, No. 5, SeptemberOctober 2011, pp. 10791089.

A. Olshevsky and J. N. Tsitsiklis, "Convergence Speed in Distributed Consensus and Averaging,'' SIAM Review,
Vol. 53, No. 4, 2011, pp. 747772.

D. Shah, J. N. Tsitsiklis, Y. Zhong,
"Optimal scaling of average queue sizes in an inputqueued
switch: an open problem",
Queueing Systems: Theory and Applications, Vol. 68, No. 34, August 2011, pp. 375384.

O. P. Kreidl, J. N. Tsitsiklis, and S. Zoumpoulis,
"On Decentralized Detection with Partial Information
Sharing among Sensors",
IEEE Transactions on Signal Processing,
Vol. 59, No. 4, 2011, pp. 17591765.

V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis,
"ContinuousTime AveragePreserving Opinion Dynamics with OpinionDependent Communications," SIAM Journal on Control and Optimization,
Vol. 48, No. 8, 2010, pp. 52145240.
[supplement on existence and uniqueness of solutions]

P. Rusmevichientong, and
J. N. Tsitsiklis,
"Linearly Parameterized Bandits",
Mathematics of Operations Research,
Vol. 35, No. 2, May 2010, pp. 395411.
[extended version]

S. Das and J. N. Tsitsiklis,
"When is it Important to Know You've Been
Rejected? A Search Problem with Probabilistic
Appearance of Offers", Journal of Economic Behavior and Organization,
Vol. 74, No. 12, 2010, pp. 104122.

J. N. Tsitsiklis,
"Perspectives on Stochastic Optimization Over Time,
INFORMS Journal on Computing, Vol. 22, No. 1, 2010, pp. 1819.

T. C. Y. Chan, J. N. Tsitsiklis, and T. Bortfeld,
"Optimal margin and edgeenhanced intensity maps
in the presence of motion and uncertainty", Physics in Medicine and Biology,
Vol. 55, No. 2, 2010, pp. 515533.

A. J. Mersereau,
P. Rusmevichientong, and
J. N. Tsitsiklis,
"A Structured Multiarmed Bandit Problem
and the Greedy Policy",
IEEE Transactions on Automatic Control,
Vol. 54, No. 12, December 2009, pp. 27872802.

V. D. Blondel, J. M. Hendrickx, and J. N. Tsitsiklis,
"On Krause's multiagent consensus model with
statedependent connectivity,"
IEEE Transactions on Automatic Control,
Vol. 54, No. 11, November 2009, pp. 25862597.
[extended version]

A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis,
"On Distributed Averaging Algorithms and
Quantization Effects, IEEE Transactions on Automatic Control,
Vol. 54, No. 11, November 2009, pp. 25062517.

W. P. Tay, J. N. Tsitsiklis, and M. Z. Win,
"Bayesian Detection in Bounded Height Tree
Networks", IEEE Transactions on Signal Processing,
Vol. 57, No. 10, October 2009, pp. 40424051.
 R. Johari and J. N. Tsitsiklis,
"Efficiency of ScalarParameterized Mechanisms",
Operations Research,
Vol. 57, No. 4, JulyAugust 2009, pp. 823839;
electronic companion.
 S. Mannor and J. N. Tsitsiklis,
"Approachability in Repeated Games: Computational Aspects and a Stackelberg Variant", Games and Economic Behavior, Vol. 66, No. 1, 2009, pp. 315325.

S. Mannor, J. N. Tsitsiklis, and J. Y. Yu,
"Online Learning with Sample Path Constraints,"
Journal of Machine Learning Research, Vol. 10, March 2009,
pp. 569590.

A. Olshevsky and J. N. Tsitsiklis,
"Convergence Speed in Distributed Consensus and Averaging",
SIAM Journal on Control and Optimization,
Vol. 48, No. 1, 2009, pp. 3355.

D. Shah and J. N. Tsitsiklis, "Bin Packing with Queues,"
Journal of Applied Probability, Vol. 45, No. 4, December 2008, pp. 922939.

A. Olshevsky and J. N. Tsitsiklis,
"On the Nonexistence of Quadratic Lyapunov
Functions for Consensus Algorithms", IEEE Transactions on Automatic Control, Vol. 53, No. 11, December 2008, pp. 26422645.

T. Bortfeld, T. C. Y. Chan, A. Trofimov, and J. N. Tsitsiklis,
"Robust Management of Motion Uncertainty in IntensityModulated Radiation Therapy", Operations Research, Vol. 56, No. 6, NovemberDecember 2008, pp. 14611473.

A. Muharremoglu and J. N. Tsitsiklis,
"A SingleUnit Decomposition
Approach to MultiEchelon Inventory Systems", Operations Research,
Vol. 56, No. 5, SeptemberOctober 2008, pp. 10891103.
Electronic companion (appendix).

W. P. Tay, J. N. Tsitsiklis, and M. Z. Win, "On the Subexponential Decay of Detection Error Probabilities in Long Tandems", IEEE Transactions on Information Theory, Vol. 54, No. 10, October 2008, pp. 47674771.

W. P. Tay, J. N. Tsitsiklis, and M. Z. Win,
"Data Fusion Trees for Detection: Does Architecture Matter?",
IEEE Transactions on Information Theory,
Vol. 54, No. 9, September 2008, pp. 41554168.

W. P. Tay, J. N. Tsitsiklis, and M. Z. Win,
"On the Impact of Node Failures and Unreliable
Communications in Dense Sensor Networks",
IEEE Transactions on Signal processing, Vol. 56, No. 6, June 2008, pp. 25352546.

W. P. Tay, J. N. Tsitsiklis, and M. Z. Win,
"Asymptotic Performance of a Censoring Sensor Network ,'' IEEE Transactions on Information Theory, Vol. 53, No. 11, pp. 41914209, November 2007.

J. Sethuraman and J. N. Tsitsiklis,
"Stochastic Search in a Forest Revisited,"
Mathematics of Operations Research,
Vol. 32, No. 3, August 2007, pp. 589593.

D. P. Bertsekas and J. N. Tsitsiklis,
"Comment on `Coordination of Groups of Mobile
Autonomous Agents Using Nearest Neighbor Rules'," IEEE Transactions on Automatic Control, Vol. 52, No. 5, May 2007, pp. 968969.

J. N. Tsitsiklis,
"NPHardness of Checking the Unichain Condition in Average Cost MDPs,"
Operations Research Letters, Vol. 35, No. 3, May 2007, pp. 319323.

A. Ganti, E. Modiano, and J. N. Tsitsiklis,
"Optimal Transmission Scheduling in Symmetric Communication
Models with Intermittent Connectivity," IEEE Transactions on Information Theory, Vol. 5, No. 3, March 2007, pp. 9981008.

S. Mannor, D. I. Simester, P. Sun, and J. N. Tsitsiklis,
"Bias and Variance Approximation in Value Function Estimates,"
Management Science, Vol. 53, No. 2, February 2007, pp. 308322; Appendix.

R. Johari, S. Mannor, and J. N. Tsitsiklis,
"A ContractBased Model for Directed Network Formation,"
Games and Economic Behavior,
Vol. 56, 2006, pp. 201224.

R. Johari and J. N. Tsitsiklis,
"A Scalable Network Resource
Allocation Mechanism with Bounded Efficiency Loss",
IEEE JSAC Special issue: PriceBased Access Control and Economics for Communication Networks, Vol. 24, No. 5, May 2006, pp. 992999;
Expanded version: "Efficiency Loss in Cournot Games," technical report LIDSP2639, Laboratory for Information and Decision Systems, MIT, January 2005.

D. I. Simester, P. Sun, and J. N. Tsitsiklis, "Dynamic Catalog Mailing
Policies," Management Science, Vol. 52, No. 5, May 2006, pp. 683696.

T. C. Y. Chan, T. Bortfeld, and J. N. Tsitsiklis, "A Robust Approach to IMRT Optimization," Physics in Medicine and Biology, Vol. 51, 2006, pp. 25672583.

A. Fu, E. Modiano, and J. N. Tsitsiklis,
"Optimal Transmission Scheduling
over a Fading Channel with Energy and Deadline
Constraints,"
IEEE Transactions on Wireless Communications,
Vol. 5, No. 3, March 2006, pp. 630641.

R. Johari, S. Mannor, and J. N. Tsitsiklis,
"Efficiency Loss in a Network Resource Allocation Game:
The Case of Elastic Supply," IEEE Transactions on Automatic Control, Vol. 50, No. 11, November 2005, pp. 17121724;
expanded version, technical report LIDSP2605,
June 2004.

S. Mannor and J. N. Tsitsiklis,
"On the Empirical StateAction
Frequencies in Markov Decision Processes Under General Policies",
Mathematics of Operations
Research, Vol. 30, No. 3, August 2005, pp. 545561.

R. Johari and J. N. Tsitsiklis,
"Efficiency Loss in a Network Resource Allocation
Game,", Mathematics of Operations Research,
Vol. 29, No. 3, August 2004, pp. 407435.

S. Mannor and J. N. Tsitsiklis,
"The Sample Complexity of Exploration in the MultiArmed Bandit
Problem," Journal of Machine Learning
Research, Vol. 5, June 2004, pp. 623648.

V. R. Konda and J. N. Tsitsiklis,
"Convergence Rate of Linear TwoTime
Scale Stochastic Approximation",
Annals of Applied
Probability, Vol. 14, No. 2, 2004,
pp. 796819.

V. R. Konda and J. N. Tsitsiklis,
"ActorCritic Algorithms"
, SIAM Journal on Control and Optimization,
Vol. 42, No. 4, 2003,
pp. 11431166. Appendix

A. Fu, E. Modiano, and J. N. Tsitsiklis,
"Optimal Energy Allocation and Admission Control for
Communications Satellites" IEEE/ACM
Transactions on Networking, Vol. 11, No. 3, June 2003, pp.
488500.

V. R. Konda and J. N. Tsitsiklis,
"Linear Stochastic
Approximation Driven by Slowly Varying Markov Chains", Systems and
Control Letters, Vol. 50, No. 2, 2003, pp. 95102.

P. Marbach and J. N. Tsitsiklis,
"Approximate Gradient Methods in PolicySpace Optimization of
Markov Reward Processes", Journal of Discrete
Event Dynamical Systems,
Vol. 13, pp. 111148,
2003.
(preliminary version:
"Simulationbased optimization of Markov reward processes:
implementation issues," in Proceedings of the 38th IEEE
Conference on Decision and Control, December 1999,
pp. 17691774.)

N. Agarwal, J. Basch, P. Beckmann, P. Bharti, S. Bloebaum, S. Casadei,
A. Chou, P. Enge, W. Fong, N. Hathi, W. Mann, A. Sahai, J. Stone, J.
Tsitsiklis, and B. Van Roy,
"Algorithms for GPS
Operation Indoors and
Downtown," GPS Solutions, Vol. 6, No. 3,
pp. 149160,
December 2002.

J. N. Tsitsiklis,
"On the Convergence of
Optimistic Policy Iteration",
Journal of Machine Learning Research, Vol. 3, July 2002, pp. 5972.

J. N. Tsitsiklis and B. Van Roy,
"On Average Versus Discounted Reward TemporalDifference Learning"
, Machine Learning, Vol. 49, No. 2, pp. 179191, November
2002.

D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis,
"Performance of Multiclass Markovian Queueing Networks via
Piecewise Linear Lyapunov Functions",
Annals of Applied Probability, Vol. 11, No. 4, pp.
13841428,
2001.

J. N. Tsitsiklis and B. Van Roy,
"Regression Methods
for Pricing Complex AmericanStyle
Options," IEEE Trans. on Neural Networks,
Vol. 12, No. 4, July 2001, pp. 694703.
 V. D. Blondel, O. Bournez, P. Koiran, and
J. N. Tsitsiklis,
"The stability of saturated linear systems
is undecidable,",
Journal of Computer
Systems Science,
Journal of Computer and System Sciences, Vol. 62, pp. 442462, 2001.

V. D. Blondel, O. Bournez, P. Koiran, C. H.
Papadimitriou, and J. N. Tsitsiklis,
"Deciding stability and mortality of piecewise
affine systems",
Theoretical Computer Science, Vol. 255, No. 12, pp.
687696, 2001.
 P. Marbach and J. N. Tsitsiklis,
"SimulationBased Optimization
of Markov Reward Processes",
IEEE Transactions on Automatic Control, Vol. 46, No. 2, pp.
191209, February 2001.

V. D. Blondel, S. Gaubert, and J. N. Tsitsiklis,
"Approximating the spectral radius of sets of matrices in the
maxalgebra is NPhard, IEEE Transactions on Automatic
Control,
Vol. 45, No. 9, pp. 17621765, September 2000.

V. D. Blondel and J. N. Tsitsiklis,
"The boundedness of all products of a pair of matrices
is undecidable",
Systems and Control Letters, Vol. 41, No. 2,
pp. 135140, 2000.

V. D. Blondel and J. N. Tsitsiklis,
"A Survey of Computational Complexity Results in
Systems and Control", Automatica,
Vol. 36, No. 9, pp. 12491274, September 2000.
 D. P. Bertsekas and J. N. Tsitsiklis,
"Gradient Convergence in Gradient Methods with Errors,"
SIAM Journal in Optimization, Vol. 10, No. 3, 2000,
pp. 627642.
 I. C. Paschalidis and J. N. Tsitsiklis,
"CongestionDependent Pricing of Network Services",
IEEE/ACM Transactions on Networking, Vol. 8, No. 2,
April 2000, pp. 171184.

P. Marbach, O. Mihatsch, and J. N. Tsitsiklis,
"Call Admission Control and Routing in
Integrated Service Networks Using NeuroDynamic Programming,"
IEEE Journal on Selected Areas
in Communications, Vol. 18, No. 2, February 2000, pp. 197208.

D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis,
"Large Deviations Analysis of the Generalized Processor Sharing Policy",
Queueing Systems, Vol. 32, 1999, pp. 319349.
 J. N. Tsitsiklis, and B. Van Roy,
"Average Cost TemporalDifference
Learning", Automatica,
Vol. 35, No. 11, November 1999, pp. 17991808.
 J. N. Tsitsiklis and B. Van Roy,
"Optimal Stopping of Markov
Processes: Hilbert Space Theory, Approximation Algorithms, and an Application
to Pricing Financial Derivatives",
IEEE Transactions on Automatic Control,
Vol. 44, No. 10, October 1999, pp. 18401851.

D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis,
"Estimation of TimeVarying Parameters in Statistical Models; an
Optimization Approach,"
Machine Learning,, Vol. 35, No. 3, 1999, pp. 225245.

C. H. Papadimitriou and J. N. Tsitsiklis,
"The Complexity
of Optimal Queueing Network Control", Mathematics
of Operations Research, Vol. 24, No. 2, May 1999, pp. 293305.

V. D. Blondel, and J. N. Tsitsiklis,
"Complexity of Stability and Controllability of Elementary Hybrid Systems",
Automatica, Vol. 35, No. 3, March 1999.

D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis,
"On the Large Deviations Behavior of Acyclic Networks of
G/G/1 Queues",
Annals of Applied Probability ,
Vol. 8, No. 4, November 1998, pp.
10271069.

D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis,
Asymptotic Buffer Overflow Probabilities in Multiclass
Multiplexers: An Optimal Control Approach",
IEEE Transactions on Automatic Control.
Vol. 43, No. 3, March 1988, pp. 315335.

L. C. Polymenakos, D. P. Bertsekas, and J. N. Tsitsiklis,
"Implementation of
Efficient Algorithms for Globally Optimal Trajectories",
IEEE Transactions on Automatic Control,
Vol. 43, No. 2,
February 1998, pp. 278283.

V. Blondel and J. N. Tsitsiklis,
"NPhardness of some linear control
design problems", SIAM J. on Control and Optimization
,
Vol. 35, No. 6, November 1997, pp. 21182127.

D. P. Bertsekas, J. N. Tsitsiklis, and C. Wu,
"Rollout Algorithms
for Combinatorial Optimization", Journal
of Heuristics, Vol. 3, 1997, pp. 245262.

V. D. Blondel and J. N. Tsitsiklis,
"When is a Pair of
Matrices Mortal?",
Information Processing Letters ,
Vol. 63, No. 5, 1997, pp. 283286.
 J. N. Tsitsiklis and V. D. Blondel,
"The Lyapunov exponent and joint spectral
radius of pairs of matrices are hard  when not impossible  to
compute and to approximate",
Mathematics of Control, Signals and Systems,
Vol. 10, No. 1, 1997, pp. 3140; correction in Vol. 10, No. 4, p.
381.
 J. N. Tsitsiklis and B. Van Roy,
"An Analysis of TemporalDifference
Learning with Function Approximation",
IEEE Transactions on Automatic Control,
Vol. 42, No. 5, May 1997, pp. 674690.

D. Bertsimas, D. Gamarnik, J. N. Tsitsiklis,
"Stability Conditions
for Multiclass Fluid Queueing Networks",
IEEE Transactions on Automatic Control,
Vol. 41, No. 11, November 1996, pp. 16181631.

G. H. Polychronopoulos and J. N. Tsitsiklis,
"Stochastic Shortest
Path Problems with Recourse", Networks, Vol. 27, No. 2, 1996,
pp. 133143.

J. N. Tsitsiklis and B. Van Roy, FeatureBased Methods for Large
Scale Dynamic Programming", Machine Learning, Vol. 22, 1996,
pp. 5994.

D. Bertsimas, I. Paschalidis and J. N. Tsitsiklis,
"Branching
Bandits and Klimov's Problem: Achievable Region and Side Constraints"
,
IEEE Transactions on Automatic Control, Vol. 40, No. 12,
December 1995, pp. 20632075.

J. N. Tsitsiklis, "Efficient
Algorithms for Globally Optimal Trajectories", IEEE Transactions
on Automatic Control, Vol. 40, No. 9, September 1995, pp. 15281538.

J. N. Tsitsiklis and G. D. Stamoulis,
"On the Average Communication
Complexity of Asynchronous Distributed Algorithms",
Journal of the ACM, Vol. 42, No. 2, March 1995, pp. 382400.

D. N. C. Tse, R. G. Gallager, and J. N. Tsitsiklis,
"Statistical Multiplexing of Multiple TimeScale Markov Streams",
IEEE Journal on Selected Areas in
Communications, Vol. 13, No. 6, August 1995, pp. 10281038.

M. A. Dahleh, E. D. Sontag, D. N. C. Tse, and J. N. Tsitsiklis,
"WorstCase Identification of Nonlinear Fading Memory Systems",
Automatica, Vol. 31, No. 3, March 1995, pp. 503508.

G. D. Stamoulis and J. N. Tsitsiklis,
"The
Efficiency of Greedy Routing
in Hypercubes and Butterflies",
IEEE Transactions on Communications, Vol. 42, No. 11, November 1994,
pp. 30513061.

Z.Q. Luo and J. N. Tsitsiklis,
"Data Fusion with Minimal
Communication", IEEE Transactions on
Information Theory, Vol. 40, No. 5, September 1994, pp. 15511563.

J. N. Tsitsiklis,
"Asynchronous Stochastic Approximation and
Qlearning", Machine Learning, 16, 1994, pp. 185202.
Correction.

S. R. Kulkarni, S. K. Mitter, T. J. Richardson, and J. N.
Tsitsiklis,
"Local versus NonLocal Computation of Length of
Digitized Curves",
IEEE Transactions on Pattern Analysis and Machine Intelligence,
Vol. 16, No. 7, July 1994.

W. W. Irving and J. N. Tsitsiklis,
"Some Properties of Optimal Thresholds in Decentralized Detection",
IEEE Transactions on Automatic Control,
Vol. 39, No. 4, April 1994, pp. 835838.

D. Bertsimas, I. C. Paschalidis, and J. N. Tsitsiklis,
"Optimization of Multiclass Queueing Networks: Polyhedral and
Nonlinear Characterizations of Achievable Performance",
Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 4375.

J. N. Tsitsiklis,
"A Short Proof of the Gittins Index Theorem",
Annals of Applied Probability, Vol. 4, No. 1, 1994, pp. 194199.

Z.Q. Luo and J. N. Tsitsiklis,
"On the Communication
Complexity of Distributed Algebraic Computation",
Journal of the ACM, Vol. 40, No. 5, pp. 10191047, November 1993.

S. R. Kulkarni, S. K. Mitter, J. N. Tsitsiklis, and O. Zeitouni,
"PAC Learning with Generalized Samples and an Application to Stochastic
Geometry", IEEE Transactions on Pattern Analysis
and Machine Intelligence, Vol. 15, No. 9, September 1993.

D. Bertsimas and J. N. Tsitsiklis,
"Simulated Annealing",
Statistical Science, Vol. 8, No. 1, 1993, pp. 1015.

G. D. Stamoulis and J. N. Tsitsiklis,
"Efficient Routing
Schemes for Multiple Broadcasts in Hypercubes",
IEEE Transactions on Parallel and Distributed Systems,
Vol. 4, No. 7, July 1993, pp. 725739.

D. N. C. Tse, M. A. Dahleh, J. N. Tsitsiklis,
"Optimal Asymptotic Identification under Bounded Disturbances",
IEEE Transactions on Automatic Control, Vol. AC38, No. 8,
1993, pp. 11761190.

G. D. Stamoulis and J. N. Tsitsiklis, "An Efficient Algorithm
for Multiple Simultaneous Broadcasts in the Hypercube",
Information Processing Letters, Vol. 46, 1993, pp. 219224.

J. N. Tsitsiklis,
"Extremal Properties of LikelihoodRatio
Quantizers", IEEE Transactions on
Communications, Vol. 41, No. 4, 1993, pp. 550558.

S. R. Kulkarni, S. K. Mitter and J. N. Tsitsiklis,
"Active Learning
Using Arbitrary Binary Valued Queries",
Machine Learning, Vol. 11, 1993, pp. 2335.

M. A. Dahleh, T. Theodosopoulos, and J. N. Tsitsiklis,
"The Sample Complexity of WorstCase Identification of F.I.R.
Linear Systems", Systems and Control Letters, Vol. 20,
1993, pp. 157166.

H. N. Psaraftis and J. N. Tsitsiklis,
"Dynamic Shortest Paths
in Acyclic Networks
with Markovian Arc Costs",
Operations Research, Vol. 41, 1, 1993, pp. 91101.

J. N. Tsitsiklis,
"Special Cases of Traveling Salesman and
Repairman Problems with Time Windows",
Networks., Vol. 22,No. 3, 1992, pp. 263282.

S. Buss, C. H. Papadimitriou, and J. N. Tsitsiklis,
"On the Predictability of Coupled Automata: an Allegory about Chaos",
Complex Systems, Vol. 5, No. 5, 1991, pp. 525539.

Z.Q. Luo and J. N. Tsitsiklis,
"On the Communication Complexity
of Solving a Polynomial Equation", SIAM J. on
Computing, Vol. 20, No. 5, October 1991, pp. 936950.

D. P. Bertsekas and J. N. Tsitsiklis,
"An Analysis of Stochastic
Shortest Path Problems", Mathematics of Operations
Research, Vol. 16, No. 3, August 1991, pp. 580595.

C.S. Chow and J. N. Tsitsiklis,
"An Optimal OneWay Multigrid
Algorithm for DiscreteTime Stochastic Control",
IEEE Transactions on Automatic Control, Vol. AC36, No. 8,
1991, pp. 898914.

N. Pippenger, G. D. Stamoulis, and J. N. Tsitsiklis,
"On a Lower Bound for the Redundancy of Reliable Networks with Noisy
Gates", IEEE Transactions on Information Theory,
Vol. IT37, May 1991, pp. 639643.

D. P. Bertsekas, C. Ozveren, G. D. Stamoulis, P. Tseng,
and
J. N. Tsitsiklis, "Optimal Communication Algorithms for Hypercubes"
Journal of Parallel and Distributed
Computing, Vol. 11, 1991, pp. 263275.

D. P. Bertsekas and J. N. Tsitsiklis,
"Some
Aspects of Parallel and Distributed
Iterative Algorithms  A Survey",
Automatica, Vol. 27, No. 1, 1991, pp. 321.

G. D. Stamoulis and J. N. Tsitsiklis,
"On the Settling Time of
the Congested GI/G/1 Queue", Advances in
Applied Probability, Vol. 22, 1990, pp. 929956.

P. Tseng, D. P. Bertsekas, and J. N. Tsitsiklis,
"Partially
Asynchronous, Parallel Algorithms for Network Flow and other
Problems", SIAM Journal on Control and Optimization, Vol. 28,
No. 3, May 1990, pp. 678710.

G. Polychronopoulos and J. N. Tsitsiklis,
"Explicit
Solutions for some
Simple Decentralized Detection Problems",
IEEE Transactions on Aerospace and Electronic Systems, Vol. 26,
1990, pp. 282291.

C.S. Chow and J. N. Tsitsiklis, "The
Complexity of Dynamic Programming", Journal of
Complexity, Vol. 5, No. 4, 1989, pp. 466488. (errata)

J. N. Tsitsiklis,
"A Comparison of Jacobi and GaussSeidel
Parallel Iterations", Applied Mathematics
Letters, Vol. 2, No. 2, 1989, pp. 167170.

J. N. Tsitsiklis,
"On the Use of Random Numbers in
Asynchronous Simulation via Rollback",
Information Processing Letters, Vol. 31, 1989, pp. 139144.

J. N. Tsitsiklis,
"On the Control of Discrete Event Dynamical
Systems",
Mathematics of Control, Signals and Systems, Vol. 2, No.
2, 1989, pp. 95107.

J. N. Tsitsiklis,
"Markov Chains with Rare Transitions and Simulated
Annealing", Mathematics of Operations Research, Vol. 14,
No. 1, 1989, pp. 7090.

D. E. Knuth, C. H. Papadimitriou, J. N. Tsitsiklis,
"A Note
on Strategy Elimination in Bimatrix Games",
Operations Research Letters, Vol. 7, No. 3, 1988, pp. 103107.

J. N. Tsitsiklis,
"Decentralized Detection by a Large Number of
Sensors", Mathematics of Control, Signals and Systems, Vol. 1,
No. 2, 1988, pp. 167182.

J. N. Tsitsiklis,
"On the Stability of Asynchronous Iterative
Processes",
Mathematical Systems Theory, Vol. 20, No. 23,
1987, pp. 137153.

J. N. Tsitsiklis and Z.Q. Luo,
"Communication Complexity
of Convex Optimization", Journal of
Complexity, Vol. 3, No. 3, 1987, pp. 231243.

J. N. Tsitsiklis,
"Analysis of a Multiaccess Control Scheme",
IEEE Transactions on Automatic Control, Vol. 32, No. 11,
1987, pp. 10171020.

C. H. Papadimitriou and J. N. Tsitsiklis,
"The Complexity of
Markov Decision Processses", Mathematics of
Operations Research, Vol. 12, No. 3, 1987, pp. 441450.

C. H. Papadimitriou and J. N. Tsitsiklis,
"Stochastic Scheduling with
InTree Precedence Constraints", SIAM Journal
on Computing, Vol. 16, No. 1, 1987, pp. 16.

J. N. Tsitsiklis, D. P. Bertsekas and M. Athans,
"Distributed
Asynchronous Deterministic and Stochastic Gradient Optimization
Algorithms," IEEE Transactions on Automatic
Control, Vol. 31, No. 9, 1986, pp. 803812.

J. N. Tsitsiklis,
C. H. Papadimitriou and P. Humblet,
"The Performance of a PrecedenceBased
Queueing Discipline", Journal of the ACM, Vol. 33, No. 3,
1986, pp. 593602.

C. H. Papadimitriou and J. N. Tsitsiklis,
"Intractable Problems
in Control Theory", SIAM Journal on Control and
Optimization, Vol. 24, No. 4, 1986, pp. 639654.

J. N. Tsitsiklis,
"A Lemma on the MultiArmed Bandit
Problem", IEEE Transactions on Automatic Control, Vol. 31, No. 6,
1986, pp. 576577.

J. N. Tsitsiklis and D. P. Bertsekas,
"Distributed Asynchronous
Optimal Routing in Data Networks", IEEE
Transactions on Automatic Control, Vol. 31, No. 4, 1986, pp. 325332.

B. C. Levy and J. N. Tsitsiklis,
"A Fast Algorithm for the Linear
Estimation of TwoDimensional Isotropic Random Fields", IEEE
Transactions on Information Theory, Vol. 31, No. 5, 1985, pp. 635644.

J. N. Tsitsiklis and M. Athans,
"On the Complexity of Decentralized
Decision Making and Detection Problems", IEEE Transactions on
Automatic Control, Vol. 30, No.5, 1985, pp. 440446.

J. N. Tsitsiklis,
"Periodic Review Inventory Systems with
Continuous Demand and Discrete Order Sizes",
Management Science, Vol.
30, No. 10, 1984, pp. 12501254.

C. H. Papadimitriou and J. N. Tsitsiklis, "A Simple
Criterion for Structurally Fixed Modes", Systems and Control
Letters, Vol. 4, 1984, pp. 333337.

J. N. Tsitsiklis,
"Convexity and Characterization of Optimal Policies
in a Dynamic Routing Problem", Journal of Optimization Theory
and Applications, Vol. 44, No. 1, 1984, pp. 105136.

J. N. Tsitsiklis and M. Athans,
"Guaranteed Robustness
Properties of Multivariable Nonlinear
Stochastic Optimal Regulators", IEEE Transactions on Automatic
Control, Vol. 29, No. 8, 1984, pp. 690696.

J. N. Tsitsiklis and M. Athans,
"Convergence and
Asymptotic Agreement in Distributed Decision Problems", IEEE
Transactions on Automatic Control, Vol. 29, No. 1, 1984, pp. 4250.

C. H. Papadimitriou and J. N. Tsitsiklis,
"On the Complexity of
Designing Distributed Protocols", Information and Control,
Vol. 53, No. 3, 1982, pp. 211218.

J. N. Tsitsiklis,
"Conditions for Finiteness of a
Constructive Algorithm for Determining Stability", IEEE
Transactions on Circuits and Systems, Vol. 29, No. 6, 1982, pp.
400402.
Theses

J. N. Tsitsiklis, "Linear Optimization Problems with Dynamical Structure", B.Sc.
Thesis, Department of EECS, MIT, January 1980.

J. N. Tsitsiklis, "Optimal Dynamic Routing in an Unreliable Manufacturing System",
M.Sc. Thesis, Department of EECS, MIT, February 1981; technical report
LIDSTH1069, Laboratory for Information and Decision Systems, MIT.

J. N. Tsitsiklis,
"Problems in Decentralized Decision Making and Computation,"
Ph.D. Thesis, Department of EECS, MIT, November 1984; technical report
LIDSTH1424, Laboratory for Information and Decision Systems, MIT.
Selected nonjournal publications

W. P. Tay and J. N. Tsitsiklis,
"The Value of Feedback for Decentralized Detection
in Large Sensor Networks",
Proceedings of the IEEE International Symposium on Wireless Pervasive Computing (ISWPC 2011), Hong Kong, China, February 2011.

F. Benezit, V. Blondel, P. Thiran, J. Tsitsiklis, and M. Vetterli, "Weighted Gossip: Distributed Averaging Using
NonDoubly Stochastic Matrices," 2010 IEEE International Symposium on Information Theory,
Austin, Texas, June 2010.

M. G. Markakis, E. M. Modiano, and J. N. Tsitsiklis,
"Scheduling policies
for singlehop networks with heavytailed traffic," Proceedings of the FortySeventh Annual Allerton Conference on Communication, Control, and Computing,
Monticello, Illinois, September 2009.

A. Nedic, A. Olshevsky, A. Ozdaglar, and J. N. Tsitsiklis,
"Distributed Subgradient Methods and Quantization Effects,"
Proceedings of the
47th IEEE Conference on Decision
and Control, Cancun, Mexico, December 2008.

V. D. Blondel, J. M. Hendrickx, A. Olshevsky, and J. N. Tsitsiklis,
"Convergence in Multiagent Coordination, Consensus, and Flocking," in Proceedings of the
Joint 44th IEEE Conference on Decision
and Control and European Control Conference (CDCECC'05), Seville, Spain, December 2005. [corrected version]

R. Johari and J. N. Tsitsiklis, "Routing and Peering in a
Competitive Internet", technical report LIDSP2570, January 2003;
condensed version in
Proceedings of the 2004 IEEE Conference on Decision and Control, Bahamas, December 2004.

A. Muharremoglu and J. N. Tsitsiklis,
"Dynamic Leadtime Management in Supply Chains,"
unpublished manuscript,
June 2003.

V. D. Blondel and J. N. Tsitsiklis,
"Three Problems on the Decidability and Complexity of Stability,"
in
Open Problems in Mathematical Systems and Control Theory,
V.D. Blondel, E.D. Sontag, M. Vidyasagar, J.C. Willems (editors),
Springer Verlag, Heidelberg, 1998.

V. D. Blondel and J. N. Tsitsiklis,
"Overview of complexity and
decidability results for three classes of elementary
nonlinear systems",
in Learning, Control and Hybrid Systems, Y. Yamamoto and S. Hara (Eds),
Springer Verlag, Heidelberg, 1998, 4658.
 D. Bertsimas, D. Gamarnik, and J. N. Tsitsiklis,
"Geometric Bounds for Stationary Distributions of Infinite
Markov Chains Via Lyapunov Functions,"
technical report LIDSP2426, September 1998.

P. Marbach, and J. N. Tsitsiklis,
"A NeuroDynamic Programming Approach
to Call Admission Control in Integrated Service
Networks: The Single Link Case,"
Technical Report LIDSP2402,
Laboratory for Information and Decision Systems,
M.I.T.,
November 1997.
Short version
in Proceedings of the 2003 IEEE
Conference on Decision and Control, Maui, Hawaii, December 2003.

B. Van Roy, D. P. Bertsekas, Y. Lee, and J. N. Tsitsiklis,
"A NeuroDynamic Programming Approach to Retailer Inventory Management",
November 1996.
Short version in Proceedings of the 36th IEEE
Conference on Decision and Control, San Diego, California, December
1997, pp. 40524057.

C. E. Padilla, V. I. Karlov, J. N. Tsitsiklis, R. D. Reasenberg,
H. M. Chun, "Problem of Fringe Acquisition in HighPrecision SpaceBased
Interferometers", SPIE
Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida,
April 1995, p. 47.

C. E. Padilla, V. I. Karlov, J. N. Tsitsiklis, R. D. Reasenberg,
H. M. Chun,
"A Study of Fringe Tracking for HighPrecision SpaceBased
Interferometers", SPIE
Conference # 2477 on Spaceborne Interferometry II, Orlando, Florida,
April 1995, p. 63.

G. D. Stamoulis and J. N. Tsitsiklis, "Optimal Distributed
Policies for Choosing Among Multiple Servers", Proceedings of
the 30th IEEE Conference on Decision and Control, Brighton, England,
December 1991, pp. 815820.

D. P. Bertsekas and J. N. Tsitsiklis,
"Convergence Rate and
Termination of Asynchronous Iterative Algorithms", in Proceedings of
the 1989 International Conference on Supercomputing, Irakleion, Greece,
June 1989, pp. 461470.

Z.Q. Luo and J. N. Tsitsiklis,
"Lower
Bounds on the Time to Compute a Simple Boolean Function on a Parallel
Random Access Machine," Technical
Report LIDSP1616, Laboratory for Information and Decision Systems,
M.I.T., October 1986.

J. N. Tsitsiklis and B. C. Levy, "Integral Equations and Resolvents of
Toeplitz plus Hankel Kernels", Technical Report LIDSP1170, Laboratory
for Information and Decision Systems, M.I.T., December 1981.

B. C. Levy and J. N. Tsitsiklis, "Linear Estimation of
Stationary Stochastic Processes, Vibrating Strings,
and Inverse Scattering",
Technical Report LIDSP1155, Laboratory
for Information and Decision Systems, M.I.T., November 1982.