Fetching the paper…
Reading the bibliography…
Heating, Ventilation, and Air Conditioning (HVAC) is extremely energy-consuming, accounting for 40% of total building energy consumption.
G. E. Uhlenbeck and L. S. Ornstein, “On the theory of the brownian motion,” Physical review , vol. 36, no. 5, p. 823, 1930
1930
Earlier work this paper cites.
F. D. Foresee and M. T. Hagan, “Gauss-newton approximation to bayesian learning,” in Proceedings of the 1997 international joint conference on neural networks , vol. 3. Piscataway: IEEE, 1997, pp. 1930–1935
1935
Earlier work this paper cites.
G. J. Levermore, Building energy management systems: An application to heating and control . E & FN Spon, 1992
1992
Earlier work this paper cites.
A. society of heating refrigerating and air conditioning engineers, ASHRAE STANDARD: An American Standard: Thermal Environmental Conditions for Human Occupancy . American Society of Heating refrigerationg and air conditioning engineers, 1992
1992
Earlier work this paper cites.
M. T. Hagan and M. B. Menhaj, “Training feedforward networks with the marquardt algorithm,” IEEE transactions on Neural Networks , vol. 5, no. 6, pp. 989–993, 1994
1994
Earlier work this paper cites.
A. I. Dounis, M. Bruant, M. Santamouris, G. Guarracino, and P. Michel, “Comparison of conventional and fuzzy control of indoor air quality in buildings,” Journal of Intelligent & Fuzzy Systems , vol. 4, no. 2, pp. 131–140, 1996
1996
Earlier work this paper cites.
R. J. De Dear, “A global database of thermal comfort field experiments,” ASHRAE transactions , vol. 104, p. 1141, 1998
1998
Earlier work this paper cites.
S. Wang and X. Jin, “Model-based optimal control of VAV air-conditioning system using genetic algorithm,” Building and Environment , vol. 35, no. 6, pp. 471–487, 2000
2000
Earlier work this paper cites.
M. Kummert, P. André, and J. Nicolas, “Optimal heating control in a passive solar commercial building,” Solar Energy , vol. 69, pp. 103–116, 2001
2001
Earlier work this paper cites.
A. Shepherd and W. Batty, “Fuzzy control strategies to provide cost and energy efficient high quality indoor environments in buildings with high occupant densities,” Building Services Engineering Research and Technology , vol. 24, no. 1, pp. 35–45, 2003
2003
Earlier work this paper cites.
F. Calvino, M. La Gennusa, G. Rizzo, and G. Scaccianoce, “The control of indoor thermal comfort conditions: Introducing a fuzzy adaptive controller,” Energy and buildings , vol. 36, no. 2, pp. 97–102, 2004
2004
Earlier work this paper cites.
C. W. Anderson, D. Hittle, M. Kretchmar, P. Young, J. Si, A. Barto, W. Powell, and D. Wunsch, “Robust reinforcement learning for heating, ventilation, and air conditioning control of buildings,” Handbook of Learning and Approximate Dynamic Programming , pp. 517–534, 2004
2004
Earlier work this paper cites.
S. P. Corgnati, M. Filippi, and S. Viazzo, “Perception of the thermal environment in high school and university classrooms: Subjective preferences and thermal comfort,” Building and environment , vol. 42, no. 2, pp. 951–959, 2007
2007
Earlier work this paper cites.
K. Dalamagkidis, D. Kolokotsa, K. Kalaitzakis, and G. S. Stavrakakis, “Reinforcement learning for energy conservation and comfort in buildings,” Building and environment , vol. 42, no. 7, pp. 2686–2698, 2007
2007
Cited alongside, same era.
L. Pérez-Lombard, J. Ortiz, and C. Pout, “A review on buildings energy consumption information,” Energy and buildings , vol. 40, no. 3, pp. 394–398, 2008
2008
Cited alongside, same era.
A. I. Dounis and C. Caraiscos, “Advanced control systems engineering for energy and comfort management in a building environment—A review,” Renewable and Sustainable Energy Reviews , vol. 13, no. 6-7, pp. 1246–1261, 2009
2009
Cited alongside, same era.
F. Oldewurtel, A. Parisio, C. Jones, M. Morari, D. Gyalistras, M. Gwerder, V. Stauch, B. Lehmann, and K. Wirth, “Energy efficient building climate control using stochastic model predictive control and weather predictions,” in Proceedings of the 2010 American control conference , no. EPFL-CONF-169733. Ieee Service Center, 445 Hoes Lane, Po Box 1331, Piscataway, Nj 08855-1331 Usa, 2010, pp. 5100–5105
D. Silver, G. Lever, N. Heess, T. Degris, D. Wierstra, and M. Riedmiller, “Deterministic policy gradient algorithms,” in ICML , 2014
2014
Later among the works it cites.
E. Barrett and S. Linder, “Autonomous HVAC control, a reinforcement learning approach,” in Joint European Conference on Machine Learning and Knowledge Discovery in Databases . Springer, 2015, pp. 3–19
2015
Later among the works it cites.
B. Li and L. Xia, “A multi-grid reinforcement learning method for energy conservation and comfort of HVAC in buildings,” in Automation Science and Engineering (CASE), 2015 IEEE International Conference on . IEEE, 2015, pp. 444–449
2015
Later among the works it cites.
2015
Later among the works it cites.
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
2010
Cited alongside, same era.
M. Maasoumy, A. Pinto, and A. Sangiovanni-Vincentelli, “Model-based hierarchical optimal control design for HVAC systems,” in ASME 2011 Dynamic Systems and Control Conference and Bath/ASME Symposium on Fluid Power and Motion Control . American Society of Mechanical Engineers, 2011, pp. 271–278
2011
Cited alongside, same era.
Y. Cheng, J. Niu, and N. Gao, “Thermal comfort models: A review and numerical investigation,” Building and Environment , vol. 47, pp. 13–22, 2012
2012
Cited alongside, same era.
M. van Otterlo and M. Wiering, “Reinforcement learning and markov decision processes,” in Reinforcement Learning . Springer, 2012, pp. 3–42
2012
Cited alongside, same era.
Y. Ma, F. Borrelli, B. Hencey, B. Coffey, S. Bengea, and P. Haves, “Model predictive control for the operation of building cooling systems,” IEEE Transactions on control systems technology , vol. 20, no. 3, pp. 796–803, 2012
2012
Cited alongside, same era.
D. Nikovski, J. Xu, and M. Nonaka, “A method for computing optimal set-point schedules for HVAC systems,” in REHVA World Congress CLIMA’13 , 2013
2013
Cited alongside, same era.
A. Zenger, J. Schmidt, and M. Krödel, “Towards the intelligent home: Using reinforcement-learning for optimal heating control,” in Annual Conference on Artificial Intelligence . Springer, 2013, pp. 304–307
2013
Cited alongside, same era.
P. Fazenda, K. Veeramachaneni, P. Lima, and U.-M. O’Reilly, “Using reinforcement learning to optimize occupant comfort and energy usage in HVAC systems,” Journal of Ambient Intelligence and Smart Environments , vol. 6, no. 6, pp. 675–690, 2014
2014
Cited alongside, same era.
T. Wei, Q. Zhu, and M. Maasoumy, “Co-scheduling of HVAC control, EV charging and battery usage for building energy efficiency,” in Proceedings of the 2014 IEEE/ACM International Conference on Computer-Aided Design . IEEE Press, 2014, pp. 191–196
2014
Cited alongside, same era.
V. Mnih, K. Kavukcuoglu, D. Silver, A. A. Rusu, J. Veness, M. G. Bellemare, A. Graves, M. Riedmiller, A. K. Fidjeland, G. Ostrovski et al. , “Human-level control through deep reinforcement learning,” Nature , vol. 518, no. 7540, p. 529, 2015
2015
Later among the works it cites.
J. Pan, R. Jain, S. Paul, T. Vu, A. Saifullah, and M. Sha, “An internet of things framework for smart energy in buildings: designs, prototype, and experiments,” IEEE Internet of Things Journal , vol. 2, no. 6, pp. 527–537, 2015
2015
Later among the works it cites.
T. Wei, Y. Wang, and Q. Zhu, “Deep reinforcement learning for building HVAC control,” in Design Automation Conference (DAC), 2017 54th ACM/EDAC/IEEE . IEEE, 2017, pp. 1–6
2017
Later among the works it cites.
Y. Wang, K. Velswamy, and B. Huang, “A long-short term memory recurrent neural network based reinforcement learning controller for office heating ventilation and air conditioning systems,” Processes , vol. 5, no. 3, p. 46, 2017
2017
Later among the works it cites.
D. Minoli, K. Sohraby, and B. Occhiogrosso, “IoT considerations, requirements, and architectures for smart buildings—energy optimization and next-generation building management systems,” IEEE Internet of Things Journal , vol. 4, no. 1, pp. 269–283, 2017
2017
Later among the works it cites.
“TRNSYS: Transient system simulation tool,” http://www.trnsys.com
2018
Later among the works it cites.
“Pytorch: An open source deep learning platform,” https://pytorch.org
2018
Later among the works it cites.
“MySQL: the world’s most popular open source database,” https://www.mysql.com
2018
Later among the works it cites.