[{"@context":"http:\/\/schema.org\/","@type":"BlogPosting","@id":"https:\/\/wiki.edu.vn\/en\/wiki21\/energy-based-generative-neural-network-wikipedia\/#BlogPosting","mainEntityOfPage":"https:\/\/wiki.edu.vn\/en\/wiki21\/energy-based-generative-neural-network-wikipedia\/","headline":"Energy-based generative neural network – Wikipedia","name":"Energy-based generative neural network – Wikipedia","description":"before-content-x4 From Wikipedia, the free encyclopedia after-content-x4 Energy-based generative neural networks [1][2][3][4] is a class of generative models, which aim","datePublished":"2016-11-23","dateModified":"2016-11-23","author":{"@type":"Person","@id":"https:\/\/wiki.edu.vn\/en\/wiki21\/author\/lordneo\/#Person","name":"lordneo","url":"https:\/\/wiki.edu.vn\/en\/wiki21\/author\/lordneo\/","image":{"@type":"ImageObject","@id":"https:\/\/secure.gravatar.com\/avatar\/c9645c498c9701c88b89b8537773dd7c?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/c9645c498c9701c88b89b8537773dd7c?s=96&d=mm&r=g","height":96,"width":96}},"publisher":{"@type":"Organization","name":"Enzyklop\u00e4die","logo":{"@type":"ImageObject","@id":"https:\/\/wiki.edu.vn\/wiki4\/wp-content\/uploads\/2023\/08\/download.jpg","url":"https:\/\/wiki.edu.vn\/wiki4\/wp-content\/uploads\/2023\/08\/download.jpg","width":600,"height":60}},"image":{"@type":"ImageObject","@id":"https:\/\/en.wikipedia.org\/wiki\/Special:CentralAutoLogin\/start?type=1x1","url":"https:\/\/en.wikipedia.org\/wiki\/Special:CentralAutoLogin\/start?type=1x1","height":"1","width":"1"},"url":"https:\/\/wiki.edu.vn\/en\/wiki21\/energy-based-generative-neural-network-wikipedia\/","wordCount":3710,"articleBody":"     (adsbygoogle = window.adsbygoogle || []).push({});before-content-x4From Wikipedia, the free encyclopedia       (adsbygoogle = window.adsbygoogle || []).push({});after-content-x4Energy-based generative neural networks [1][2][3][4]  is a class of generative models, which aim to learn explicit probability distributions of data in the form of energy-based models whose energy functions are parameterized by modern deep neural networks. Its name is due to the fact that this model can be derived from the discriminative neural networks. The parameter of the neural network in this model is trained in a generative manner by Markov chain Monte Carlo[5](MCMC)-based maximum likelihood estimation. The learning process follows an ”analysis by synthesis” scheme, where within each learning iteration, the algorithm samples the synthesized examples from the current model by a gradient-based MCMC method, e.g., Langevin dynamics, and then updates the model parameters based on the difference between the training examples and the synthesized ones. This process can be interpreted as an alternating mode seeking and mode shifting process, and also has an adversarial interpretation.[2][3][6] The first energy-based generative neural network is the generative ConvNet [1] proposed in 2016 for image patterns, where the neural network is a convolutional neural network.[7][8] The model has been generalized to various domains to learn distributions of videos,[2][4] and 3D voxels.[3] They are made more effective in their variants.[9][10][11][12][13][14] They have proven useful for data generation (e.g., image synthesis,[1] video synthesis,[2] 3D shape synthesis,[3] etc.), data recovery (e.g., recovering videos with missing pixels or image frames,[2] 3D super-resolution,[3] etc), data reconstruction (e.g., image reconstruction and linear interpolation [10]).References[edit]^ a b c Xie, Jianwen; Lu, Yang; Zhu, Song-Chun; Wu, Ying Nian (2016). “A theory of generative ConvNet”. ICML. arXiv:1602.03264. Bibcode:2016arXiv160203264X.^ a b c d e Xie, Jianwen; Zhu, Song-Chun; Wu, Ying Nian (July 2017). “Synthesizing Dynamic Patterns by Spatial-Temporal Generative ConvNet”. 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE: 1061\u20131069. arXiv:1606.00972. doi:10.1109\/cvpr.2017.119. ISBN\u00a0978-1-5386-0457-1. S2CID\u00a0763074.^ a b c d e Xie, Jianwen; Zheng, Zilong; Gao, Ruiqi; Wang, Wenguan; Zhu, Song-Chun; Wu, Ying Nian (June 2018). “Learning Descriptor Networks for 3D Shape Synthesis and Analysis”. 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE: 8629\u20138638. arXiv:1804.00586. Bibcode:2018arXiv180400586X. doi:10.1109\/cvpr.2018.00900. ISBN\u00a0978-1-5386-6420-9. S2CID\u00a04564025.^ a b Xie, Jianwen; Zhu, Song-Chun; Wu, Ying Nian (2019). “Learning Energy-based Spatial-Temporal Generative ConvNets for Dynamic Patterns”. IEEE Transactions on Pattern Analysis and Machine Intelligence. 43 (2): 516\u2013531. arXiv:1909.11975. Bibcode:2019arXiv190911975X. doi:10.1109\/tpami.2019.2934852. ISSN\u00a00162-8828. PMID\u00a031425020. S2CID\u00a0201098397.^ Barbu, Adrian; Zhu, Song-Chun (2020). Monte Carlo Methods. Springer.^ Wu, Ying Nian; Xie, Jianwen; Lu, Yang; Zhu, Song-Chun (2018). “Sparse and deep generalizations of the FRAME model”. Annals of Mathematical Sciences and Applications. 3 (1): 211\u2013254. doi:10.4310\/amsa.2018.v3.n1.a7. ISSN\u00a02380-288X.^ Lecun, Y.; Bottou, L.; Bengio, Y.; Haffner, P. (1998). “Gradient-based learning applied to document recognition”. Proceedings of the IEEE. 86 (11): 2278\u20132324. doi:10.1109\/5.726791. ISSN\u00a00018-9219. S2CID\u00a014542261.^ Krizhevsky, Alex; Sutskever, Ilya; Hinton, Geoffrey (2012). “ImageNet classification with deep convolutional neural networks” (PDF). NIPS.^ Gao, Ruiqi; Lu, Yang; Zhou, Junpei; Zhu, Song-Chun; Wu, Ying Nian (June 2018). “Learning Generative ConvNets via Multi-grid Modeling and Sampling”. 2018 IEEE\/CVF Conference on Computer Vision and Pattern Recognition. IEEE: 9155\u20139164. arXiv:1709.08868. doi:10.1109\/cvpr.2018.00954. ISBN\u00a0978-1-5386-6420-9. S2CID\u00a04566195.^ a b Nijkamp, Zhu, Song-Chun Wu, Ying Nian, Erik; Hill, Mitch; Zhu, Song-Chun; Wu, Ying Nian (2019). On Learning Non-Convergent Non-Persistent Short-Run MCMC Toward Energy-Based Model. NeurIPS. OCLC\u00a01106340764.{{cite book}}:  CS1 maint: multiple names: authors list (link)^ Cai, Xu; Wu, Yang; Li, Guanbin; Chen, Ziliang; Lin, Liang (2019-07-17). “FRAME Revisited: An Interpretation View Based on Particle Evolution”. Proceedings of the AAAI Conference on Artificial Intelligence. 33: 3256\u20133263. doi:10.1609\/aaai.v33i01.33013256. ISSN\u00a02374-3468.^ Xie, Jianwen; Lu, Yang; Gao, Ruiqi; Zhu, Song-Chun; Wu, Ying Nian (2020-01-01). “Cooperative Training of Descriptor and Generator Networks”. IEEE Transactions on Pattern Analysis and Machine Intelligence. 42 (1): 27\u201345. arXiv:1609.09408. doi:10.1109\/tpami.2018.2879081. ISSN\u00a00162-8828. PMID\u00a030387724. S2CID\u00a07759006.^ Xie, Jianwen; Lu, Yang; Gao, Ruiqi; Gao, Song-Chun (2018). “Cooperative Learning of Energy-Based Model and Latent Variable Model via MCMC Teaching”. Thirty-Second AAAI Conference on Artificial Intelligence. 32. doi:10.1609\/aaai.v32i1.11834. S2CID\u00a09212174.^ Han, Tian; Nijkamp, Erik; Fang, Xiaolin; Hill, Mitch; Zhu, Song-Chun; Wu, Ying Nian (June 2019). “Divergence Triangle for Joint Training of Generator Model, Energy-Based Model, and Inferential Model”. 2019 IEEE\/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE: 8662\u20138671. doi:10.1109\/cvpr.2019.00887. ISBN\u00a0978-1-7281-3293-8. S2CID\u00a057189202.       (adsbygoogle = window.adsbygoogle || []).push({});after-content-x4       (adsbygoogle = window.adsbygoogle || []).push({});after-content-x4"},{"@context":"http:\/\/schema.org\/","@type":"BreadcrumbList","itemListElement":[{"@type":"ListItem","position":1,"item":{"@id":"https:\/\/wiki.edu.vn\/en\/wiki21\/#breadcrumbitem","name":"Enzyklop\u00e4die"}},{"@type":"ListItem","position":2,"item":{"@id":"https:\/\/wiki.edu.vn\/en\/wiki21\/energy-based-generative-neural-network-wikipedia\/#breadcrumbitem","name":"Energy-based generative neural network – Wikipedia"}}]}]