ILAnet
Kullback–Leibler divergence of a prior from the truth
"Another interpretation of KL divergence is this: suppose a number X is about to be drawn randomly from a discrete set with probability distribution p(x). If Alice knows the true distribution p(x), while Bob believes (has a prior) that the distribution is q(x), then Bob will be more surprised than Alice, on average, upon seeing the value of X. The KL divergence is the (objective) expected value of Bob's (subjective) surprisal minus Alice's surprisal, measured in bits if the log is in base 2. In this way,
the extent to which Bob's prior is "wrong" can be quantified in terms of how "unnecessarily surprised" it's expected to make him
[Português: a medida em que a prévia de Bob está "errada" pode ser quantificada em termos do quão "desnecessariamente surpreso" espera-se fazê-lo]" (Wikipedia, 2014).
Português:
teoria da informação
Claude Shannon. Available from <
http://en.wikipedia.org/wiki/Claude_Shannon
>. access on 19 October 2014.
Information theory. Available from <
http://en.wikipedia.org/wiki/Information_theory
>. Português: <
http://translate.google.com/translate?hl=pt-BR&sl=en&tl=pt&u=http%3A%2F%2Fen.wikipedia.org%2Fwiki%2FInformation_theory
>. access on 19 October 2014.
http://www.google.com.br/search?hl=pt-BR&q=orientation+community+%22information+theory%22&btnG=Pesquisar
InformationTheory
TeoriaDaInformacao
ValorDaInformacao
Number of topics:
3
Express
Number of topics:
0
Ágora
Appreciation
Number of topics:
1
Persona
Number of topics:
0
Community
Efficiency
/
Eficiência
Community
/
Comunidade
Twitter
Pipl
Annual report
/
Balanço anual
Research social networks
/
Redes sociais de pesquisa
Wikipedia
Personality
/
Individualidade
Sociability
/
Sociabilidade
--
GregorioIvanoff
- 19 Oct 2014
Revision: r1.2 - 21 Nov 2019 - 15:37 -
GregorioIvanoff
Ilanet
>
Visao
>
VisaoDoConhecimento
>
ComunicacaoEmVisaoDoConhecimento
>
Valores
>
Mobilidade
>
Trabalho
>
AgirOrganizacional
>
SujeitoAgente
>
Agente
>
AgentesDeConhecimento
>
ValorDaInformacao
>
InformationTheory
Direitos de cópia © 1999-2024 pelos autores que contribuem. Todo material dessa plataforma de colaboração é propriedade dos autores que contribuem.
Ideias, solicitações, problemas relacionados a Ilanet?
Dê sua opinião
Copyright © 1999-2024 by the contributing authors. All material on this collaboration platform is the property of the contributing authors.
Ideas, requests, problems regarding Ilanet?
Send feedback