Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
1–10 of 49 posts
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#2hmm...maybe the way we then encode data digitally is also "wrong" or should I say unnatural.
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#3"... which explains why natural languages are poorly approximated by Markov processes."
Is that a joke? It's 2016 and you think you need to explain that a Markov process is a poor approximation of natural language? This has been obvious for computational linguists, and anyone working in the field, from day one.
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#4I wonder what programming languages look like? I'd guess a lot like natural language?
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#5 The Bach data consists of 5727 notes from Partita No. 2 [11],
with all notes mapped into a 12-symbol alphabet
consisting of the 12 half-tones {C, C#, D, D#, E, F, F#, G, G#, A, A#, B}
with all timing, volume and octave informationI was good until the last part.
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#6The Bach data consists of 5727 notes from Partita No. 2 [11], with all notes mapped into a 12-symbol alphabet consisting of the 12 half-tones {C, C#, D, D#, E, F, F#, G, G#, A, A#, B} with all timing, volume and octave information discarded. I was good until the last part.
Can you elaborate?
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#7The Bach data consists of 5727 notes from Partita No. 2 [11], with all notes mapped into a 12-symbol alphabet consisting of the 12 half-tones {C, C#, D, D#, E, F, F#, G, G#, A, A#, B} with all timing, volume and octave information discarded. I was good until the last part.
Was this a sample of text generated by a Markov chain or their 'new' model?
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#8I wonder what programming languages look like? I'd guess a lot like natural language?
Not quite, but as the paper says:
Corollary: No probabilistic regular grammar
exhibits criticality.
In the next section, we will show that this statement is
not true for context-free grammars (CFGs).
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#9I wonder what programming languages look like? I'd guess a lot like natural language?
Not quite, but as the paper says: Corollary: No probabilistic regular grammar exhibits criticality. In the next section, we will show that this statement is not true for context-free grammars (CFGs). That is, there exists CFGs that exhibit criticality. Programming languages are often parsed by CFGs, so it's likely that some programming languages exhibit the same criticality structure as natural languages.
I think that means only that programs written in a language described by a CFG could exhibit "criticality", not that they will. "Exhibiting criticality" is a property of a distribution (e.g. a corpus of human-written programs or an algorithm for generating programs), not of a grammar, IIUC.
Re: Critical Behavior from Deep Dynamics: A Hidden Dimension in Natural Language
#10The Bach data consists of 5727 notes from Partita No. 2 [11], with all notes mapped into a 12-symbol alphabet consisting of the 12 half-tones {C, C#, D, D#, E, F, F#, G, G#, A, A#, B} with all timing, volume and octave information discarded. I was good until the last part.
Can you elaborate?
[deleted]