Arquivo para May 6th, 2019

Playing with the mind: Claude Shannon

06 May

It was time to pay tribute at the time of Claude Shannon’s contribution and genius, two journalists wrote in 2017 a book about the one that, in our vision with Vannevar Bush of whom he was a MIT lecturer, created Information Theory, although the name might be different, he knew he used information like “machine.”

In the book the information will be called a message, but it could be a sign. I did not read the book, but it was studying the Boolean Algebra that Shannon started to make a digital world, but opposing the analog is the second misconception because everything we do is analog, the clock for example, there is an analogy with the movement of the sun and of course, the rotation of the earth.

In his master’s thesis, in 1937 he analyzed electric circuits that were based only on “yes” or “no”, with connectives “and” or “and” and “not”, and it will be only in his 1948 work that his “Mathematical Theory of Communication”, became Information Theory.

The basic idea was based on calculations of the amount of information needed for a message (I prefer a signal) so that information (of human origin, transmitted by a channel or physical medium) does not lose its original relevance.

Few books have so many citations in relevant works, the book cites 91,000, and virtually the entire theory of “signal processing,” “imaging,” and any information transformed into digital “signal” must use its theory.

The central contribution of his work is called “sampling theory”, which states that in any system the maximum sampling frequency must be at least twice the highest frequency of the signal to be transmitted.

For example, an audible sound to the human ear, which reaches the maximum at 20 KHz, should have a sampling rate of at least 40 KHz. In addition to anticipating the computer along with Alan Turing, also the first Machine Learning, quite simple, but sophisticated for that time, a mouse robot in a maze: