I thought this was already very well-known among scientists. It's written about often in popular science literature. James Burke mentions it every now and then, saying that these momentary flashes of insight are what separates the innovators "from the rest of us slobs." But, then, I suppose it's a tribute to the challenge of psychology that there is little solid scientific study about the phenomenon itself.
Anyway, I believe that it is related to the simple idea that nervousness and creativity are inversely related, or that...
Smart People Choke Under Pressure
A new study finds that individuals with high working-memory capacity, which normally allows them to excel, crack under pressure and do worse on simple exams than when allowed to work with no constraints. Those with less capacity score low, too, but they tend not to be affected by pressure.
...
"People with lower working-memory capacities are not using that capacity to begin with, so they’re not affected by pressure."
...
Working memory, also known as short-term memory, holds information that is relevant to performance and ensures task focus. It’s what allows us to remember and retrieve information from an early step of a long task, such as long-division math.
"In these math problems students have to perform subtraction and division, and if you’re trying to hold information in your memory and you start worrying about performance, then you can’t use your entire mental capacity to do the math," Beilock explained.
Most of the people on this site probably have higher than average working-memory. You know that you can work on a task for a long period of time, but when you eventually hit a snag, it irritates you a bit. That irritation takes up short-term memory and could make it even more irritating. So you take a break and do something to shake it off.
However, if you do something that you are well-accustomed to, something that doesn't take much of your working memory, like taking a shower, then your memory will be free again and you will
naturally continue the problem, despite your apparent action on something else. What appears like a wonderful insight, when viewed from another angle, could have been the normal conclusion, now long overdue, you would have found had you not snagged. (what makes people snag is another interesting question, huh?)
I have had my memory tested a couple times by academic psychologists and results were mixed. However, most recently, I was tested commercially by the Rockport Institute, which did not take a unilateral view towards working memory. Instead, they divided working memory into three categories.
Number Memory - A list of random 10-digit numbers.
Design Memory - A random "connect the dots" assortment of line segments.
Associative Memory - A list of nonsense words paired with English words.
As you can tell, each is useful for different tasks. Number memory for things like accounting, design memory for art, and associative memory for foreign languages. Note also that number memory does not measure anything about one's ability to perform calculations with numbers, just the ability to keep them in one's mind short term. The Rockport Institute uses these measures among others to test for what careers would suit you.
My results were the following percentile figures:
Number memory - 17
Design memory - 91
Associative memory - 99
I have very high working memory for design and association, but very low for number.
So, to put it all together. According to the article, and assuming these measures are applicable to their view of working memory, in theory, I should noticeably crack under pressure when asked to work with designs and languages, but do just as well under pressure when asked to work with numbers. However, in a low pressure environment, these other levels would rise significantly.
Those of us with low working memory in one area might perform the same as others with those who are otherwise gifted. But we would seemingly not have the same likelihood of having a flash of insight in that area while in a low pressure environment, ceteris paribus.