Content Generating Algorithms - Where to Start?

  • Thread starter Thread starter NeoDevin
  • Start date Start date
  • Tags Tags
    Algorithms
Click For Summary

Discussion Overview

The discussion revolves around content generating algorithms, particularly focusing on methods like Markov chains. Participants express interest in learning resources and share insights on existing algorithms and their applications, including humorous takes on automated content generation.

Discussion Character

  • Exploratory
  • Technical explanation
  • Debate/contested

Main Points Raised

  • One participant seeks recommendations for introductory reading on content generating algorithms, indicating a basic programming background.
  • Another participant mentions SCIgen, a generator of nonsensical computer science papers, highlighting its humorous aspect.
  • A comment critiques the method of using Word for generating content instead of LaTeX, suggesting it complicates the process unnecessarily.
  • Markov chains are proposed as a viable method for generating text, with a participant providing a brief explanation of how they work.
  • There is a request for more introductory and in-depth resources specifically on Markov chains.
  • A participant shares a basic outline of the text generation process using probabilities derived from original text, mentioning the use of three-word sequences.
  • Another participant humorously notes that social science papers may have been generated using similar methods and accepted into peer-reviewed journals.

Areas of Agreement / Disagreement

Participants generally agree on the potential of Markov chains for text generation, but there is no consensus on specific resources or methods to start learning about content generating algorithms.

Contextual Notes

Some participants express uncertainty about the specific texts or algorithms used in examples, and there are references to various methods without detailed explanations or validations of their effectiveness.

NeoDevin
Messages
334
Reaction score
2
I want to learn more about content generating algorithms (examples: http://www.abc.net.au/science/news/stories/2007/1842077.htm" ), but I'm not sure where to begin. I have basic programming knowledge, but I figure I can learn any more advanced programming requirements as I go.

Can someone recommend some reading to start with on the subject?

Thanks in advance.
 
Last edited by a moderator:
Technology news on Phys.org
SCIgen the syntactically correct CS technobabble generator (for those moments when you wonder whether certain authors just randomly strung buzz-words together):
http://pdos.csail.mit.edu/scigen/
 
Does anyone else find it hilarious that the book generating program uses automation and copy-pasting in Word instead of just generating a latex source? Sounds like wayyy more of a pain than it has to be...
 
Markov chains can be used.

As he spoke, it was not merely possible, but I wouldn't really be true? Could they enter any of the month, which he lived. 'Why shouldn't we be married in the daytime, and now suddenly she slapped it away from it without discussion, as if she were relieved to hear something really interesting to tell them apart.' Well, then, ask Mrs. Hudson has been galloping all night, from eight in the governors began to reassure Aouda, telling her it no more, and, full of the house for information about the arrowheads themselves. I was weak. Yes, they had found no words for this. This is a nurse here who may some day citizens of Alexandria filled him with the sad news they were always very careful, in accordance with your short term survival scheme you have, rather than fall into the present. He paused. Very likely I have. Then, for pity's sake, Help! The way he stood hid behind a desk on the wall of Chasma Borealis and around six thirty a sudden thought, and so he held his sway. These ruffians, united by our master's wife, who had been unduly anxious concerning the destination of the crab's cerebral portion.

I don't remember what was feed into the generator - some combination of SF books probably.
 
Noone has any suggestions on where to start learning about it?
 
Thanks DavidSnider, that was an interesting read. I'm looking up more information now, hopefully this will lead me where I want to go. If anyone has a more introductory level and in depth source on markov chains, I would be grateful.
 
The basic idea behind the text above is:

1. use some original text to calculate probabilities that given word is followed by other word
2. generate text that retains these probabilities (that is - start with any word, draw the next one using probablities calculated in step one, use this word as a base for the next draw and so on)

If I recall correctly text presented was generated using three words sequences, but it is just a simple extension of the idea.

Edit: Hm, Chasma Borealis suggests Red Mars was used as the input :smile: I really don't remember, I wrote the code several years ago.
 
I've heard rumors that social science papers have been generated this way and accepted into peer reviewed journals =)
 

Similar threads

Replies
86
Views
3K
  • · Replies 8 ·
Replies
8
Views
4K
  • · Replies 6 ·
Replies
6
Views
4K
  • · Replies 13 ·
Replies
13
Views
4K
  • · Replies 6 ·
Replies
6
Views
3K
  • · Replies 4 ·
Replies
4
Views
1K
  • · Replies 6 ·
Replies
6
Views
4K
Replies
63
Views
11K
  • · Replies 5 ·
Replies
5
Views
2K
  • · Replies 5 ·
Replies
5
Views
7K