Tuesday, June 28, 2005

Creating original content through web mining

There are quite a few products out there that artificially inflate your web site content through the use of stealing stories from others who publish RSS feeds.

The basic idea is to find several RSS feeds, based on keywords, match the content that you are trying to create. Download their RSS feed and steal their stories to put on your web site.

It's easy to read RSS and post it to a blog. For example blogger gives you the option of sending stories to your blog through email. So it would be very easy to write a program to read several RSS feeds, filter the stories and send emails to your blog with the contents.

But that's for lame asses who can't create any original content. They are counting on getting high search engine rankings because they have alot of on topic content that changes frequently. It's a desperate attempt to get lots of pages in the search engines.

Alot of these programs sell you on the concept of timed postings. Which would appear to freshen your blog content even when you are on vacation. You can schedule stories weeks in advance and have them posted at timed intervals to your blog.

Any way you cut it, it's still stealing. You could call it stealing on a schedule if you want. But it's still stealing.


What I think is a better idea is the creation of content based on building a knowledge base around a topic. If you have a program that will search the Internet for stories, you can parse the stories into individual sentences. Parsing the sentences further into parts of speech (noun, verb, adjective, etc...) and mapping the relationships between the parts of speech will allow you to build a fact table.

For example, if I were to build a program that searched all the major news markets, for stories on the recent headline of the week. I bet you would find that there are plenty of similarities in the fact tables you would be able to build. The Who, What, When, Where, How and Why would probably all be refected in the stories. Using the fact tables and the relevance of the web site source. i.e. CNN would out rank Bob's news. You could build a structure of words and phrases that establish facts.

When you receive 3 unique sources, all credible I would hope. You could determine this type of fact out weights other facts that maybe only have 1 unique source.

Using the knowledge base of facts all related around a topic of interest, you could create a program that could summarize and create unique paragraphs based on the facts. Which would appear as unique content that is original.

For some time I have thought about creating such a program that would read RSS feeds and filter them based on keyword relavance in the posts. Once I had the text, I would parse it using some type of english language part of speech tagger to determine nouns, verbs, adjectives, etc... All of which would be built into hyperbolic trees of keyword associations, based on the credibility of the source (easily determinable by inbound links and such). After that, I would add in intelligence like word synonyms using a thesaurus and part of speech learning using a dictionary and sentence structure.

Once you have something like this, you would need to create a program like the nonsense generator, that would create a unique template for how you would want your stories to appear. In no time flat, you could create hugh amounts of original content that is not stolen and in fact meets some ethical standard of source notation and value.

Reference: http://nonsense.sourceforge.net/

37 Comments:

Anonymous Anonymous said...

top [url=http://www.c-online-casino.co.uk/]casino online[/url] coincide the latest [url=http://www.casinolasvegass.com/]casino bonus[/url] manumitted no store reward at the foremost [url=http://www.baywatchcasino.com/]online casino
[/url].

Saturday, January 19, 2013 4:00:00 AM  
Blogger oakleyses said...

prada outlet, tiffany and co, michael kors outlet, ray ban sunglasses, replica watches, nike air max, uggs on sale, replica watches, longchamp outlet, louis vuitton outlet, longchamp, prada handbags, michael kors outlet, louis vuitton, christian louboutin outlet, chanel handbags, louboutin, tiffany jewelry, ugg boots, burberry, louboutin shoes, ugg boots, longchamp outlet, louis vuitton, polo ralph lauren outlet, michael kors outlet, michael kors outlet, nike free, gucci outlet, ugg boots, louboutin outlet, kate spade outlet, jordan shoes, louis vuitton outlet, ray ban sunglasses, michael kors outlet, oakley sunglasses, louis vuitton, ugg boots, nike air max, tory burch outlet, nike outlet, michael kors, oakley sunglasses, oakley sunglasses, cheap oakley sunglasses

Tuesday, November 17, 2015 8:55:00 PM  
Blogger oakleyses said...

michael kors, converse pas cher, vans pas cher, tn pas cher, sac guess, coach purses, oakley pas cher, longchamp pas cher, nike roshe, michael kors, lululemon, ralph lauren pas cher, nike air max, true religion outlet, air force, nike air max, mulberry, air max, louboutin pas cher, hogan, new balance pas cher, nike free run uk, nike air max, true religion jeans, ray ban uk, hermes, ralph lauren uk, michael kors, timberland, ray ban pas cher, burberry, michael kors, nike roshe run, hollister pas cher, nike free, abercrombie and fitch, hollister, coach outlet, north face, coach factory outlet, coach outlet, true religion jeans, nike blazer, true religion jeans, north face, lacoste pas cher, sac longchamp, air jordan pas cher, kate spade handbags, vanessa bruno

Tuesday, November 17, 2015 8:57:00 PM  
Blogger oakleyses said...

moncler, doke gabbana outlet, ugg boots uk, barbour jackets, canada goose, ugg pas cher, moncler, replica watches, canada goose outlet, swarovski, ray ban, converse outlet, hollister, hollister, supra shoes, ugg,uggs,uggs canada, pandora jewelry, doudoune canada goose, pandora charms, moncler, louis vuitton, moncler, montre pas cher, vans, moncler, pandora jewelry, louis vuitton, michael kors outlet online, moncler outlet, thomas sabo, swarovski crystal, coach outlet, juicy couture outlet, canada goose outlet, toms shoes, canada goose, pandora charms, moncler, sac louis vuitton pas cher, canada goose uk, louis vuitton, bottes ugg, nike air max, links of london, louis vuitton, juicy couture outlet, gucci, wedding dresses, barbour, ugg,ugg australia,ugg italia, ugg australia, converse

Tuesday, November 17, 2015 9:02:00 PM  
Blogger Wendy Welston said...

It was a positive conversation and each day since then he has made an effort to come and speak to her about his success of the day. Light House Galley |

Thursday, June 02, 2016 4:46:00 AM  
Blogger Unknown said...

This is a smart blog. I mean it you have so much knowledge about this issue and so much passion. Hybra Technology |

Friday, June 03, 2016 7:05:00 AM  
Blogger Gypsy Hadley said...

I just wanted to let you know that what you do really affects peoples lives and that people - like me - truly appreciate it.Bisman Healthy Living |

Monday, June 06, 2016 3:44:00 AM  
Blogger Unknown said...

Hey there! This is my first visit to your blog! We are a collection of volunteers and starting a new project in a community in the same niche. Your blog provided us useful information to work on. You have done a extraordinary job!Mad Ideas Software |

Wednesday, June 08, 2016 2:02:00 AM  
Blogger Cid Croston said...

This is very interesting news website running 24 hours a day to keep their viewer updated all the time. Business of Diving |

Saturday, June 11, 2016 6:16:00 AM  
Blogger Bent Ley said...

The good slicing points and portal easily accept wide range of connections to summarize new ideas with proper scale marketing to run right business.Halabi Travel |

Tuesday, June 14, 2016 12:03:00 AM  
Blogger Ayer Bailey said...

Excellent share, this is a really quality post. In underlying objects theory I’d like to write like this too. Taking time and real effort to make a good article.Town Real Estate |

Tuesday, June 14, 2016 11:07:00 PM  
Blogger Ayer Bailey said...

Interesting and amazing how your post is! It Is Useful and helpful for me That I like it very much, and I am looking forward to Hearing from your next..mindsehealth |

Thursday, June 16, 2016 2:09:00 AM  
Blogger Colvin Cord said...

I am really glad to be here.I hope to see more great articles here in the future too so keep it up and good luck to all of you!ncfirsttimehomebuyer |

Sunday, June 19, 2016 8:57:00 PM  
Blogger Danita Delman said...

Quality content is the crucial to invite the visitors to visit the site, that's what this website is providing.emrsoftwaresite |

Tuesday, June 21, 2016 2:21:00 AM  
Blogger Unknown said...

I am really satisfied with this posting that you have given us. This is really a stupendous work done by you.millerhillbusiness |

Wednesday, June 22, 2016 6:44:00 AM  
Blogger John said...

coach outlet online
michael kors bags
adidas superstar
burberry outlet online
air max outlet
adidas nmd r1
nike free 4.0 flyknit
cheap jordan shoes
cheap jordans for sale
canada goose sale
20161015yuanyuan

Sunday, October 16, 2016 5:15:00 AM  
Blogger Unknown said...

canada goose
rolex replica watches
cheap oakley sunglasses
cheap ugg boots
michael kors bags
cheap jordan shoes
replica omega watches
nike free run
pandora charms sale clearance
michael kors outlet store
zhi20170110

Monday, January 09, 2017 9:37:00 PM  
Blogger Unknown said...

In case you are being guaranteed 24/7 Customer Support and life time replacement then never think hard when you Buy facebook reviews from a service agency. buy facebook reviews

Sunday, August 06, 2017 11:44:00 AM  
Anonymous Obat kanker lambung said...

given article is very helpful and very useful for my admin, and pardon me permission to share articles here hopefully helped :

Cara mengatasi katarak
Cara menyembuhkan asam urat
Obat hepatitis b

Wednesday, May 02, 2018 1:26:00 AM  
Anonymous Pengobatan Sakit Pinggang Secara Cepat said...

This article is interesting and useful. Thank you for sharing. And let me share an article about health that God willing will be very useful. Thank you :)

Penyebab Sering Nyeri Ulu Hati
Solusi untuk Menanggulangi Osteoporosis
Obat Penyakit Crohn
Vitamin Penguat Tulang dan sendi
Cara Mengobati Abses Payudara Tanpa Operasi
Cara Menyembuhkan DBD

Wednesday, June 20, 2018 10:06:00 PM  
Blogger Adnan Qhalby said...

Thanks please share this information if you are face any problem in Toshiba laptop. We will help you for more detail visit here
obat keloid
obat ginjal bengkak
obat thalasemia
obat benjolan di kepala
obat benjolan di payudara

Saturday, June 30, 2018 1:25:00 AM  
Anonymous Obat Syaraf Kejepit Alami said...


Thank you for sharing an interesting and very useful article. And let me share an article about health here I believe this is useful. Thank you :)

Obat Diabetes Herbal, Pengobatan Alami Diabetes
Obat Penghancur Kista, Pengobatan Kista Tanpa Operasi
Cara Mengobati Konjungtivitis Secara Alami
Pengobatan Alami & Efektif untuk Ginjal Bengkak
Pengobatan Alternatif untuk Syaraf Mata Rusak

Wednesday, July 11, 2018 2:43:00 AM  
Anonymous obat bekas jerawat said...

Given article is very helpful and very useful for my admin, and pardon me permission to share articles
here hopefully helped :

cara menghilangkan bekas jerawat
Menghilangkan jerawat batu
Menghilangkan benjolan di leher
Obat pengapuran tulang
Mengatasi Sering Kencing Penyebab Diabetes
Cara Menyembuhkan Kanker Laring

Tuesday, July 24, 2018 8:24:00 PM  
Anonymous Obat Herbal Sapnudin said...

I think this is an informative post and it is very useful and knowledgeable. therefore, I would like to thank you for the efforts you have made in writing this article

cara menghilangkan bekas jerawat
Menghilangkan jerawat batu
Menghilangkan benjolan di leher
Obat pengapuran tulang
Mengatasi Sering Kencing Penyebab Diabetes
Cara Menyembuhkan Kanker Laring
Cara Menghilangkan Kista Coklat

Wednesday, July 25, 2018 8:57:00 PM  
Anonymous Obat Tumor Jinak said...


Thanks for the information, this is very useful. Allow me to share a health article here, which gods are beneficial to us. Thank you :)

Obat Sakit Dada
Penyebab Benjolan dileher
Obat Penghilang Nyeri Lutut
Obat Penghilang Nyeri Pada Payudara
Pengobatan penyakit Meningioma
Obat Luka Bernanah bekas Caesar

Friday, August 10, 2018 7:26:00 PM  
Blogger Adnan Qhalby said...

I think this is an informative post and it is very useful and knowledgeable. therefore, I would like to thank you for the efforts you have made in writing this article.
cara menghilangkan benjolan di tangan
obat limpa bengkak
obat benjolan di selangkangan

Saturday, August 25, 2018 1:54:00 AM  
Anonymous Obat Borok Bernanah said...

Hopefully, sustenance will be easy and simplified in all matters
Cara Mengobati Lymphadenitis
Cara Menghilangkan Sekelan

Monday, August 27, 2018 10:50:00 PM  
Anonymous khasiat dan manfaat obat herbal said...

I am happy to be here and this wonderful article. I have found here lots of interesting information for my knowledge I need. all the details you provide to us, it was very helpful and useful, thanks for sharing this amazing post.


obat benjolan di selangkangan
khasiat obat herbal
Cara menormalkan penglihatan yang buram
Obat herbal penyakit kulit
obat kejang kejang epilepsi
cara menghilangkan cairan di paru paru
obat benjolan
toko obat herbal
Penyebab kelebihan sel darah putih

Tuesday, August 28, 2018 2:50:00 AM  
Anonymous risa herbal said...

This is such a great resource that you are providing and you give it away for free. I love seeing websites that understand the value of providing a quality resource for free. It is the old what goes around comes around routine

penyebab sakit pinggang
obat penyakit mata glaukoma
obat gagal ginjal
obat penebalan dinding rahim

Tuesday, August 28, 2018 2:51:00 AM  
Blogger Jennie said...

Thanks for sharing the info, keep up the good work going.... I really enjoyed exploring your site. obat leukosit tinggi

Wednesday, September 05, 2018 11:30:00 PM  
Blogger QnC Jelly Gamat said...

Hopefully, sustenance will be easy and simplified in all matters :-)
Solusi Pengobatan Alami KOREA
OBAT LUKA BAKAR ALAMI BANDUNG
OBAT KLIYENGAN ALAMI JAKARTA
SAPNUDIN HERBAL TASIKMALAYA
OBAT BATU GINJAL ALAMI BANJAR
RINO HERBAL PANGANDARAN
KHASIAT JELLY GAMAT GOLD-G JOGJAKARTA
ERWIN HERBAL CILACAP

Monday, September 10, 2018 2:25:00 AM  
Blogger Siti Solihah said...

Hi, This Information is incredible ^_^ I want to work with you in the health sector :

obat batuk berdarah
obat infeksi saluran kencing
cara mengobati kencing nanah
obat cacar air

Monday, September 17, 2018 3:32:00 AM  
Blogger Jisoo Blackpink said...

I am happy to be here and this wonderful article. I have found here lots of interesting information for my knowledge I need. all the details you provide to us, it was very helpful and useful, thanks for sharing this post.

khasiat obat herbal
Obat herbal penyakit kulit
obat benjolan
toko obat herbal
obat gondok beracun
risa herbal

Thursday, September 20, 2018 1:58:00 AM  
Anonymous Cara Mengobati Luka Bernanah Pada Penderita Diabetes said...

This article is very interesting and very understandable to read. sorry beforehand, please let me share this article

Cara Mudah Mengobati Prurigo
Biaya Operasi Benjolan Di Leher Akibat Kelenjar Getah Bening
Cara Mengobati Cacar Air Agar Cepat Kering Dan Sembuh Tanpa Bekas
Cara Mengatasi Nyeri Ulu Hati Dan Perut Kembung Yang Terbukti Ampuh

Friday, October 05, 2018 10:27:00 PM  
Blogger Riko JR said...

I can only express a word of thanks. Because with the content on this blog I can add knowledge I, thank has been sharing this information. Do not forget to visit our website to share information and knowledge about health.
obat Sedawa
cara menaikan peranakan terturun
Hopefully, sustenance will be easy and simplified in all matters :-)
DISTRIBUTOR QNC JELLY GAMAT
obat demam mencret dan pusing
cara menyembuhkan meniere

Monday, October 22, 2018 11:14:00 PM  
Blogger Obat Sakit Tenggorokan said...

Great thank to upload, hopefully it will be useful for writers and those who read :) Obat Kelenjar Getah Bening Bahaya Benjolan Dileher Dan Cara Mengatasinya Cara Mengobati Luka Diabetes Obat Kista Paling Ampuh

Friday, December 28, 2018 12:34:00 AM  
Anonymous Penyebab Mata Kabur dan Berbayang said...

The article is good. Also visit my article, read and share too. God willing useful. :)

Cara Mengobati Penyakit Kolera
Obat Benjolan di Rahim/Mulut Rahim
KurmaQu Sari Kurma dan Madu Murni

Thursday, April 04, 2019 11:26:00 PM  

Post a Comment

Subscribe to Post Comments [Atom]

<< Home