|Problems? Is your data what you think it is?|
proof of concept how to run this codeby perl_lover_girl
|on Aug 24, 2006 at 19:39 UTC||Need Help??|
perl_lover_girl has asked for the
wisdom of the Perl Monks concerning the following question:
g day dtoronto, hello cowboy - Hello to my dear perl-folks
many many thanks for the reply.
i fixed the code and made up my mind. HERE is what i try to accomplish.
first of all: i am happy to hear from you!! this is probably one of the best places to ask such questions. so i do it now.
first of - i have to explain something; I have to grab some data out of a phpBB in order to do some field reseach. I need the data out of a forum that is runned by a user community. I need the data to analyze the discussions.
to give an example - let us take this forum here. How can i grab all the data out of this forum - and get it local and then after wards put it in a local database - of a phpBB-forum - is this possible"?!"?
Nothing harmeful - nothing bad - nothing serious and angerous. But the issue is. i have to get the data - so what?
I need the data in a allmost full and complete formate. So i need all the data like
text of the posting and so on and so on.
how to do that?
i need some kind of a grabbing tool - can i do it with that kind of tool. How do i sove the storing-issue into the local mysql-database.
Well you see that is a tricky work - and i am pretty sure taht i am getting help here. So for any and all help i am very very thankful
#many many thanks in advance
i am testing a code .- this is a proof of concept. Please do not bear with me as this is a perl-snippet. Can u help me. The question is; if i apply this to another forum - can i get any detailed results. thanks for any answer - thanks for any and all help
And here a codeexample that is runned against the forum.
Hmm i want to grab data out of forum - (for my studies]
This is really preliminary. It just grabs the basic text from the threads and doesn't handle the quoted text right yet. hmmm would this be hard to fix. There are many parsing approaches that can be taken in perl,
we obviously also have to set up a database to capture information you want to store.
Additionally, this script just looped over the first index page, It didn't run over more than the first page it is set up a loop to grab each of the index pages
Well, dtoronto and cowboy i am a true PERL NEWBIE - and i need your help. what about the complete parsing (and harvesting of this both forum here http://www.nukeforums.com/forums/viewforum.php?f=17
i look forward to hear form you both dtoronto and cowboy