Page 1 of 1

Problems rebuilding search

PostPosted: Wed Jan 26, 2011 9:13 am
Author: batman
Hope someone has a simple solution to this <img>
A good while back I converted over to Integramod from another PHPBB type portal system.
Ever since I have had issues with some posts pre the move when trying to rebuild the search in the database management in ACP.
This is what I'm getting

Error: Couldn't insert search word data!

[color=#008000]SQL Error ]

I have managed to get rid of quite a few by simply putting [highlight=#ffffbf:fl6732tg]donà¢ÃƒÆ’ƒÂ ¢ÃƒÆ’ ¢Ãƒ ¢Ã¢â‚¬Å¡Ã‚ ¬Ãƒâ€¦Ã‚ ¡ÃƒÆ’‚Ã'[/highlight:fl6732tg] within the search and have then edited the offending post, for some reason though I cant find the above one in the search so have been literary going through the older posts looking for similar.
Is there a better method of resolving this?

PS. I do have another user account but couldnt loggin (Karl-D)

Re: Problems rebuilding search

PostPosted: Wed Jan 26, 2011 6:51 pm
Author: Helter
i cant read your code. please repost using the "code" bbcode button

Re: Problems rebuilding search

PostPosted: Thu Jan 27, 2011 6:48 am
Author: batman
Code: Select all
Error: Couldn't insert search word data!

SQL Error : 1062 Duplicate entry 'donà¢ÃƒÆ’ƒÂ ¢ÃƒÆ’ ¢Ãƒ ¢Ã¢â‚¬Å¡Ã‚ ¬Ãƒâ€¦Ã‚ ¡ÃƒÆ’‚Ã' for key 1

INSERT INTO phpbb_search_wordlist (word_text, word_common) VALUES ('donà¢ÃƒÆ’ƒÂ ¢ÃƒÆ’ ¢Ãƒ ¢Ã¢â‚¬Å¡Ã‚ ¬Ãƒâ€¦Ã‚ ¡ÃƒÆ’‚ ¬ÃƒÆ’ƒÂ ¢ÃƒÆ’ ¢Ãƒ ¢Ã¢â‚¬Å¡Ã‚ ¬Ãƒâ€¦Ã‚ ¾ÃƒÆ’‚ ¢t', 0)

Line : 584
File : /home/********/public_html/********/bbia-forums/includes/functions_dbmtnc.php


Re: Problems rebuilding search

PostPosted: Sun Jan 30, 2011 8:18 am
Author: batman
Any ideas ? <img>

Re: Problems rebuilding search

PostPosted: Sun Jan 30, 2011 7:18 pm
Author: Helter
it looks to me like your site is trying to insert text in utf-8 format into a latin1 db.

Check the format of your db. for phpBB2 it should be latin1_* , probably latin1_swedish_ci

delete the search_wordlist table and reinstall it
Code: Select all
#
# Table structure for table `phpbb_search_wordlist`
#

CREATE TABLE phpbb_search_wordlist (
  word_text varchar(50) binary NOT NULL default '',
  word_id mediumint(8) unsigned NOT NULL auto_increment,
  word_common tinyint(1) unsigned NOT NULL default '0',
  PRIMARY KEY  (word_text),
  KEY word_id (word_id)
) TYPE=MyISAM;

Re: Problems rebuilding search

PostPosted: Mon Jan 31, 2011 7:51 am
Author: batman
Hya HelterSkelter, I'm still getting the same problem mate, I start rebuilding the search and around 12% it comes up with the error, trouble is when I try to search for it to either delete or edit it tells me no searches matched.
I dropped the search_wordlist then reinstalled it with the code you provided.
I have checked the text and is latin1_swedish_ci as you say

Re: Problems rebuilding search

PostPosted: Mon Jan 31, 2011 3:11 pm
Author: Helter
have you downloaded your post text table and done a partial word search?

I believe that either you have a corrupted work in your post text, or your server is running out of memory during the rebuild process. It will use a substantial amount of ram while rebuilding the table.

You might try adding this to your config.php

Code: Select all
ini_set('memory_limit','32M');


add it just before this

Code: Select all
?>

Re: Problems rebuilding search

PostPosted: Mon Jan 31, 2011 4:43 pm
Author: batman
Hya HelterSkelter yes some of the text in some of the older posts has been corrupted when I originally converted over to Integramod.
I have either deleted or edited quite a lot manually.
What I have been doing is, running the the rebuild search and when an error has come up I have copied the offending text and searched for it on the forum, this generally finds posts containing that corrupted word, so just a case of correcting it by editing the post.

For some strange reason though, the one in the code I posted isn't being found when I do a forum search all I'm getting is "No topics or posts met your search criteria".
Its in a post somewhere as its finding the error for the corrupted text.

I guess Ill just have to keep going through the older posts manually to see if I can find it, I started the board back in 2004 so literally thousands of posts to check lol

Thanks for the help <img>

Re: Problems rebuilding search

PostPosted: Mon Jan 31, 2011 4:54 pm
Author: batman
WOW :D or is this just a coincidence?
Ill probably get a blasting from my host for using all the ram up now <img>

Re: Problems rebuilding search

PostPosted: Mon Jan 31, 2011 8:34 pm
Author: Helter
you should be safe to turn it to 16 megs after you finish rebuilding the search table.

in order to find the post, you may have to export your post_text table and open it in an editor that supports utf-8 like notepad++

you could also backup your db and then try to do a repair on the post text table in phpmyadmin

Re: Problems rebuilding search

PostPosted: Thu Feb 10, 2011 3:42 pm
Author: Karl-D
Thanks HelterSkelter, managed to login to my usual account now <img>
I'm still going through the posts gradually, it currently goes as far as 20% so should be fine about 30% as I'm getting in to the newer posts that arent effected lol

Re: Problems rebuilding search

PostPosted: Sat Feb 12, 2011 11:02 am
Author: Karl-D
Finally removed all the screwed up text, got to 35% then had no errors and completed. <img>

Re: Problems rebuilding search

PostPosted: Sat Feb 12, 2011 11:07 pm
Author: Helter
glad you got it sorted. I know the frustration intimately! <img>

Re: Problems rebuilding search

PostPosted: Mon Feb 14, 2011 2:22 am
Author: Karl-D
[quote=""HelterSkelter""]glad you got it sorted. I know the frustration intimately! :D