IMDB Scraper fix - 19th November 2009

Admin Posts : 1326 Join date : 2008-09-20

Fixed IMDB scraper library,
This will also fix the issue with spec characters.

Download imdb.rar
I've tested a few movies with this and it seems fine, but there is always the possibility of a discrepancy in a few movies, if anyone has any issues then let me know, be sure to include the imdb url to the problem movie.

Also available is tmdb_posters.rar, this has been updated to use TMdb API 2.1, it seems to be significantly faster than 2.0
Download tmdb_posters.rar

Download the dll's and extract the .dll files to your MC directory, when asked just replace the current files.

Subject: Re: IMDB Scraper fix - 19th November 2009 Thu Nov 19, 2009 1:34 pm

Works good billy, seems to be taking about 8 seconds for a complete movie scrape!

PS I appreciate the quick fix. Laughing

Subject: Re: IMDB Scraper fix - 19th November 2009 Thu Nov 19, 2009 6:29 pm

Fantastic work Billy, I'm getting good results with the two updated .dll's cheers

BB

New User Posts : 2 Join date : 2009-11-20

Thank you so much for all of your work. It's working great.

New User Posts : 5 Join date : 2009-11-20

fixed quite a few problems, but I'm noticing that some taglines and almost all runtimes have scraper error now? Using 3.154 with these two updates.

Subject: Re: IMDB Scraper fix - 19th November 2009 Fri Nov 20, 2009 7:06 am

I'm not having any problems just scraped 4 movies. Are you sure u upgraded to 3.154 then did the 2 .dll updates? or did you do the two updates then upgrade to 3.154?

Junior Member Posts : 45 Join date : 2009-05-08

Yep, just tested with 3 movies and all are fine.

New User Posts : 5 Join date : 2009-11-20

i was able to delete all of the nfo files manually and then rerun the find movies to create new nfos. seems to work ok now. only setting I changed in the preference was to get the paths for all the thumbnails from all four sites... but didnt test the reverse to see if that was the problem or that my nfo's were from an older version that was incompatible.

Admin Posts : 1326 Join date : 2008-09-20

IMDB is doing something wierd at the moment, perhaps it is only effecting certain mirrors.

Either way, i'll give them a day or two to complete whatever it is they are doing

New User Posts : 6 Join date : 2009-05-31

Still having a bit of trouble with files which have information after the (year)

Here are some examples:

Rear Window (1954) - 123.mkv - WORKS
Rear Window (1954) - 123456.mkv - WORKS
Rear Window (1954) - 12345678.mkv - WORKS
Rear Window (1954) - 123456789.mkv - FAILS

Rear Window (1954) - abcdefgh.mkv - WORKS
Rear Window (1954) - abcdefghi.mkv - WORKS
Rear Window (1954) - abcdefghij.mkv - WORKS
Rear Window (1954) - abcdefghijk.mkv - FAILS

Rear Window (1954)abcdefghij.mkv - WORKS
Rear Window (1954)abcdefghijk.mkv - FAILS

Rear Window (1954) 01234567.mkv - FAILS
Rear Window (1954) 12345678.mkv - WORKS
Rear Window (1954) 123456789.mkv - FAILS

I still havent worked out the pattern. although it seems like it can only handle 8 numbers or ten letters, after the (year) i haven't tried with combinations of letters and numbers.

When it fails it says:

Code:: Starting Folder Scan

foundG:\test
Checking for subfolders
1 New movies found in directory:- G:\test

1 Movies found in all folders
Obtaining Title for each movie found, from path and filename

Filename is: G:\test\Rear Window (1954) - test 720p.mkv
Title according to settings is: "Rear Window"

Starting Main Scraper Process

Scraping Title:- Rear Window (1954) - test 720p
Output filename:- G:\test\Rear Window (1954) - test 720p.nfo
Poster Path:- G:\test\Rear Window (1954) - test 720p.tbn
Fanart Path:- G:\test\Rear Window (1954) - test 720p-fanart.jpg
NFO does not exist
Checking filename for IMDB ID
No IMDB ID found
Checking for Movie year in filename
Year found for movie:- 1954
Cleaned Title for search :- Rear Window (1954) - test 720p
Unable to scrape body with refs "Rear Window (1954) - test 720p", "", "", "http://www.imdb.com/"
To add the movie manually, go to the movie edit page and select "Change Movie" to manually select the correct movie
Movie added to list

Admin Posts : 1326 Join date : 2008-09-20

lmaolmao wrote:: Still having a bit of trouble with files which have information after the (year)

Here are some examples:

Rear Window (1954) - 123.mkv - WORKS
Rear Window (1954) - 123456.mkv - WORKS
Rear Window (1954) - 12345678.mkv - WORKS
Rear Window (1954) - 123456789.mkv - FAILS

Rear Window (1954) - abcdefgh.mkv - WORKS
Rear Window (1954) - abcdefghi.mkv - WORKS
Rear Window (1954) - abcdefghij.mkv - WORKS
Rear Window (1954) - abcdefghijk.mkv - FAILS

Rear Window (1954)abcdefghij.mkv - WORKS
Rear Window (1954)abcdefghijk.mkv - FAILS

Rear Window (1954) 01234567.mkv - FAILS
Rear Window (1954) 12345678.mkv - WORKS
Rear Window (1954) 123456789.mkv - FAILS

I still havent worked out the pattern. although it seems like it can only handle 8 numbers or ten letters, after the (year) i haven't tried with combinations of letters and numbers.

It appears that the year was not being passed to the scraper, this is fixed for the next build.

I have no idea about the problem regarding the trailing chrs after the year. I checked the code and it is working properly. I am wondering if it is related to the google vs IMDB search. The first 50 searches in a session are performed via google then the rest are via IMDB. google is much more accurate, but used to often it can view MC as a bot and blocks a users IP, to prevent this I limited MC to 50 google searches, this is far below the point when I experienced problems.

Either way, in my tests both imdb and google returned the correct movie for the above filenames, the build will be uploaded later today.

Junior Member Posts : 42 Join date : 2009-06-01

the movie "Phone Booth" fails to scrape. When I tried to edit the movie, the IMDB page will not laod.

Junior Member Posts : 42 Join date : 2009-06-01

jz1276 wrote:: the movie "Phone Booth" fails to scrape. When I tried to edit the movie, the IMDB page will not laod.

nevermind, my internet settings were off. All's working good.

» Progress Update - 18th November 2009
» 5 November has variously been called Guy Fawkes
» Progress report 6th September 2009
» Progress report 15th September 2009
» imdb.com down?