POI category merging -- DONE!

drfluid · 11-04-2007, 05:29 AM

After a few hours of thinking and coding, I finally finished writing a Matlab script that merges as many URL's as you wish in ONE big URL/IDX pair.

I did some QA/QC with previously created URL/IDX pairs and it works perfectly.

Give me a few more days and I'll upload some photos of iDrive screen.
Hopefully no more cheat sheet or cursing the meaningless POI categories..
Actually I found a lot of duplicate infos in different sub categories.

Anyway, I could use some sleep now.. So tired.

FrankoQ · 11-04-2007, 07:02 AM

Good job!

mosport70 · 11-04-2007, 08:10 AM

Nice work... we look forward to your post.

rrandyy · 11-04-2007, 12:04 PM

awesome! A torrent file would be sweet.

drfluid · 11-04-2007, 02:23 PM

I have a couple of problems, though.

1) There are too many of duplicate lists. I need to remove them to make the process faster and keep the output file size small.
2) File I/O on hard drives is really slow. I wrote the code to minimize the memory use, but now I have the bottleneck of hard drive speed.
3) All in all, it works as it was planned, but running the code is a little slower than I thought.

There would be no torrent. I will upload my original code here as I did before once they are optimized. No torrent would be necessary for that.

Figuring out the code and implementing it to your DVD is on your own. Without that, where's all the fun???

zenmaster · 11-04-2007, 03:43 PM

Quote:

Originally Posted by drfluid

There would be no torrent. I will upload my original code here as I did before once they are optimized. No torrent would be necessary for that.

Thanks. I don't like the category-only search either. Maybe I'll convert your Matlab to C. Most people don't have access to Matlab.

eldudo · 11-04-2007, 11:03 PM

Quote:

Originally Posted by zenmaster

Thanks. I don't like the category-only search either. Maybe I'll convert your Matlab to C. Most people don't have access to Matlab.

Or PERL...

Gig103 · 11-04-2007, 11:40 PM

Well done!! I haven't used Matlab in years, but I look forward to seeing your code!

d3l0n · 11-05-2007, 12:30 AM

uuh.. just do it for us... lol.. i haven't touched scripting in 2-3yrs lol pplan to get back in it but not mathlab, more so perl/php/bash. Just do it for us pweease lol

drfluid · 11-05-2007, 12:32 AM

PM me for the codes...
Please include your 'email' in the PM. Thanks.

drwtsn32 · 11-05-2007, 04:55 PM

So... when you merge everything, can you then do a POI name search and have it search all possible categories?

drfluid · 11-08-2007, 03:41 PM

Anyone tried yet?

It seems to be working pretty well.

rrandyy · 11-12-2007, 04:59 PM

how long does it take to search? Does a burned DVD work just as well as the original?

drfluid · 11-12-2007, 07:24 PM

Existing 'All restaurant' category has 107Mbytes of URL/23Mbytes of IDX pair.

Merged 'Home improvement' - 7 categories results in about 62M/16M URL-IDX pair.
'Apparel' - 5 categories are 42M/11M.
'General' under banking and shopping - 5 categories are 23M/6M

So it wouldn't take that long comparing to 'All restaurant' category.

FYI, the biggest single category in the original Nav DVD is 'Business and Services - Business - Services' category, which is about 109M/28.5M.

zenmaster · 11-12-2007, 11:52 PM

pm sent!

mrh335 · 11-17-2007, 06:33 PM

PM sent

eldudo · 11-17-2007, 08:39 PM

Why PM for the code?
We don't believe in freeware and open source?
It was up before, why the change of heart?

drfluid · 11-18-2007, 01:25 AM

Quote:

Originally Posted by eldudo

Why PM for the code?
We don't believe in freeware and open source?
It was up before, why the change of heart?

I just wanted to know how many of you are interested in this.

For those who pm'ed, I'll send out the codes as soon as I'm back from vacation. Sorry. I'm away from my 'working' computer.

Babe · 11-26-2007, 06:17 AM

Quote:

Originally Posted by drfluid

I just wanted to know how many of you are interested in this.

For those who pm'ed, I'll send out the codes as soon as I'm back from vacation. Sorry. I'm away from my 'working' computer.

Hi
What did you do to the code?

zenmaster · 11-26-2007, 08:44 AM

I tried an easy approach first - that is, to have Matlab convert the code to C automatically. I tried version R13 of Matlab, but it doesn't work on Vista. So I borrowed an older version (R12), but it did not include the mcc. Then I tried FreeMat and SciLab, but both don't understand the code. Will get to it eventually.

drfluid · 11-26-2007, 08:34 PM

Quote:

Originally Posted by zenmaster

I tried an easy approach first - that is, to have Matlab convert the code to C automatically. I tried version R13 of Matlab, but it doesn't work on Vista. So I borrowed an older version (R12), but it did not include the mcc. Then I tried FreeMat and SciLab, but both don't understand the code. Will get to it eventually.

I hope your approach will work.
I'm not familiar with FreeMat or SciLab, but I know my code wouldn't run on R12 or R13, due to the absence of some functions that work only on recent releases.

Gig103 · 12-17-2007, 05:12 PM

DrFluid - Are you available to send your code out again? I'd sure like to see it!

11-04-2007, 05:29 AM	#1
drfluid Second Lieutenant 24 Rep 244 Posts Drives: 2006 - 330i Navi, Premium Join Date: May 2005 Location: Walnut Creek, CA iTrader: (0)	POI category merging (with Pictures) After a few hours of thinking and coding, I finally finished writing a Matlab script that merges as many URL's as you wish in ONE big URL/IDX pair. I did some QA/QC with previously created URL/IDX pairs and it works perfectly. Give me a few more days and I'll upload some photos of iDrive screen. Hopefully no more cheat sheet or cursing the meaningless POI categories.. Actually I found a lot of duplicate infos in different sub categories. Anyway, I could use some sleep now.. So tired. __________________ 330i-NAV-Premium Last edited by drfluid; 04-25-2008 at 02:03 AM..
	Appreciate 0 Tweet Quote

11-04-2007, 07:02 AM	#2
FrankoQ Deny everything 229 Rep 11,378 Posts Drives: 2006 330i; 2015 X6, S1000RR Join Date: Apr 2006 Location: Beautiful MD iTrader: (5) Garage List 2015 BMW X6 [0.00] 2006 330i [0.00]	Good job! __________________ I need a drink
	Appreciate 0 Quote

11-04-2007, 08:10 AM	#3
mosport70 First Lieutenant 12 Rep 332 Posts Drives: 330xi Join Date: Apr 2006 Location: South iTrader: (0) Garage List 2006 330xi [0.00] 2006 330xi [0.00] 2006 330xi [0.00]	Nice work... we look forward to your post. __________________ 330xi Sparkling Graphite \| Terra with Burl Walnut \| ZPP \| ZSP with Style 162 \| Comfort Access \| Heated Seats \| PDC \| Navigation \| Satellite Radio \| OEM Alarm \| De-badged \| OEM Strut Brace \| Blacklines \| Rear Fogs \| Silver Front Indicator Bulbs Ordered: 4.3.2006 Scheduled for Production: 4.7.2006 Awaiting Transport: 4.13.2006 En Route: 4.19.2006 At Preparation Center: 5.11.2006 Performance Center Delivery: 06.01.2006
	Appreciate 0 Quote

11-04-2007, 12:04 PM	#4
rrandyy Captain 32 Rep 799 Posts Drives: E92 328 Join Date: Sep 2006 Location: California iTrader: (0)	awesome! A torrent file would be sweet.
	Appreciate 0 Quote

11-04-2007, 02:23 PM	#5
drfluid Second Lieutenant 24 Rep 244 Posts Drives: 2006 - 330i Navi, Premium Join Date: May 2005 Location: Walnut Creek, CA iTrader: (0)	I have a couple of problems, though. 1) There are too many of duplicate lists. I need to remove them to make the process faster and keep the output file size small. 2) File I/O on hard drives is really slow. I wrote the code to minimize the memory use, but now I have the bottleneck of hard drive speed. 3) All in all, it works as it was planned, but running the code is a little slower than I thought. There would be no torrent. I will upload my original code here as I did before once they are optimized. No torrent would be necessary for that. Figuring out the code and implementing it to your DVD is on your own. Without that, where's all the fun??? __________________ 330i-NAV-Premium
	Appreciate 0 Quote

11-04-2007, 11:40 PM	#8
Gig103 Major 76 Rep 1,324 Posts Drives: 2014 Tesla P85D Join Date: Aug 2007 Location: Gilbert, AZ iTrader: (1)	Well done!! I haven't used Matlab in years, but I look forward to seeing your code! __________________ Was: 2008 335xi sedan 6MT Black Sapphire Metallic Is: 2014 Tesla P85D (Blue Metallic) Wife's: 2013 Infiniti G37 S sedan 6MT, Black
	Appreciate 0 Quote

11-05-2007, 12:30 AM	#9
d3l0n I love the ///M3, but I want 550hp ///M5 148 Rep 3,276 Posts Drives: BMW330iE90 Join Date: May 2006 Location: NYC iTrader: (1) Garage List 2006 BMW 330i (E90) [9.00]	uuh.. just do it for us... lol.. i haven't touched scripting in 2-3yrs lol pplan to get back in it but not mathlab, more so perl/php/bash. Just do it for us pweease lol __________________ .::d3l0n::. FS: OEM SG Side Skirts - Sparkling Graphite - PRE-LCI FS: OEM Carbon Fiber Rear Diffuser FS: (SG) E90 OEM Rear Bumper - Sparkling Graphite - Pre-LCI 328/330 i/xi
	Appreciate 0 Quote

11-05-2007, 12:32 AM	#10
drfluid Second Lieutenant 24 Rep 244 Posts Drives: 2006 - 330i Navi, Premium Join Date: May 2005 Location: Walnut Creek, CA iTrader: (0)	PM me for the codes... Please include your 'email' in the PM. Thanks. __________________ 330i-NAV-Premium Last edited by drfluid; 12-19-2007 at 12:48 PM..
	Appreciate 0 Quote

11-05-2007, 04:55 PM	#11
drwtsn32 Lieutenant 7 Rep 499 Posts Drives: 2014 BMW 435xi, 2016 MB GLA250 Join Date: Sep 2006 Location: Tri-Cities, WA iTrader: (0)	So... when you merge everything, can you then do a POI name search and have it search all possible categories?
	Appreciate 0 Quote

11-08-2007, 03:41 PM	#12
drfluid Second Lieutenant 24 Rep 244 Posts Drives: 2006 - 330i Navi, Premium Join Date: May 2005 Location: Walnut Creek, CA iTrader: (0)	Anyone tried yet? It seems to be working pretty well. __________________ 330i-NAV-Premium
	Appreciate 0 Quote

11-12-2007, 04:59 PM	#13
rrandyy Captain 32 Rep 799 Posts Drives: E92 328 Join Date: Sep 2006 Location: California iTrader: (0)	how long does it take to search? Does a burned DVD work just as well as the original?
	Appreciate 0 Quote

11-12-2007, 07:24 PM	#14
drfluid Second Lieutenant 24 Rep 244 Posts Drives: 2006 - 330i Navi, Premium Join Date: May 2005 Location: Walnut Creek, CA iTrader: (0)	Existing 'All restaurant' category has 107Mbytes of URL/23Mbytes of IDX pair. Merged 'Home improvement' - 7 categories results in about 62M/16M URL-IDX pair. 'Apparel' - 5 categories are 42M/11M. 'General' under banking and shopping - 5 categories are 23M/6M So it wouldn't take that long comparing to 'All restaurant' category. FYI, the biggest single category in the original Nav DVD is 'Business and Services - Business - Services' category, which is about 109M/28.5M. __________________ 330i-NAV-Premium
	Appreciate 0 Quote

11-12-2007, 11:52 PM	#15
zenmaster Brigadier General 1581 Rep 3,888 Posts Drives: '17 M2 Join Date: Mar 2007 Location: Atlanta iTrader: (1)	pm sent!
	Appreciate 0 Quote

11-17-2007, 06:33 PM	#16
mrh335 Second Lieutenant 32 Rep 207 Posts Drives: 2011 M3 sedan, jet black Join Date: Oct 2006 Location: Bay Area iTrader: (0)	Merge POI code PM sent
	Appreciate 0 Quote

11-17-2007, 08:39 PM	#17
eldudo Take the long way home 3 Rep 113 Posts Drives: E90 335i & E46 330i Join Date: Apr 2005 Location: B'more iTrader: (0)	Why PM for the code? We don't believe in freeware and open source? It was up before, why the change of heart? __________________ 2007 E90 335i - Monaco Blue / Beige / 6MT / ZSP / ZPP / ZCW / Navi / CA / iPod/USB 6FL 4/02/07: Test Drive - 4/03/07: Test Drive & Placed order - 4/13/07: Production Completed - 4/23/07: Loaded on Courage 5/07/07: Courage arrives in NY - 5/09/07: Released from VPC to Trucking Co. - 5/10/07: Arrives at dealer - 5/11/07: Delivery day! :rocks:
	Appreciate 0 Quote

11-26-2007, 08:44 AM	#20
zenmaster Brigadier General 1581 Rep 3,888 Posts Drives: '17 M2 Join Date: Mar 2007 Location: Atlanta iTrader: (1)	I tried an easy approach first - that is, to have Matlab convert the code to C automatically. I tried version R13 of Matlab, but it doesn't work on Vista. So I borrowed an older version (R12), but it did not include the mcc. Then I tried FreeMat and SciLab, but both don't understand the code. Will get to it eventually.
	Appreciate 0 Quote

12-17-2007, 05:12 PM	#22
Gig103 Major 76 Rep 1,324 Posts Drives: 2014 Tesla P85D Join Date: Aug 2007 Location: Gilbert, AZ iTrader: (1)	DrFluid - Are you available to send your code out again? I'd sure like to see it! __________________ Was: 2008 335xi sedan 6MT Black Sapphire Metallic Is: 2014 Tesla P85D (Blue Metallic) Wife's: 2013 Infiniti G37 S sedan 6MT, Black
	Appreciate 0 Quote