Products crawler several web sites into mySQL DB
Required skills: MySQL, PHP
We need products crawler into mySQL DB
Crawl the following 7 web sites
www.mwave.com.au
www.scorptec.com.au
www.shoppingexpress.com.au
www.shoppingsquare.com.au
www.pccasegear.com.au
www.techbuy.com.au
www.estore.com.au
and save product data into mySQL Database with the following structure:
--
-- Create schema products_crawling
CREATE DATABASE IF NOT EXISTS products_crawling;
USE products_crawling;
-- Definition of table `products`
DROP TABLE IF EXISTS `products`;
CREATE TABLE `products` (
`website_product_id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`website` varchar(80) NOT NULL,
`website_product_url` varchar(500) NOT NULL,
`product_category` varchar(250) NOT NULL,
`product_sku` varchar(40) NOT NULL,
`product_model` varchar(40) NOT NULL,
`product_features` text NOT NULL,
`product_name` varchar(200) NOT NULL,
`product_description` text NOT NULL,
`product_overview` text NOT NULL,
`product_specification_text` text NOT NULL,
`product_specification_html` text NOT NULL,
`product_manufacturer_warranty` varchar(40) NOT NULL,
`product_manufacturer_website_url` varchar(500) NOT NULL,
`product_manufacturer_website_support_url` varchar(500) NOT NULL,
`product_manufacturer_website_product_url` varchar(45) NOT NULL,
`product_brochure1` varchar(150) NOT NULL,
`product_brochure2` varchar(150) NOT NULL,
`product_brochure3` varchar(150) NOT NULL,
`product_brochure4` varchar(150) NOT NULL,
`product_video_url` varchar(250) NOT NULL,
`product_image_path1` varchar(150) NOT NULL,
`product_image_path2` varchar(150) NOT NULL,
`product_image_path3` varchar(150) NOT NULL,
`product_image_path4` varchar(150) NOT NULL,
`product_image_path5` varchar(150) NOT NULL,
`product_stock_level` varchar(20) NOT NULL,
`product_price` float NOT NULL,
`product_rrp` float NOT NULL,
`product_created_ts` datetime NOT NULL,
`product_updated_ts` datetime NOT NULL,
`product_status_cd` smallint(5) unsigned NOT NULL,
PRIMARY KEY (`website_product_id`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;
Product Categories must be saved on MySQL DB in the following format Category > SubCategory > SubSubCategory…
Product images must be downloaded into separate folders for each web site and image paths should be saved on MySQL DB.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
Posted In:MySQLPHP |
Related projects:
Products crawler into mySQL DB
hs should be saved on MySQL DB.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
parse xml file into mysql db
presents
The script must do this:
- create php page call "upload.php" with an upload file form that send the upload XML file to another page call "send.php"
- the page "send.php" must have this script that elaborate node, child and attribute , and put data into mysql db with some variabiles with foreach cicle
we give you a XML file , a mysql structure , and the variabiles to be loaded into the database
The script must do this:
- create php page call "upload.php" with an upload file form that send the upload XML file to another page call "send.php"
- the page "send.php" must have this script that elaborate node, child and attribute , and put data into mysql db with some variabiles with foreach cicle
we give you a XML file , a mysql structure , and the variabiles to be loaded into the database
Develop script/job to import several text files into mysql
work. We may have more similar projects and will award depending on outcome, performance & quality of this project. We will take a close look at your reviews, if you have any. Please contact me for more details. Once project is accepted by us and our customer, we will release funds. Please send me a message with your budget consideration and a quote.
Need To Integrate Two Web Sites Into One
gn up, get their name, etc. They have to use it to log into their back office, etc. But can we overlay the new web site on top of the old one, and let only the important parts of the old web site, show through to the new one? So the new web site would have all the nice graphics, but only a window would show the pertinent information from the old site. Perhaps use iFrames?
Let me know what you think and what ideas you would have on how to do this. Thanks!
Tim
Let me know what you think and what ideas you would have on how to do this. Thanks!
Tim
My Products on other web sites
r
* my site works in 3 languages , Default should be chosen by vendor
* Set mark up by vendor
* Set up Shipping charges by each vendor.
* Email inquiry to vendor and main admin.
* Ability On and Off shopping cart, which should work with paypal
* Main admin can also edit each store
* Main admin can activte and inactive each store
* Special common description to be shown in each product
* Vendor can email main admin via vendor control panel
* my site works in 3 languages , Default should be chosen by vendor
* Set mark up by vendor
* Set up Shipping charges by each vendor.
* Email inquiry to vendor and main admin.
* Ability On and Off shopping cart, which should work with paypal
* Main admin can also edit each store
* Main admin can activte and inactive each store
* Special common description to be shown in each product
* Vendor can email main admin via vendor control panel
Three php applications to add/update mysql db.
I need you to write three php applications to import (“|” separated) data from three web addresses to MySQL db.
I will provide detailed info on how to insert data and the dump of the destination tables.
Please let me know if you need more info.
I will provide detailed info on how to insert data and the dump of the destination tables.
Please let me know if you need more info.
Seo For Travel Web Sites
We are researching the possibility of hiring an outside SEO/SEM consultant. We manage and operate several web sites in varying market segments. Are question is what are relative pricing of packages for the following services;
1- SEO; Link building, blog posts, site review and optimization
2- SEM; Pay Per Click Management.
Thank you very much.
1- SEO; Link building, blog posts, site review and optimization
2- SEM; Pay Per Click Management.
Thank you very much.
Crawl products info into MySQL DB
e_1` varchar(200) default NULL,
`brochure_2` varchar(200) default NULL,
`brochure_3` varchar(200) default NULL,
`brochure_4` varchar(200) default NULL,
`created` datetime NOT NULL,
`last_updated` datetime NOT NULL,
PRIMARY KEY (`product_id`)
) ENGINE=MyISAM AUTO_INCREMENT=8268 DEFAULT CHARSET=latin1;
`brochure_2` varchar(200) default NULL,
`brochure_3` varchar(200) default NULL,
`brochure_4` varchar(200) default NULL,
`created` datetime NOT NULL,
`last_updated` datetime NOT NULL,
PRIMARY KEY (`product_id`)
) ENGINE=MyISAM AUTO_INCREMENT=8268 DEFAULT CHARSET=latin1;
Fetching Web Data Into Epesi
coration: none;color:#68778E" onmouseover="this.style.textDecoration='underline'" onmouseout="this.style.textDecoration='none'">http://www.idealo.de/preisvergleich/OffersOfProduct/1124693_-d90-nikon.html
http://www.skapiec.pl/site/cat/2/comp/375159
http://www.skapiec.pl/site/cat/2/comp/375159
XML WEB SERVICE (SOAP INTERFACE) TO MYSQL DB
less than 5 days.
Additional files submitted: (Files are only available for logged in users)
XML+WEB+SERVICE+PROJECT.doc
Additional files submitted: (Files are only available for logged in users)
XML+WEB+SERVICE+PROJECT.doc
Data Scraping from multiple websites
ve been added to the database. For each product category, we’ll probably need to define a set of attributes that can be used to describe the items within that group, so that similar products/substitutes can easily be indentified and compared.
Finally, I will need to be able to re-crawl the websites and update the database a few times a year to reflect new products added and/or price changes of existing products in the database.
Finally, I will need to be able to re-crawl the websites and update the database a few times a year to reflect new products added and/or price changes of existing products in the database.
upload about a dozen large CSV files into a mySQL DB
I need someone to insert about a dozen CSV files into my site's mySQL DB.
I am encountering a User XXXX has exceeded the 'max_questions' when using a dump file.
I dont have the time to look for how to do it. Just looking for a guy with this experience to go around it, like create multiple users and rotate between them, something of the sort.
CHeapest bid wins. Its a very simple task
Importer into a mysql db from a csv file
Need to automatyze the importing of csv files into my db
Put Web Data Into Mysql Database
olor:#68778E" onmouseover="this.style.textDecoration='underline'" onmouseout="this.style.textDecoration='none'">http://game.planetarion.com/manual.pl?page=stats&rn=146054506142
the data in the 1st 3 pages will change every hour.
The script will also put into another table the value that appears after 'Tick:'
there will also be a few calculations that will need to be made on some of the data (i.e the change in the figure from the previous hour)
the data in the 1st 3 pages will change every hour.
The script will also put into another table the value that appears after 'Tick:'
there will also be a few calculations that will need to be made on some of the data (i.e the change in the figure from the previous hour)
Dotnetnuke Module (Display info using remote MySQL DB)
We have a remote MySQL DB - now we use PHP and Frames to show the script on our DNN web site. We want to rewrite code from PHP into ASP.NET C# for DNN to access remote MySQL and show the pages using DNN module. We are doing it because we want to improve our SEO ratings and do not want to use frames.
PHP script is itself pretty small - so rewriting it into ASP.NET C# for DNN module should not take experienced developer longer than 8-10 hours.
PHP script is itself pretty small - so rewriting it into ASP.NET C# for DNN module should not take experienced developer longer than 8-10 hours.
Price Grapper Crawler on 5 sites
to test for 1 day if your script need 10 days to crawl, right?
Bonus will be given if your script is fast, clean and well communication.
normally we pay extra 10%-20% depends on your work.
Deadline is super important for us, if we can't finish it in the period you stated.
We have the right to cancel this project and you CANNOT argue on that.
If you DO NOT agree or DO NOT understand what we said, please DO NOT bid this project.
Bonus will be given if your script is fast, clean and well communication.
normally we pay extra 10%-20% depends on your work.
Deadline is super important for us, if we can't finish it in the period you stated.
We have the right to cancel this project and you CANNOT argue on that.
If you DO NOT agree or DO NOT understand what we said, please DO NOT bid this project.
Price Grapper Crawler on mutli sites (Simple Version)
we said, please DO NOT bid this project.
Additional information submitted: 08/11/2009 at 15:58 EDT:
Sorry, the no. of sites is 4, NOT 8
only need to crawl 4 sites.
Additional information submitted: 08/11/2009 at 15:58 EDT:
Sorry, the no. of sites is 4, NOT 8
only need to crawl 4 sites.
Mysql Db Migration.
(we would like to keep some of this new data if it dose not interfere with the migration).
9- Scripts on both sites are PHP but they are deferent.
------- this is not just a simple db Export/Emport----------
Please don't bid unless you really know your PHP and MySQL well and know how to structure MySQL db.
Project should be done in no more than one week.
Additional Info (Added 11/13/2008 at 22:05 EST)...here is a copy of both db's.
9- Scripts on both sites are PHP but they are deferent.
------- this is not just a simple db Export/Emport----------
Please don't bid unless you really know your PHP and MySQL well and know how to structure MySQL db.
Project should be done in no more than one week.
Additional Info (Added 11/13/2008 at 22:05 EST)...here is a copy of both db's.
Search for parts on numerous web sites simultaneously by robtincey
ead into a data base array and displayed at the initiating page.
The concept is similar to a web crawler, but only goes to known web sites and to return information of available stock and prices from these web sites.
This concept could be used for searching the globe for car parts, stationary items, electronic components etc or any group of products that consumers/customers go to the web for and search for items with specific part numbers.
The concept is similar to a web crawler, but only goes to known web sites and to return information of available stock and prices from these web sites.
This concept could be used for searching the globe for car parts, stationary items, electronic components etc or any group of products that consumers/customers go to the web for and search for items with specific part numbers.
MySQL DB Tuning
tables like indexes and also adding system properties related to performance tuning...
each batch of DB save operations in a transaction is currently taking around 10 seconds we want to bring it down to 3 seconds max. for that we need some help in optimizing our database
For an expert it should take few hours to narrow down the issue....
MySQL DB expert with performance tuning skills needed to work on this task....
each batch of DB save operations in a transaction is currently taking around 10 seconds we want to bring it down to 3 seconds max. for that we need some help in optimizing our database
For an expert it should take few hours to narrow down the issue....
MySQL DB expert with performance tuning skills needed to work on this task....
