Products crawler into mySQL DB
Required skills: MySQL, PHP
We need products crawler into mySQL DB
Crawl the following 7 web sites
www.mwave.com.au
www.scorptec.com.au
www.shoppingexpress.com.au
www.shoppingsquare.com.au
www.pccasegear.com.au
www.techbuy.com.au
www.estore.com.au
and save product data into mySQL Database with the following structure:
--
-- Create schema products_crawling
CREATE DATABASE IF NOT EXISTS products_crawling;
USE products_crawling;
-- Definition of table `products`
DROP TABLE IF EXISTS `products`;
CREATE TABLE `products` (
`website_product_id` int(10) unsigned NOT NULL AUTO_INCREMENT,
`website` varchar(80) NOT NULL,
`website_product_url` varchar(500) NOT NULL,
`product_category` varchar(250) NOT NULL,
`product_sku` varchar(40) NOT NULL,
`product_model` varchar(40) NOT NULL,
`product_features` text NOT NULL,
`product_name` varchar(200) NOT NULL,
`product_description` text NOT NULL,
`product_overview` text NOT NULL,
`product_specification_text` text NOT NULL,
`product_specification_html` text NOT NULL,
`product_manufacturer_warranty` varchar(40) NOT NULL,
`product_manufacturer_website_url` varchar(500) NOT NULL,
`product_manufacturer_website_support_url` varchar(500) NOT NULL,
`product_manufacturer_website_product_url` varchar(45) NOT NULL,
`product_brochure1` varchar(150) NOT NULL,
`product_brochure2` varchar(150) NOT NULL,
`product_brochure3` varchar(150) NOT NULL,
`product_brochure4` varchar(150) NOT NULL,
`product_video_url` varchar(250) NOT NULL,
`product_image_path1` varchar(150) NOT NULL,
`product_image_path2` varchar(150) NOT NULL,
`product_image_path3` varchar(150) NOT NULL,
`product_image_path4` varchar(150) NOT NULL,
`product_image_path5` varchar(150) NOT NULL,
`product_stock_level` varchar(20) NOT NULL,
`product_price` float NOT NULL,
`product_rrp` float NOT NULL,
`product_created_ts` datetime NOT NULL,
`product_updated_ts` datetime NOT NULL,
`product_status_cd` smallint(5) unsigned NOT NULL,
PRIMARY KEY (`website_product_id`)
) ENGINE=MyISAM DEFAULT CHARSET=latin1;
Product Categories must be saved on MySQL DB in the following format Category > SubCategory > SubSubCategory…
Product images must be downloaded into separate folders for each web site and image paths should be saved on MySQL DB.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
Posted In:MySQLPHP |
Related projects:
Products crawler several web sites into mySQL DB
s should be saved on MySQL DB.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
Product video URLs must be saved on MySQL DB
Crawler must have 2 modes:
Full – each products details information crawled and stored on DB
List – all categories crawled and only stock level and price stored on DB for all existing products and for new products stored information only available from the List.
parse xml file into mysql db
presents
The script must do this:
- create php page call "upload.php" with an upload file form that send the upload XML file to another page call "send.php"
- the page "send.php" must have this script that elaborate node, child and attribute , and put data into mysql db with some variabiles with foreach cicle
we give you a XML file , a mysql structure , and the variabiles to be loaded into the database
The script must do this:
- create php page call "upload.php" with an upload file form that send the upload XML file to another page call "send.php"
- the page "send.php" must have this script that elaborate node, child and attribute , and put data into mysql db with some variabiles with foreach cicle
we give you a XML file , a mysql structure , and the variabiles to be loaded into the database
Crawl products info into MySQL DB
e_1` varchar(200) default NULL,
`brochure_2` varchar(200) default NULL,
`brochure_3` varchar(200) default NULL,
`brochure_4` varchar(200) default NULL,
`created` datetime NOT NULL,
`last_updated` datetime NOT NULL,
PRIMARY KEY (`product_id`)
) ENGINE=MyISAM AUTO_INCREMENT=8268 DEFAULT CHARSET=latin1;
`brochure_2` varchar(200) default NULL,
`brochure_3` varchar(200) default NULL,
`brochure_4` varchar(200) default NULL,
`created` datetime NOT NULL,
`last_updated` datetime NOT NULL,
PRIMARY KEY (`product_id`)
) ENGINE=MyISAM AUTO_INCREMENT=8268 DEFAULT CHARSET=latin1;
upload about a dozen large CSV files into a mySQL DB
I need someone to insert about a dozen CSV files into my site's mySQL DB.
I am encountering a User XXXX has exceeded the 'max_questions' when using a dump file.
I dont have the time to look for how to do it. Just looking for a guy with this experience to go around it, like create multiple users and rotate between them, something of the sort.
CHeapest bid wins. Its a very simple task
Convert SQL Database to MySQL DB
Convert an SQL Database into MYSQL... Need to go with a documentation and screenshots...
SQL DB has 50 tables
Postgresql to Mysql DB conversion.
I am migrating a drupal site from a postgresql db to a mysql db. I need someone to covert from a postgresql dump file into a mysql dumpfile.
ebay API PHP Upload listings from Mysql DB
-style: none; border-spacing: 0px;">
i need a tool to upload products to ebay using ebay API
it will get product data from mysql db and upload it if i pass the productID to the program
for example
http://localhost/upload.php?productID=23232
will get data for product ID 23232 and send to ebay creating a listing
it will get product data from mysql db and upload it if i pass the productID to the program
for example
http://localhost/upload.php?productID=23232
will get data for product ID 23232 and send to ebay creating a listing
Importer into a mysql db from a csv file
Need to automatyze the importing of csv files into my db
Magento MYSQL DB Migration
We have upgraded our website to magento 1.4.2 from 1.4.0 and did the installation using a new DB. The project is to move the old MySQL DB content into the new MySQL DB (or link the new install to the old DB). They are on the same server, same domain.
Simple PHP Form and MySQL DB Creation to Support Form
>
Additional files submitted: (Files are only available for logged in users)
club_nomination.pdf
club_night_sched.pdf
Additional files submitted: (Files are only available for logged in users)
club_nomination.pdf
club_night_sched.pdf
XML WEB SERVICE (SOAP INTERFACE) TO MYSQL DB
less than 5 days.
Additional files submitted: (Files are only available for logged in users)
XML+WEB+SERVICE+PROJECT.doc
Additional files submitted: (Files are only available for logged in users)
XML+WEB+SERVICE+PROJECT.doc
Csv Import Into Mysql
e (even if many) to me statically
- beside csv name is a drop down with potential categories from the categories table (has been pre-populated)
- I select the correct category based on the name of csv and hit submit
- script goes through each line of csv and matches the keyword in db and the keyword in the csv file and and assigns it to the category join table and adds the extra data to the data table
- script deletes csv file it just processed and starts over
- beside csv name is a drop down with potential categories from the categories table (has been pre-populated)
- I select the correct category based on the name of csv and hit submit
- script goes through each line of csv and matches the keyword in db and the keyword in the csv file and and assigns it to the category join table and adds the extra data to the data table
- script deletes csv file it just processed and starts over
Dotnetnuke Module (Display info using remote MySQL DB)
We have a remote MySQL DB - now we use PHP and Frames to show the script on our DNN web site. We want to rewrite code from PHP into ASP.NET C# for DNN to access remote MySQL and show the pages using DNN module. We are doing it because we want to improve our SEO ratings and do not want to use frames.
PHP script is itself pretty small - so rewriting it into ASP.NET C# for DNN module should not take experienced developer longer than 8-10 hours.
PHP script is itself pretty small - so rewriting it into ASP.NET C# for DNN module should not take experienced developer longer than 8-10 hours.
Spider/crawler Script + Mysql
be crawled as well as the page it will be displayed on can be found here:
http://dancecuts.com/spyder/spider-job.html
If the above link does not work, ask for the URL in PMB.
Server is Running PHP 5, MySQL, PERL, and has cronjobs.
http://dancecuts.com/spyder/spider-job.html
If the above link does not work, ask for the URL in PMB.
Server is Running PHP 5, MySQL, PERL, and has cronjobs.
Rss Parsed Into Mysql
We need to automate this process. ALL three agencies have an RSS feed. So we need a script that would automatically take any new articles from a number of feeds (three in this case) and parse them into our mysql.
We can set this file to run once a day using a cron or something.
Code must be in php and db in mysql. The mysql table should have the following fields:
1) article_id
2) title
3) summary
4) body
5) source
Daily Xml Feed Into Mysql
e date the product was first added to my database should be added to the table and updated as appropriate.
Sample formatted output of the feed can be seen here so you can get a feel for the data.
http://tinyurl.com/xmlmysql
Thank-you
Sample formatted output of the feed can be seen here so you can get a feel for the data.
http://tinyurl.com/xmlmysql
Thank-you
MySQL DB Tuning
tables like indexes and also adding system properties related to performance tuning...
each batch of DB save operations in a transaction is currently taking around 10 seconds we want to bring it down to 3 seconds max. for that we need some help in optimizing our database
For an expert it should take few hours to narrow down the issue....
MySQL DB expert with performance tuning skills needed to work on this task....
each batch of DB save operations in a transaction is currently taking around 10 seconds we want to bring it down to 3 seconds max. for that we need some help in optimizing our database
For an expert it should take few hours to narrow down the issue....
MySQL DB expert with performance tuning skills needed to work on this task....
PHP page to edit mysql db
We have a small database with 2 tables.
Approximately 20 rows per table
We currently use sqlyog to create/delete the rows in the table.
Instead we simply want a php page to do this. i.e. be able to edit the mysql db
Note: The php/mysql is hosted on windows not unix
Thanks
(Note we have reposted this project. We initially posted the project as per hour in error)
Approximately 20 rows per table
We currently use sqlyog to create/delete the rows in the table.
Instead we simply want a php page to do this. i.e. be able to edit the mysql db
Note: The php/mysql is hosted on windows not unix
Thanks
(Note we have reposted this project. We initially posted the project as per hour in error)
Create PDF with QR codes out of data in MySQL DB
tains links to automatically generated PDF's, which are built in this manner:
https://docs.google.com/drawings/d/1H8bAHJoSolPSzIIgIcIi2cSaRj4cHUMKm1qf7WKJXEE/edit
All the data will be taken from a MySQL DB, the table is attached, change the extension from 123 to sql.
Simple project, should take 1-2 hours for an experienced developer. Only bid if you know how to generate PDF and QR codes automatically from a webpage
https://docs.google.com/drawings/d/1H8bAHJoSolPSzIIgIcIi2cSaRj4cHUMKm1qf7WKJXEE/edit
All the data will be taken from a MySQL DB, the table is attached, change the extension from 123 to sql.
Simple project, should take 1-2 hours for an experienced developer. Only bid if you know how to generate PDF and QR codes automatically from a webpage
CSV into mysql using codeigniter
Additional files submitted: (Files are only available for logged in users)
instruction.txt
prepare.csv
