Data Mining From Digg (by script)
Required skills: Data Processing, Market Research, Python, Ruby/Ruby on Rails
Data Mining Task from Digg
You'll be supplied with a list of movie titles.
Your task is to gather the following data
- List of Digg Submissions related to the movie based on the following search terms:
a. search for ||movie_name movie||
b. search for ||movie_name film||
c. search for ||movie_name trailer||
d. search for ||movie_name watch||
e. search for ||movie_name see||
IE for the movie "The Eye" you will run the following separates searches
"The Eye movie"
"The Eye film"
"The Eye Trailer"
"The Eye watch"
"The Eye see"
All *without* the double quotes!!
All searches should be combined and duplicates deleted (delete only exact duplicates, that leads to the same digg submission, not the same external URL)!
Digg search settings: "Title, Description, and URL", "All Stories". "Including burried: NO"
The results should be saved in a table (preferably excel, CSV is also possible) with the following data
ID (auto increment Serial Number), Date Submitted (dd/mm/yyyy), Title, Full URL of DIGG Item, FULL URL ITEM IS LINKED TO, number of diggs, number of comments, Made Popular(YES/NO)
Please note that the date appears on digg as a relative date (ie 2 years 34 days ago). This should of course be converted to the exact data).
Made Popular: Regular diggs (not popular) shows the following text on search result: "username" submitted "342 days ago"
Popular items shows the following text instead: "Username" made popular "342 days ago"
Sample data attached. Please make sure you understand the requirements before posting your bid.
I expect this to be done, as accurately as possible by script (automatically) and in 2-3 days.
You'll be supplied with a list of movie titles.
Your task is to gather the following data
- List of Digg Submissions related to the movie based on the following search terms:
a. search for ||movie_name movie||
b. search for ||movie_name film||
c. search for ||movie_name trailer||
d. search for ||movie_name watch||
e. search for ||movie_name see||
IE for the movie "The Eye" you will run the following separates searches
"The Eye movie"
"The Eye film"
"The Eye Trailer"
"The Eye watch"
"The Eye see"
All *without* the double quotes!!
All searches should be combined and duplicates deleted (delete only exact duplicates, that leads to the same digg submission, not the same external URL)!
Digg search settings: "Title, Description, and URL", "All Stories". "Including burried: NO"
The results should be saved in a table (preferably excel, CSV is also possible) with the following data
ID (auto increment Serial Number), Date Submitted (dd/mm/yyyy), Title, Full URL of DIGG Item, FULL URL ITEM IS LINKED TO, number of diggs, number of comments, Made Popular(YES/NO)
Please note that the date appears on digg as a relative date (ie 2 years 34 days ago). This should of course be converted to the exact data).
Made Popular: Regular diggs (not popular) shows the following text on search result: "username" submitted "342 days ago"
Popular items shows the following text instead: "Username" made popular "342 days ago"
Sample data attached. Please make sure you understand the requirements before posting your bid.
I expect this to be done, as accurately as possible by script (automatically) and in 2-3 days.
Posted In:Data ProcessingPythonMarket ResearchRuby/Ruby on Rails |
Related projects:
Data Mining From Website
I have a very simple project of data mining from 5 sites that I will provide to you.
I want script / programs to do the project.
Timeline : 2 days
Budget fixed.
Bid confidently.
I want script / programs to do the project.
Timeline : 2 days
Budget fixed.
Bid confidently.
Data Mining from Yellow Pages
a for general listings without a physical address. Do not mine general listings that say "Serving the [City] Area"
Eventually I will want to have data mined for 15,000 different cities, but I am asking for just 100 now to see if you can properly do this. If you feel you can do 15,000 cities please feel free to communicate this to me. I may select multiple winners for this project.
Eventually I will want to have data mined for 15,000 different cities, but I am asking for just 100 now to see if you can properly do this. If you feel you can do 15,000 cities please feel free to communicate this to me. I may select multiple winners for this project.
Data Mining From Yellow Pages
e general listings that say "Serving the [City] Area"
*See attachment spreadsheet for exactly what I'm looking for using the following 2 small cities as examples:
Burlington, KS
Powell, WY
Eventually I will want to have data mined for 15,000 different cities, but I am asking for just 100 now to see if you can properly do this. If you feel you can do 15,000 cities please feel free to communicate this to me. I may select multiple winners for this project.
*See attachment spreadsheet for exactly what I'm looking for using the following 2 small cities as examples:
Burlington, KS
Powell, WY
Eventually I will want to have data mined for 15,000 different cities, but I am asking for just 100 now to see if you can properly do this. If you feel you can do 15,000 cities please feel free to communicate this to me. I may select multiple winners for this project.
Web Scraping - Research of Email Addresses - Data Mining
ongoing relationship with with future projects posted just for them on Scriptlance. Some of those projects will be: data mining from corporate career / job pages, placing new Linkedin Connections on an existing Linkedin Profile Page, Adding FaceBook Friends and Likes from real people in the United States, on our corporate Facebook page.
Please message me with any questions you may have on the project.
Bid confidently
Please message me with any questions you may have on the project.
Bid confidently
Data Mining / Web Scraping / Research Of Email Addresses
r an expert who we can have an ongoing relationship with with future projects posted just for them on Scriptlance. Some of those projects will be: data mining from corporate career / job pages, placing new Linkedin Connections on an existing Linkedin Profile Page, Adding FaceBook Friends and Likes from real people in the United States, on our corporate Facebook page.
Please message me with any questions you may have on the project.
Thank you for your bid.
Please message me with any questions you may have on the project.
Thank you for your bid.
Around 1$ /hour: easy DATA MINING from internet and simple pr
hed file first.
Additional files submitted: (Files are only available for logged in users)
Data+Collecting.docx
Additional files submitted: (Files are only available for logged in users)
Data+Collecting.docx
Data Mining from website into excel - for Stacross only 3
Data Mining from website into excel - for Stacross only
Retrieval data from website by script (SP20100918)
ompanyId # foreign key to company.ID
TABLE ProductCategory # source: http://www.cebit.de/search_pg
ID
Name
ParentPC_ID # foreign key to ProductCategory.ID, NULL if it's the root ProductCategory (no parent)
TABLE Section # source: http://www.cebit.de/search_zb
ID
Name
ParentSI_ID # foreign key to Section.ID, NULL if it's the root section (no parent)
TABLE ProductCategory # source: http://www.cebit.de/search_pg
ID
Name
ParentPC_ID # foreign key to ProductCategory.ID, NULL if it's the root ProductCategory (no parent)
TABLE Section # source: http://www.cebit.de/search_zb
ID
Name
ParentSI_ID # foreign key to Section.ID, NULL if it's the root section (no parent)
Data Mining Script/scraper
ng scripts, this should be an easy job for someone with appropriate experience.
I will need to be able to test the script on my local environment until I am 100% happy with it's completion and ability to do what is specified in this job.
No escrow payments or any payment will be made until I am 100% happy with the work done. Do not bid if you require escrow. No bid will be accepted from anyone who does not include the code word "AUSTRALIA" in messages.
I will need to be able to test the script on my local environment until I am 100% happy with it's completion and ability to do what is specified in this job.
No escrow payments or any payment will be made until I am 100% happy with the work done. Do not bid if you require escrow. No bid will be accepted from anyone who does not include the code word "AUSTRALIA" in messages.
Data mining from a website
I need a web data scraping tool (script) in order to (legally) enter data into a search form of a website and collect data from it and to store them in an excel file.
I have the structure of the data and everything helping you to develop the script.
-enter data from an excel sheet into a form of a website
-grab the data from the website
-enter the grabbed data into excel sheet again
-repeat.
I have the structure of the data and everything helping you to develop the script.
-enter data from an excel sheet into a form of a website
-grab the data from the website
-enter the grabbed data into excel sheet again
-repeat.
Data Extracting and Processing PHP script
d be possible to place the processed data in any page whether it is HTML or Wordpress site
The project should be done within 3 days
When you bid, please use the word "Stats" in the message, so that I know you have read the project description and understand the requirements.
The project should be done within 3 days
When you bid, please use the word "Stats" in the message, so that I know you have read the project description and understand the requirements.
Data mining & learning techniques 4 future network knowledge
be loaded via SSIS into SQL Server and cubes shall be generated. Once the data is available in data warehouse in form of cubes, appropriate queries and slicing and dicing can be performed to figure out what are most probable scenarios for BTS outage. This ‘knowledge’ can be used to warn of possible outages and probably prevent failures before they occur.
Data mining & learning techniques 4 future network knowledge
nd powerful technology with the ability and potential used for extracting of analytical and predictive information from huge databases and is widely helpful for companies to focus on the important information in their data warehouses.
this is the abstract of the project. any one interested in it has to generate some scenario and work on it.
this is the abstract of the project. any one interested in it has to generate some scenario and work on it.
Data Mining Expoert Needed
wledge on web scraping and data mining. Candidate will be responsible in writing a scripts/cron so data scraping is done automatically. Developer must be able to set up cron. This is important because data mine must be set up automatically, multiple times a day.
If developer performs work successfully (on time), additional work will be provided.
If developer performs work successfully (on time), additional work will be provided.
Scrape Data (mining) from focalpricecom to Excel and updater
e in a .txt files (again not scraping the entire site)
The app most be able to update the excel sheet when I want to. Look if the price has change or when the link doesnt work ( item is out of stock or no longer available to sell). I also want to be noticed ( create a .txt file or whatever telling me SKU #xxxxxxxx has change price)
Thank you
The app most be able to update the excel sheet when I want to. Look if the price has change or when the link doesnt work ( item is out of stock or no longer available to sell). I also want to be noticed ( create a .txt file or whatever telling me SKU #xxxxxxxx has change price)
Thank you
Category Data Fields Extraction Mining from eBay & Other
Additional files submitted: (Files are only available for logged in users)
CategoryScrape-ExtractionExample.jpg
CategoryScrape-ExtractionExample2.jpg
Data mining Uk & Ireland Buisness
>I am looking for all pc repair | Laptop Repair | Data Recovery specialists
In UK and Ireland.
Winner must find the details by there own means (not ask me to tell them how to get it)
This will be ongoing work needed for other categorys
I would like Business name | Tel No | Address |
But most importantly email addresses thanks.
NO FEEDBACK DON'T BID
NO PORTFOLIO DON'T BID
In UK and Ireland.
Winner must find the details by there own means (not ask me to tell them how to get it)
This will be ongoing work needed for other categorys
I would like Business name | Tel No | Address |
But most importantly email addresses thanks.
NO FEEDBACK DON'T BID
NO PORTFOLIO DON'T BID
Data Mining from Drop Down Menus
o get the data before bidding.
Additional files submitted: (Files are only available for logged in users)
Screen+shot+2010-08-28+at+1.09.36+AM.png
Additional files submitted: (Files are only available for logged in users)
Screen+shot+2010-08-28+at+1.09.36+AM.png
Simple Data Mining Work For Long Term
ete a bunch and move forward one by one. There are many websites from which the data has to be extracted so this will be long term work. Payment will be done through GAF. People with the least bid will be awarded this job. PM me for any clarification.
PS: If you have any bots or softwares to data mine from the given websites automatically then you can also submit more details about it.
PS: If you have any bots or softwares to data mine from the given websites automatically then you can also submit more details about it.
Data Extract From Site 2
I have a very simple project of data mining from 5 sites that I will provide to you.
I want script / programs to do the project.
Timeline : 2 days
Budget fixed.
Bid confidently.
Additional Info (Added 2/10/2010 at 6:33 EST)...System Message: This is a reposting of project Data Extract from site (1265524781).
I want script / programs to do the project.
Timeline : 2 days
Budget fixed.
Bid confidently.
Additional Info (Added 2/10/2010 at 6:33 EST)...System Message: This is a reposting of project Data Extract from site (1265524781).
