Archive: Help code Google searchtool 4 Eng writer
Budget
10000$
per month
Posted: 5 years ago
Closed
- Description
- I am a linguist building a Google-based desktop search engine Engle, which processes and organizes Google search results as reference material for English writing and English learning. Currently, Google is prevalently used as a means of understanding and checking English expressions, and Engle makes this process much more convenient and powerful, by turning Google into an engine dedicated to a single purpose. Through many years’ research and user testing I have developed an ideal design with detailed algorithms (written in English). I am now looking for a developer to put them into code as MVP.
Engle has the following modules (see attached file):
* Input interface: conveniently takes user entries with drop-down menus from the search box and generates search keywords from it.
* Scraper: accesses Google.com (not Custom Search) from a user IP at rates that minimize Google captcha and scrapes results for the keywords.
* Result processor: sorts and ranks the results by URLs and keyword matches.
* Output interface: displays results by their type and rank and supports various user controls over the results (multi-tab windows; nested i-frames; move, delete and add) and secondary searches.
I already have a scraper and have done many experiments with captchas. But it is in need of repair and revision. It would be better to build a new one, but hopefully current one is still useful as a resource. It is a .NET 4.5.2 Windows application written in C# and has detailed notes.
I am looking for a developer or a team to build the entire system, but will also consider developers with a strong expertise on some part of it. Importantly, I need someone to stay with me for a long term through completion, debugging, and new iterations. I see the project as a process of building partnership, so please apply only if you are interested in a long-term partnership.
Now, about how to proceed, If I shortlist you, I will send you the Engle MVP blueprint for feasibility, price, and delivery time. This is a document of about 6500 ~ 7000 words with several drawings. As this will take much of your time, I will pay for your assessment and feedback by creating a small private project for you. I would also expect comments and advice on clarity, problems, alternative approaches, etc. Based on your feedback I will make the final choice and we will start building milestone by milestone.
My LinkedIn profile: https://www.linkedin.com/in/jinseungeu/
Please answer the following questions in your application:
1. Will you build the whole or part of the system? If part, which part?
2. If you build only a part, will you be able to do the system integration and make sure it works properly as a whole including debugging? What issues do you anticipate in this process?
3. If you build the scraper, will you always be available to help when Google changes HTML markup? Can you suggest a system to ensure a prompt response? If so, how much will each fix/system cost?
4. Your background relevant to this project, why you are interested in this project, and why you are a good fit
5. Your public profile such as LinkedIn and Github if available
6. Coding language and technical platform you plan to use
7. Your price for assessment and feedback on the blueprint
8. Test question if you propose to build the scraper:
In my tests with my scraper, I found strong evidence that Google knows the difference between manual requests and bot requests although the scraper made requests at humanly feasible rates, 5 ~ 15 seconds apart: i) Even when the scraper is blocked with a captcha, manual search is still allowed; ii) It is much easier to solve captchas caused by a manual search (usually just a click) than it is to solve captchas caused by a scraper (long series of images):
8a. Does Google really know the difference?
8b. If so, how does it detect the difference?
8c. If so, why doesn’t it block the scraper from the beginning?
8d. What is your strategy to build a human-like scraper, and how far can you succeed?
Working conditions:
Fixed Price
$5k-$10k
Skills:
captcha,frontend development,microsoft word,web scraping,google,full stack,backend
- Category
Similar freelance jobs
$7Hi Robert P. , I noticed your profile and would like to offer you my project. We can discuss any details over chat....
1 year ago
"Hello, I need to create a website based on a . psd design file. Please also specify the timeframe within which you can complete this. Technical requirements: Layout (not pixel-perfect, but close to it) Responsiveness (the website should properly adapt to different screen sizes and devices) Clean code......
1 year ago
Project Title: Delphi Code Feature Creation Using delphi: Check to see if this already exsits, if not: create a shedulled task to start my program on PC startup with highest permissions, with no password or prompt. program is called for example: C:\Program Files (x86)\Myfolder\myprogram. exe If it already......
1 year ago
I want to create a program for customers and sellers to be able to use, to create a template for there artwork and be able to size them to there specific needs. And be able to download them as pdf or png files. This program will benefit the clothing industry with the industry i am in....
1 year ago
Hi, I am not quite sure if what I am asking is possible but within my University degree there is a calculator program which only works on the HP Prime prime calculator, I own a Casio fx-CG50 AU. I was hoping to have this program converted into a format which is compatible with my Casio calculator, all......
1 year ago
I am looking for a skilled C++ developer to help with a real-time object detection system for my project....
1 year ago
Project Title: Correct Rcpp armadillo code Overview: I am seeking a skilled developer to fix a compilation error in my Rcpp armadillo code. The code is currently throwing a compilation error, and I need it to be resolved promptly. Requirements: - Proficient in Rcpp and armadillo library - Strong understanding......
1 year ago
Project Description: - I am looking for a freelancer who can combine all the columns of 2 rows with similar values in Telerik Reporting. - The combined data needs to be displayed in a table view. - Ideal skills and experience for this job include: - Proficiency in Telerik Reporting. - Strong understanding......
1 year ago
$250Bonjour Dmytro M. , j'ai remarqué votre profil et je souhaite vous proposer mon projet. Nous pouvons discuter des détails via le chat....
1 year ago
Hello, I am looking to develop a unity soccer game with moves like score hero 1. Map with 1-3 stars achievments 2. engine to make the goals like i want 3. smooth game play 4. IAP , shop , buy lives 5. lives to play 6. finger smoothness touch 7. the level will be added automticlly to the map 8. rewind......
1 year ago
Project Title: Bootloader For Renesas RL78 mcu Description: I am looking for a skilled developer to create a bootloader for the Renesas RL78 mcu. The ideal candidate should have experience with Renesas RL78 mcu and be familiar with the development environment. bootloader code is ready need help for run......
1 year ago
I am using EMA´s (50/75/100/200),two Stoch (5/5/5 and 5/3/3), RDX Indicator and the Indicator "The Arty". For Short Positions the Prive has to be under the 200 EMA (the 100EMA under 200, 75 under 100, 50 under 75, NOT crossing) and for Long Positions over the 200 EMA ( 100 over 200, 75 over 100, 50 over......
1 year ago
My project involves using an Emotional Stroop Task to measure and assess attentional bias towards emotional stimuli. To do this, I will be using the Drift Diffusion Model which is an analytical model to study the human decision making process. My study will need to include 90 participants in order to......
1 year ago
I'd like to extract tables from pdf invoices files. At this stage i really only want the products that are in the tables on the invoices. The only information i would like from the invoices is supplier date (received) location received. Within thetables i require stock code, product item, the unit measurement......
1 year ago
Im creating a config using 'openbullet 1. 4', everything added successfully, due i have 3 years of using openbullet, but this request i never faced it before!...
1 year ago
This position is responsible for verifying data quality reports and queries, correcting errors and also tracking them....
1 year ago
We are currently looking for developer to contact us on developing integration/plugin for below listed platform. Please drop me message on which plugin you're able to develop. Please send similar plugin portfolio of your previous work. The plugin need to ready for uploading to marketplace . ActiveCampaign.......
3 year ago
Similar freelance jobs
- Freelance jobs for Web Developer
- Freelance jobs for Database Developer
- Freelance jobs for Software Developer
- Freelance jobs for System Developer
- Freelance jobs for Game Developer
- Freelance jobs for Mobile App Developers
- Freelance jobs for QA & Testing specialist
- Freelance jobs for embedded software developer
- Freelance jobs for CRM & ERP developer
Drag