Archive: Scrap ans track real estate ads

Budget 150$ per month

Posted: 5 years ago

Closed

Description: I'm looking for a python tool that can scrap ads data from a real estate site in Hebrew.
Please note that the website does not have an English interface as far as I know, though Google translate may be of assistance.
I believe the site has taken some measures to prevent scraping.

The goals of the project:
- Recording new ads when they are published.
- Tracking price changes
See attached video showing the required data.

The output of running the tool will be an update to a database (e.g. pandas dataframe) of all ads - location, price, size, description, ad number, owner name and phone number, and all binary and numeric attribute. In case behind the scenes there is also an NadlanID field it should also be recorded.
Price changes can be kept in a different table.

The code should be written in python based on any standard library that is currently maintained.
I expect the code to be organized and documented enough to allow a skilled programmer to update the code if needed.

There should be a support for using third party proxy services
Skills:
video,database,English,general programming,Hebrew,Python programming language,real estate,scraping,software development,translation,user interface (UI),web