Welcome to DEiXTo!
DEiXTo (or ΔEiXTo) is a powerful web data extraction tool that is based on the W3C Document Object Model (DOM). It allows users to create highly accurate “extraction rules” (wrappers) that describe what pieces of data to scrape from a website. DEiXTo consists of three separate components:
- GUI DEiXTo, an MS Windows™ application implementing a friendly graphical user interface that is used to manage extraction rules (build, test, fine-tune, save and modify). This is all that you need for small-scale extraction tasks.
- DEiXToBot, a Perl module implementing a flexible and efficient Mechanize agent (essentially a browser emulator) capable of extracting data of interest using GUI DEiXTo generated patterns. It contains the best-of-breed Perl technology and allows extensive customization. Thus, it facilitates tailor-made solutions.
- DEiXTo CLE (Command Line Executor), a stand-alone, DEiXToBot-based, cross-platform utility that can massively apply an extraction rule on multiple target pages and produce structured output in a variety of formats.
“I have done an extensive search on the internet to find something just like DEiXTo! I am very glad that I have found it! It is very easy to use and understand – even for non-programmers like me. I only want to do one single – but big – scaping task. After the DEiXTo Team solved some extraordinary character problems for me – many thanks guys – I will now be able to fulfill this task in the next one or two days. I am looking forward to the results!”
DEiXTo can contend with a wide range of websites with high precision and recall. It provides the user with an arsenal of features aiming at the construction of well-engineered extraction rules. Wrappers built with GUI DEiXTo can be scheduled to run automatically providing automated access to resources of interest and saving users a lot of time, energy, and repetitive effort.