XTreePath: A generalization of XPath to handle real world structural variation

Understand

We discuss a key problem in information extraction which deals with wrapper failures due to changing content templates.

• A good proportion of wrapper failures are due to HTML templates changing to cause wrappers to become incompatible after element inclusion or removal in a DOM (Tree representation of HTML).
• We perform a large-scale empirical analyses of the causes of shift and mathematically quantify the levels of domain difficulty based on entropy.
• We propose the XTreePath annotation method to captures contextual node information from the training DOM.