GenerallyPositive.DigestRuleSet Class Reference

One named set of LLM-digest cleanup rules: which nodes are junk, where the main content usually lives, what base URL to use for relative sitemap links, and which post-conversion markdown cleanup passes to run. Sites drift over time, so these live in LLMDigestRules.yaml rather than being hardcoded. More...

Properties
string	Name = "generic" [get, set]
	Name of this rule set, e.g. "generic" or "indeed".
List< string >	DomainPatterns = new List<string>() [get, set]
	Substrings matched (case-insensitive) against the current page URL to decide whether this rule set applies. The "generic" rule set is the fallback and does not need any.
List< string >	JunkSelectors = new List<string>() [get, set]
	XPath expressions for nodes to strip before conversion (ads, nav, cookie banners, etc.).
List< string >	MainContentCandidates = new List<string>() [get, set]
	XPath expressions tried in order to find the main content container.
string	SitemapBaseUrl = "" [get, set]
	Base URL used to resolve relative links when a page is treated as a sitemap. Empty means derive it from the current page's URL.
List< string >	EnabledPasses = new List<string>() [get, set]
	Names of the post-conversion markdown cleanup passes to run, e.g. "PriceGluing".

Detailed Description

One named set of LLM-digest cleanup rules: which nodes are junk, where the main content usually lives, what base URL to use for relative sitemap links, and which post-conversion markdown cleanup passes to run. Sites drift over time, so these live in LLMDigestRules.yaml rather than being hardcoded.

Definition at line 32 of file DigestRules.cs.

Property Documentation

DomainPatterns

List<string> GenerallyPositive.DigestRuleSet.DomainPatterns = new List<string>()

getset

Substrings matched (case-insensitive) against the current page URL to decide whether this rule set applies. The "generic" rule set is the fallback and does not need any.

Definition at line 41 of file DigestRules.cs.

EnabledPasses

List<string> GenerallyPositive.DigestRuleSet.EnabledPasses = new List<string>()

getset

Names of the post-conversion markdown cleanup passes to run, e.g. "PriceGluing".

Definition at line 53 of file DigestRules.cs.

JunkSelectors

List<string> GenerallyPositive.DigestRuleSet.JunkSelectors = new List<string>()

getset

XPath expressions for nodes to strip before conversion (ads, nav, cookie banners, etc.).

Definition at line 44 of file DigestRules.cs.

MainContentCandidates

List<string> GenerallyPositive.DigestRuleSet.MainContentCandidates = new List<string>()

getset

XPath expressions tried in order to find the main content container.

Definition at line 47 of file DigestRules.cs.

Name

string GenerallyPositive.DigestRuleSet.Name = "generic"

getset

Name of this rule set, e.g. "generic" or "indeed".

Definition at line 35 of file DigestRules.cs.

SitemapBaseUrl

string GenerallyPositive.DigestRuleSet.SitemapBaseUrl = ""

getset

Base URL used to resolve relative links when a page is treated as a sitemap. Empty means derive it from the current page's URL.

Definition at line 50 of file DigestRules.cs.

---

The documentation for this class was generated from the following file:

• Common/DigestRules.cs