You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit e4e8b47
Browse filesBrowse the repository at this point in the historyBrowse files
stlc-bot
committed
docs(openapi): unify regex wording and shorten sourcePreference descriptions (#2051)
Copy file name to clipboardExpand all lines: pkg/cmd/web.go
+5-5Lines changed: 5 additions & 5 deletions
Original file line number
Diff line number
Diff line change
@@ -485,7 +485,7 @@ var webWebCrawlMd = requestflag.WithInnerFlags(cli.Command{
485
485
},
486
486
&requestflag.Flag[string]{
487
487
Name: "exclude-url-regex",
488
-
Usage: "RE2 regex pattern. URLs matching this pattern are never followed or scraped, even when they match urlRegex. The starting URL is always scraped.",
488
+
Usage: "Regex pattern. URLs matching this pattern are never followed or scraped, even when they match urlRegex. The starting URL is always scraped.",
489
489
BodyPath: "excludeUrlRegex",
490
490
},
491
491
&requestflag.Flag[bool]{
@@ -502,13 +502,13 @@ var webWebCrawlMd = requestflag.WithInnerFlags(cli.Command{
502
502
},
503
503
&requestflag.Flag[bool]{
504
504
Name: "include-images",
505
-
Usage: "Include image references in the Markdown output Only applies to `html-conversion` extractions.",
505
+
Usage: "Include image references in the Markdown output (`html-conversion` only).",
506
506
Default: false,
507
507
BodyPath: "includeImages",
508
508
},
509
509
&requestflag.Flag[bool]{
510
510
Name: "include-links",
511
-
Usage: "Preserve hyperlinks in the Markdown output Only applies to `html-conversion` extractions.",
511
+
Usage: "Preserve hyperlinks in the Markdown output (`html-conversion` only).",
512
512
Default: true,
513
513
BodyPath: "includeLinks",
514
514
},
@@ -548,13 +548,13 @@ var webWebCrawlMd = requestflag.WithInnerFlags(cli.Command{
548
548
},
549
549
&requestflag.Flag[bool]{
550
550
Name: "shorten-base64-images",
551
-
Usage: "Truncate base64-encoded image data in the Markdown output Only applies to `html-conversion` extractions.",
551
+
Usage: "Truncate base64-encoded image data in the Markdown output (`html-conversion` only).",
552
552
Default: true,
553
553
BodyPath: "shortenBase64Images",
554
554
},
555
555
&requestflag.Flag[[]string]{
556
556
Name: "source-preference",
557
-
Usage: "Where the Markdown should come from, in order of preference; the first usable source wins. `html-conversion` converts the page HTML, and counts as unusable when the conversion has almost no content (under 200 characters). `markdown-direct` uses the official Markdown version the page publishes through, returned as the site serves it. Defaults to `[\"html-conversion\", \"markdown-direct\"]`. With only `markdown-direct`, a page that publishes no Markdown fails with `NO_PUBLISHED_MARKDOWN` and is not billed. Requests with include or exclude selectors never use `markdown-direct`, so they must include `html-conversion`.",
557
+
Usage: "Markdown sources in order of preference: `html-conversion` converts the page HTML, `markdown-direct` uses Markdown the site publishes.",
0 commit comments