Multiple instantiations of Wikipedia source #16
-
|
Hi! Thank you very much Armin for this very useful package. Is it possible to instantiate multiple version of Wikipedia source: for example one in one language, and one in another? |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments 3 replies
-
|
@neurolit I think that should be possible by defining multiple Wikipedia sources (with a different base URL), but this is not built-in. Let me experiment with that and get back to you |
Beta Was this translation helpful? Give feedback.
-
|
@neurolit Ok, I did a quick test, and it is possible to get results in different languages, but running multiple instances in different languages in a multi-source search format would require some work around. |
Beta Was this translation helpful? Give feedback.
-
|
For my use case, I just want to be able to change the language, or to have 3 sources (omni-wikipedia-fr, omni-wikipedia-de and omni-wikipedia-fr, for example). You're right, I'll never need to search in the three languages in one interactive query. |
Beta Was this translation helpful? Give feedback.
-
|
Ok, here is a quick and somewhat dirty solution. You can, of course, come up with cleaner solutions, for example using macros that take the language code as input and make the fetcher function for you, but I'll leave that to you to figure out! ;;; French Wikipedia
(cl-defun consult-omni--wikipedia-fetch-results-in-french (input &rest args &key callback lang &allow-other-keys)
"Fetches search results from French Wikipedia for INPUT."
(pcase-let* ((`(,query . ,opts) (consult-omni--split-command input (seq-difference args (list :callback callback))))
(consult-omni-wikipedia-api-url "https://fr.wikipedia.org/w/api.php")
(opts (car-safe opts))
(count (plist-get opts :count))
(page (plist-get opts :page))
(count (or (and count (integerp (read count)) (string-to-number count))
consult-omni-default-count))
(page (or (and page (integerp (read page)) (string-to-number page))
consult-omni-default-page))
(count (max count 1))
(params `(("action" . "query")
("format" . "json")
("list" . "search")
("formatversion" . "2")
("prop" . "info")
("inprop" . "url")
("srwhat" . "text")
("srsearch" . ,(url-hexify-string query))
("srlimit" . ,(format "%s" count))
("sroffset" . ,(format "%s" page))))
(headers '(("User-Agent" . "Emacs:consult-omni/0.1 (https://github.com/armindarvish/consult-omni);"))))
(consult-omni--fetch-url consult-omni-wikipedia-api-url consult-omni-http-retrieve-backend
:encoding 'utf-8
:params params
:headers headers
:parser #'consult-omni--json-parse-buffer
:callback
(lambda (attrs)
(when-let* ((raw-results (map-nested-elt attrs '("query" "search")))
(annotated-results
(mapcar (lambda (item)
(let*
((consult-omni-wikipedia-url "https://fr.wikipedia.org/")
(consult-omni-wikipedia-search-url "https://fr.wikipedia.org/wiki/Special:Search/")
(source "Wikipedia French")
(title (format "%s" (gethash "title" item)))
(url (concat consult-omni-wikipedia-url "wiki/" (string-replace " " "_" title)))
(date (gethash "timestamp" item))
(date (format-time-string "%Y-%m-%d" (date-to-time date)))
(snippet (replace-regexp-in-string "<span.*?>\\|</span>\\|"" "" (format "%s" (gethash "snippet" item))))
(search-url (concat consult-omni-wikipedia-search-url query))
(decorated (consult-omni--wikipedia-format-candidate :source source :query query :url url :search-url search-url :title title :snippet snippet :date date)))
(propertize decorated
:source source
:title title
:url url
:search-url search-url
:query query
:date date)))
raw-results)))
(funcall callback annotated-results)
annotated-results)))))
(consult-omni-define-source "Wikipedia French"
:narrow-char ?w
:type 'dynamic
:require-match nil
:face 'consult-omni-engine-title-face
:request #'consult-omni--wikipedia-fetch-results-in-french
:on-new (apply-partially #'consult-omni-external-search-with-engine "Wikipedia")
:preview-key consult-omni-preview-key
:search-hist 'consult-omni--search-history
:select-hist 'consult-omni--selection-history
:enabled (lambda () (bound-and-true-p consult-omni-wikipedia-api-url))
:group #'consult-omni--group-function
:sort t
:type 'dynamic
:interactive consult-omni-intereactive-commands-type)
;;; German Wikipedia
(cl-defun consult-omni--wikipedia-fetch-results-in-german (input &rest args &key callback lang &allow-other-keys)
"Fetches search results from French Wikipedia for INPUT."
(pcase-let* ((`(,query . ,opts) (consult-omni--split-command input (seq-difference args (list :callback callback))))
(consult-omni-wikipedia-api-url "https://de.wikipedia.org/w/api.php")
(opts (car-safe opts))
(count (plist-get opts :count))
(page (plist-get opts :page))
(count (or (and count (integerp (read count)) (string-to-number count))
consult-omni-default-count))
(page (or (and page (integerp (read page)) (string-to-number page))
consult-omni-default-page))
(count (max count 1))
(params `(("action" . "query")
("format" . "json")
("list" . "search")
("formatversion" . "2")
("prop" . "info")
("inprop" . "url")
("srwhat" . "text")
("srsearch" . ,(url-hexify-string query))
("srlimit" . ,(format "%s" count))
("sroffset" . ,(format "%s" page))))
(headers '(("User-Agent" . "Emacs:consult-omni/0.1 (https://github.com/armindarvish/consult-omni);"))))
(consult-omni--fetch-url consult-omni-wikipedia-api-url consult-omni-http-retrieve-backend
:encoding 'utf-8
:params params
:headers headers
:parser #'consult-omni--json-parse-buffer
:callback
(lambda (attrs)
(when-let* ((raw-results (map-nested-elt attrs '("query" "search")))
(annotated-results
(mapcar (lambda (item)
(let*
((consult-omni-wikipedia-url "https://de.wikipedia.org/")
(consult-omni-wikipedia-search-url "https://de.wikipedia.org/wiki/Special:Search/")
(source "Wikipedia German")
(title (format "%s" (gethash "title" item)))
(url (concat consult-omni-wikipedia-url "wiki/" (string-replace " " "_" title)))
(date (gethash "timestamp" item))
(date (format-time-string "%Y-%m-%d" (date-to-time date)))
(snippet (replace-regexp-in-string "<span.*?>\\|</span>\\|"" "" (format "%s" (gethash "snippet" item))))
(search-url (concat consult-omni-wikipedia-search-url query))
(decorated (consult-omni--wikipedia-format-candidate :source source :query query :url url :search-url search-url :title title :snippet snippet :date date)))
(propertize decorated
:source source
:title title
:url url
:search-url search-url
:query query
:date date)))
raw-results)))
(funcall callback annotated-results)
annotated-results)))))
(consult-omni-define-source "Wikipedia German"
:narrow-char ?w
:type 'dynamic
:require-match nil
:face 'consult-omni-engine-title-face
:request #'consult-omni--wikipedia-fetch-results-in-german
:on-new (apply-partially #'consult-omni-external-search-with-engine "Wikipedia")
:preview-key consult-omni-preview-key
:search-hist 'consult-omni--search-history
:select-hist 'consult-omni--selection-history
:enabled (lambda () (bound-and-true-p consult-omni-wikipedia-api-url))
:group #'consult-omni--group-function
:sort t
:type 'dynamic
:interactive consult-omni-intereactive-commands-type)
You can add more languages as you wish, following the same pattern above, and then you can even use them in a multi-source search if you want, like this: (consult-omni-multi nil "[French and Germna Wikipedia] Search: " '("Wikipedia French" "Wikipedia German"))Here is a screenshot:
|
Beta Was this translation helpful? Give feedback.
-
|
Wow, thank you very much! I'll take it from there! |
Beta Was this translation helpful? Give feedback.
Ok, here is a quick and somewhat dirty solution. You can, of course, come up with cleaner solutions, for example using macros that take the language code as input and make the fetcher function for you, but I'll leave that to you to figure out!