Bruno Sofiato f64fbd9b74 Updated tokenizer to better matching when search for code snippets (#32261) ... This PR improves the accuracy of Gitea's code search. Currently, Gitea does not consider statements such as `onsole.log("hello")` as hits when the user searches for `log`. The culprit is how both ES and Bleve are tokenizing the file contents (in both cases, `console.log` is a whole token). In ES' case, we changed the tokenizer to [simple_pattern_split](https://www.elastic.co/guide/en/elasticsearch/reference/current/analysis-simplepatternsplit-tokenizer.html#:~:text=The%20simple_pattern_split%20tokenizer%20uses%20a,the%20tokenization%20is%20generally%20faster.). In such a case, tokens are words formed by digits and letters. In Bleve's case, it employs a [letter](https://blevesearch.com/docs/Tokenizers/) tokenizer. Resolves #32220 --------- Signed-off-by: Bruno Sofiato <bruno.sofiato@gmail.com>		2024-11-06 20:51:20 +00:00
..
limited_org
migration/lfs-test.git
org3
org26
org41/repo61.git	Allow non-admin users to delete review requests (#29057)	2024-02-24 12:38:43 +00:00
org42/search-by-path.git	Updated tokenizer to better matching when search for code snippets (#32261)	2024-11-06 20:51:20 +00:00
privated_org
user2	Support repo license (#24872)	2024-10-01 15:25:08 -04:00
user5/repo4.git
user12/repo10.git
user13/repo11.git
user27
user30
user40/repo60.git	Allow non-admin users to delete review requests (#29057)	2024-02-24 12:38:43 +00:00