0b0be7c18c
fix: use the correct federated search URL in the client
2023-03-04 18:52:45 +05:30
649f319f9b
fix: ignore when the same hostname is introduced twice
2023-03-04 18:52:29 +05:30
d3b59c0072
feat: log federated seraches in leaky-bucket counter
2023-03-04 16:42:38 +05:30
5e18cad34c
feat: leaky-bucket algo implementing federated search counter
2023-03-04 16:42:23 +05:30
0576a54af7
feat: record starchart imports
2023-03-02 19:13:28 +05:30
3270ef89ee
feat: federated search
2023-03-02 18:51:06 +05:30
7f4e6d5bda
chore: lints
2023-03-02 18:09:44 +05:30
063627b1d8
feat: download mini index while bootstrapping introductions
2023-03-02 18:03:56 +05:30
540026c61e
chore: refactor to separate HTTP client ops
2023-03-02 17:59:15 +05:30
61a0a7bc11
feat: expose mini-index via REST API
2023-03-02 17:47:49 +05:30
30c245ea8f
feat: impl import for publiccodeyml
2023-03-02 17:39:14 +05:30
c5a36ca685
feat: import and search federating mini indices
2023-03-02 15:39:43 +05:30
a22defdab1
feat: index words on user and repo creation and rm from index when they
...
are deleted
2023-03-02 13:24:35 +05:30
f53a0afada
feat: implement mini-index
2023-03-02 13:09:48 +05:30
3f92a9ff33
feat: import forges from introduced nodes during bootstrap
2023-02-28 20:10:15 +05:30
8564f40478
feat: introduce self when bootstrapping
2023-02-28 17:30:25 +05:30
2c4344a23f
feat: introduce new starchart nodes to other starchart nodes
2023-02-28 17:23:25 +05:30
a155ab9d26
feat: bootstrap introductions from vals received in config
2023-02-28 17:04:32 +05:30
ac7c1e4066
feat: read bootstrap Starchart nodes from config
2023-02-28 16:38:43 +05:30
f42e06358e
feat: list introductions via REST API
2023-02-28 16:37:59 +05:30
28bef1623f
fix: ignore insert if a Starchart instance is already known
2023-02-28 16:37:22 +05:30
83175b333a
feat: paginated introduced starchart instances list with tests
2023-02-28 16:13:41 +05:30
9ff4788b69
feat & fix: insert fts_repositories when repo is not present and implement introducer
2023-02-28 16:02:36 +05:30
38fee3daf3
chore: replace CreateForge.import with starchart_url for marking forge
...
instances with Starchart instances
2023-02-28 15:59:50 +05:30
8cf21c3ce6
fix: include asterisk when it isn't present in query
2023-02-28 15:49:35 +05:30
3fb7b27ab3
feat: filter imported and native forges
2023-02-26 23:38:36 +05:30
3f29d420c3
feat: list forges REST API
2023-02-26 23:33:08 +05:30
5ed1ebacef
feat: implement repo API search in REST API
2023-02-26 23:16:25 +05:30
2755e346d7
feat: impl repo search with sqlite's FTS
2023-02-23 13:04:14 +05:30
0e040e4875
feat: search repositories
2023-02-23 13:03:58 +05:30
359c0133b8
feat: import index from federating node
2023-02-23 11:47:34 +05:30
7b3bc8161e
chore: mv routes to separate crate for reusability
2023-02-23 11:41:16 +05:30
d3fde704ff
fix: archive after each crawl
2023-02-22 18:10:34 +05:30
bc2e1870f5
feat: convert publiccodeyml::Repository to db::AddRepository
2023-02-22 18:10:14 +05:30
944cf7075c
fix: use constant value DNS challenge
2023-02-22 18:09:12 +05:30
f9da115100
feat: add lega/repoOwner and map to forge repository owner(namespace)
2023-02-22 14:56:36 +05:30
632479ff58
feat: add tags with optional intendedAudience/scope
2023-02-22 14:53:10 +05:30
e726f2234d
feat: use fixed value for an instance for DNS challenge
...
DESCRIPTION
Randomly generated values for forge ownership verification through
DNS TXT records was making development process complicated. Using
starchart instance's hostname for the TXT record's value is secure
enough for our use case.
This patch gets rid of all the code necessary to implement random
value challenges
2023-02-22 12:05:49 +05:30
38eb9c74ec
feat: get latest tarball from REST API
2023-02-11 19:42:48 +05:30
cb2dfa5e19
fix: gitea check is broken, disable check and return default true to
...
avoid breakage
2023-02-11 19:40:48 +05:30
f8d33e04e8
feat: mark entries as imported to differentiate b/w native crawls and
...
imported records
2023-02-11 19:40:04 +05:30
3f088a8cb8
fix: return string instead of pathbuf
2023-02-11 19:39:50 +05:30
df1edefb9d
feat: implement latest_tar for publiccodeyml
2023-01-08 00:32:15 +05:30
202600696a
feat: define latest_tar on federate trait
2023-01-08 00:31:58 +05:30
d8126a9268
hotfix: remove references to custom repository page and link directly to repository's page
2022-07-23 22:20:40 +05:30
3c6ccc278b
fix: adapt repository.hostname -> repository.url name change
2022-07-23 22:10:13 +05:30
0d1f42d5e4
feat: async crawl
2022-07-15 20:59:35 +05:30
993ba2fe25
feat: periodic deletion of old archives
2022-07-15 20:59:35 +05:30
31fd0f0c51
chore: clippy lints
2022-07-15 20:59:32 +05:30
9a3425eabe
fix & chore: handle hostname/URL cleaning within trait implementation
...
SUMMARY
Renamed function parameters from "hostname" to "url" wherever a
url::Url is received
db_core::get_hostname is renamed to db_core::clean_url, better
describing its new implementation
forge_core::get_hostname is renamed to forge_core::get_url to better
describe its new implementation
URL PROCESSING METHODS
federate/federate-core
Parses URL and returns only the hostname
db/db-core
Parses URL, cleans it by removing path and query parameters and
returns the end result
2022-07-15 20:58:40 +05:30
