64daf6eb2f
chore: clippy
Lint / fmt (push) Has been cancelled
Lint / clippy (push) Has been cancelled
Coverage / stable - x86_64-unknown-linux-gnu (push) Has been cancelled
Build / stable - x86_64-unknown-linux-gnu (push) Has been cancelled
2023-03-26 11:43:21 +05:30
f622f47550
feat: use public_url in USER_AGENT
2023-03-26 11:42:18 +05:30
2890bf566c
fix: re-introduce to known starcharts
2023-03-25 22:47:28 +05:30
124d8d7b34
feat: improve spider event logging
2023-03-25 21:30:19 +05:30
1a121139e3
feat: sleep in between introductions
2023-03-25 21:29:56 +05:30
1ebb18b884
fix: don't kill introducer immediately; wait for server to exit
2023-03-25 21:29:23 +05:30
c1c55ec7f3
feat: launch from configuration via env vars only
2023-03-25 11:45:07 +05:30
fa31c4fac0
feat: introduce on loop in bg
2023-03-10 20:24:23 +05:30
d0bc6627f2
fix: explore page is now at root
2023-03-05 13:12:20 +05:30
6006d04b2f
fix: don't introduce self!
2023-03-04 18:59:20 +05:30
cd797fba83
feat: display search results
2023-03-04 18:59:10 +05:30
0b0be7c18c
fix: use the correct federated search URL in the client
2023-03-04 18:52:45 +05:30
d3b59c0072
feat: log federated seraches in leaky-bucket counter
2023-03-04 16:42:38 +05:30
5e18cad34c
feat: leaky-bucket algo implementing federated search counter
2023-03-04 16:42:23 +05:30
3270ef89ee
feat: federated search
2023-03-02 18:51:06 +05:30
7f4e6d5bda
chore: lints
2023-03-02 18:09:44 +05:30
063627b1d8
feat: download mini index while bootstrapping introductions
2023-03-02 18:03:56 +05:30
540026c61e
chore: refactor to separate HTTP client ops
2023-03-02 17:59:15 +05:30
61a0a7bc11
feat: expose mini-index via REST API
2023-03-02 17:47:49 +05:30
3f92a9ff33
feat: import forges from introduced nodes during bootstrap
2023-02-28 20:10:15 +05:30
8564f40478
feat: introduce self when bootstrapping
2023-02-28 17:30:25 +05:30
2c4344a23f
feat: introduce new starchart nodes to other starchart nodes
2023-02-28 17:23:25 +05:30
a155ab9d26
feat: bootstrap introductions from vals received in config
2023-02-28 17:04:32 +05:30
ac7c1e4066
feat: read bootstrap Starchart nodes from config
2023-02-28 16:38:43 +05:30
f42e06358e
feat: list introductions via REST API
2023-02-28 16:37:59 +05:30
38fee3daf3
chore: replace CreateForge.import with starchart_url for marking forge
...
instances with Starchart instances
2023-02-28 15:59:50 +05:30
8cf21c3ce6
fix: include asterisk when it isn't present in query
2023-02-28 15:49:35 +05:30
3fb7b27ab3
feat: filter imported and native forges
2023-02-26 23:38:36 +05:30
3f29d420c3
feat: list forges REST API
2023-02-26 23:33:08 +05:30
5ed1ebacef
feat: implement repo API search in REST API
2023-02-26 23:16:25 +05:30
7b3bc8161e
chore: mv routes to separate crate for reusability
2023-02-23 11:41:16 +05:30
d3fde704ff
fix: archive after each crawl
2023-02-22 18:10:34 +05:30
944cf7075c
fix: use constant value DNS challenge
2023-02-22 18:09:12 +05:30
e726f2234d
feat: use fixed value for an instance for DNS challenge
...
DESCRIPTION
Randomly generated values for forge ownership verification through
DNS TXT records was making development process complicated. Using
starchart instance's hostname for the TXT record's value is secure
enough for our use case.
This patch gets rid of all the code necessary to implement random
value challenges
2023-02-22 12:05:49 +05:30
38eb9c74ec
feat: get latest tarball from REST API
2023-02-11 19:42:48 +05:30
0d1f42d5e4
feat: async crawl
2022-07-15 20:59:35 +05:30
31fd0f0c51
chore: clippy lints
2022-07-15 20:59:32 +05:30
fe8bd2fb26
fix & chore: handle hostname/URL cleaning within trait implementation
...
SUMMARY
Renamed function parameters from "hostname" to "url" wherever a
url::Url is received
db_core::get_hostname is renamed to db_core::clean_url, better
describing its new implementation
forge_core::get_hostname is renamed to forge_core::get_url to better
describe its new implementation
URL PROCESSING METHODS
federate/federate-core
Parses URL and returns only the hostname
db/db-core
Parses URL, cleans it by removing path and query parameters and
returns the end result
2022-07-15 20:52:47 +05:30
Dat Adithya
eb97ded32c
Merge branch 'forgeflux-org:master' into master
2022-07-05 14:26:55 +05:30
dat-adi
a65115bfeb
fix: Refactored grammatical errors
2022-07-05 14:05:57 +05:30
aba71115a7
fix: page counter increment
2022-06-09 15:03:14 +05:30
ef2707e4ee
feat: crawl generic over SCForge implementaiton and add forge type checks
2022-06-09 01:22:23 +05:30
1a3206b57a
chore: rm forge dead code
2022-06-04 21:33:13 +05:30
db1d7657a7
feat: create repo file if doesn't exist
2022-06-04 21:30:50 +05:30
54a1d28395
feat: impl archive user if not exists
2022-06-04 20:47:02 +05:30
399ef34f08
feat: migrate crawl accepts rate-limit configuratoin
2022-06-04 20:35:24 +05:30
7e0c235275
feat: archive forge data if it doesn't exist
2022-06-03 23:14:57 +05:30
036a90e74a
feat: add CC0(public domain) license to published data
2022-05-26 22:50:40 +05:30
8f51205d64
feat: dns TXT record-based configuration parser
2022-05-25 13:21:09 +05:30
c637be4499
fix: pagination link generator and related tests
...
SUMMARY
When OptionalPage.page is None, the count was incremented twice
leading to skipping next_page_link=2. Increment operation is now
movied into `impl From<OptionalPage> for Page` for centralized
incrementing, which also fixes this bug
2022-05-25 12:49:13 +05:30
