Commit graph

52 commits

Author SHA1 Message Date
e726f2234d
feat: use fixed value for an instance for DNS challenge
DESCRIPTION
    Randomly generated values for forge ownership verification through
    DNS TXT records was making development process complicated. Using
    starchart instance's hostname for the TXT record's value is secure
    enough for our use case.

    This patch gets rid of all the code necessary to implement random
    value challenges
2023-02-22 12:05:49 +05:30
38eb9c74ec
feat: get latest tarball from REST API 2023-02-11 19:42:48 +05:30
0d1f42d5e4
feat: async crawl 2022-07-15 20:59:35 +05:30
31fd0f0c51
chore: clippy lints 2022-07-15 20:59:32 +05:30
fe8bd2fb26
fix & chore: handle hostname/URL cleaning within trait implementation
SUMMARY
    Renamed function parameters from "hostname" to "url" wherever a
    url::Url is received

    db_core::get_hostname is renamed to db_core::clean_url, better
    describing its new implementation

    forge_core::get_hostname is renamed to forge_core::get_url to better
    describe its new implementation

URL PROCESSING METHODS

    federate/federate-core
	Parses URL and returns only the hostname

    db/db-core
	Parses URL, cleans it by removing path and query parameters and
	returns the end result
2022-07-15 20:52:47 +05:30
Dat Adithya
eb97ded32c
Merge branch 'forgeflux-org:master' into master 2022-07-05 14:26:55 +05:30
dat-adi
a65115bfeb fix: Refactored grammatical errors 2022-07-05 14:05:57 +05:30
aba71115a7
fix: page counter increment 2022-06-09 15:03:14 +05:30
ef2707e4ee
feat: crawl generic over SCForge implementaiton and add forge type checks 2022-06-09 01:22:23 +05:30
1a3206b57a
chore: rm forge dead code 2022-06-04 21:33:13 +05:30
db1d7657a7
feat: create repo file if doesn't exist 2022-06-04 21:30:50 +05:30
54a1d28395
feat: impl archive user if not exists 2022-06-04 20:47:02 +05:30
399ef34f08
feat: migrate crawl accepts rate-limit configuratoin 2022-06-04 20:35:24 +05:30
7e0c235275
feat: archive forge data if it doesn't exist 2022-06-03 23:14:57 +05:30
036a90e74a
feat: add CC0(public domain) license to published data 2022-05-26 22:50:40 +05:30
8f51205d64
feat: dns TXT record-based configuration parser 2022-05-25 13:21:09 +05:30
c637be4499
fix: pagination link generator and related tests
SUMMARY
    When OptionalPage.page is None, the count was incremented twice
    leading to skipping next_page_link=2. Increment operation is now
    movied into `impl From<OptionalPage> for Page` for centralized
    incrementing, which also fixes this bug
2022-05-25 12:49:13 +05:30
428cb600a6 feat: homepage 2022-05-21 00:17:14 +05:30
083af27351 feat & fix: load verify routes and fix template loads 2022-05-19 19:32:10 +05:30
0fe3c8f619 feat: export tar ball at the end of an instance crawl 2022-05-19 19:31:41 +05:30
c7d7f9ec8a fix: redirect user to challenge instructions page after challenge addition 2022-05-19 19:31:17 +05:30
10d34ed240 feat: adopt changes to save hostname with challenge creation 2022-05-19 19:15:10 +05:30
0a4b5dd62c feat: setup file listing for download 2022-05-19 18:25:18 +05:30
593f3d5c17 feat: add logging to crawl method 2022-05-19 17:35:47 +05:30
0ca420d1ff feat: impl get and submit DNS challenge 2022-05-19 17:35:22 +05:30
a2582fdce8 feat: use constant format challenge TXT key 2022-05-19 16:24:18 +05:30
2d07f7f0ca feat: mod navbars and base templates, setup loading templates and fix
ctx loading
2022-05-19 15:45:44 +05:30
a8b58da3eb feat: bootstarp loading templates 2022-05-19 14:33:33 +05:30
6cd0313a01
feat: load templates 2022-05-18 20:28:26 +05:30
26a4d1f39f
feat: bootstrap error handling 2022-05-18 20:26:58 +05:30
d7c8d4a2f6
feat: embed static assets into bin 2022-05-18 20:26:17 +05:30
5add143318
feat: bootstrap actix-web 2022-05-18 17:39:53 +05:30
d0fd8166e3
feat: add federation file writes in crawl method 2022-05-17 20:12:30 +05:30
f03bd5aaae
feat: setup federation file writes 2022-05-17 20:12:14 +05:30
65eab4e488
chore: rename data::Data to ctx::Ctx 2022-05-17 19:57:57 +05:30
aefc691033
feat: migrate gitea interfaces to use forge/gitea interfaces 2022-05-17 01:04:44 +05:30
a146386e68
chore: update deps 2022-05-05 00:49:23 +05:30
59aafc037e
feat: save repositories and tags 2022-05-04 23:51:05 +05:30
3d98149244
feat: username save on spider::crawl 2022-04-30 23:51:38 +05:30
a57759ea80
feat: add owner field and implement Hash for all Gitea response types 2022-04-30 23:50:45 +05:30
c0303ba8c5
feat: create instance the first time it is encountered and load DB from
test env
2022-04-13 14:12:29 +05:30
efb5401691
feat: load and init db-sqlx-sqlite with testing environment setup 2022-04-13 12:20:26 +05:30
b39ce2098a
fix: loading sqlite database URL from env var
SUMMARY
    sqlite caused problems(panic) when trying to break its database URL
    when trying to break it down into host, protocol, path and port,
    etc. with crate::settings;:DatabaseBuilder. Bypassing
    DatabaseBuilder and directly setting crate::settings::Database.url,
    fixes this issue.
2022-04-12 17:17:24 +05:30
9d137f8dcf
feat: check if provided URL points to a Gitea instance 2022-04-06 10:10:38 +05:30
8a305d6db1
feat: crawl gitea and get all repository information 2022-04-06 10:09:49 +05:30
35aa155c0e
feat: initialize app data and apply clippy lints 2022-04-06 10:08:15 +05:30
307e9397fc
feat: configuration option for wait time before next API call 2022-04-06 10:05:34 +05:30
7852ae634d
feat: add crawler configuration options 2022-04-03 19:59:45 +05:30
e37f335652
feat: load settings from configuration file 2022-04-02 16:29:23 +05:30
efd4db8e1c
feat: Gitea search results datatypes 2022-04-02 16:18:51 +05:30