e726f2234d
feat: use fixed value for an instance for DNS challenge
...
DESCRIPTION
Randomly generated values for forge ownership verification through
DNS TXT records was making development process complicated. Using
starchart instance's hostname for the TXT record's value is secure
enough for our use case.
This patch gets rid of all the code necessary to implement random
value challenges
2023-02-22 12:05:49 +05:30
38eb9c74ec
feat: get latest tarball from REST API
2023-02-11 19:42:48 +05:30
0d1f42d5e4
feat: async crawl
2022-07-15 20:59:35 +05:30
31fd0f0c51
chore: clippy lints
2022-07-15 20:59:32 +05:30
fe8bd2fb26
fix & chore: handle hostname/URL cleaning within trait implementation
...
SUMMARY
Renamed function parameters from "hostname" to "url" wherever a
url::Url is received
db_core::get_hostname is renamed to db_core::clean_url, better
describing its new implementation
forge_core::get_hostname is renamed to forge_core::get_url to better
describe its new implementation
URL PROCESSING METHODS
federate/federate-core
Parses URL and returns only the hostname
db/db-core
Parses URL, cleans it by removing path and query parameters and
returns the end result
2022-07-15 20:52:47 +05:30
Dat Adithya
eb97ded32c
Merge branch 'forgeflux-org:master' into master
2022-07-05 14:26:55 +05:30
dat-adi
a65115bfeb
fix: Refactored grammatical errors
2022-07-05 14:05:57 +05:30
aba71115a7
fix: page counter increment
2022-06-09 15:03:14 +05:30
ef2707e4ee
feat: crawl generic over SCForge implementaiton and add forge type checks
2022-06-09 01:22:23 +05:30
1a3206b57a
chore: rm forge dead code
2022-06-04 21:33:13 +05:30
db1d7657a7
feat: create repo file if doesn't exist
2022-06-04 21:30:50 +05:30
54a1d28395
feat: impl archive user if not exists
2022-06-04 20:47:02 +05:30
399ef34f08
feat: migrate crawl accepts rate-limit configuratoin
2022-06-04 20:35:24 +05:30
7e0c235275
feat: archive forge data if it doesn't exist
2022-06-03 23:14:57 +05:30
036a90e74a
feat: add CC0(public domain) license to published data
2022-05-26 22:50:40 +05:30
8f51205d64
feat: dns TXT record-based configuration parser
2022-05-25 13:21:09 +05:30
c637be4499
fix: pagination link generator and related tests
...
SUMMARY
When OptionalPage.page is None, the count was incremented twice
leading to skipping next_page_link=2. Increment operation is now
movied into `impl From<OptionalPage> for Page` for centralized
incrementing, which also fixes this bug
2022-05-25 12:49:13 +05:30
428cb600a6
feat: homepage
2022-05-21 00:17:14 +05:30
083af27351
feat & fix: load verify routes and fix template loads
2022-05-19 19:32:10 +05:30
0fe3c8f619
feat: export tar ball at the end of an instance crawl
2022-05-19 19:31:41 +05:30
c7d7f9ec8a
fix: redirect user to challenge instructions page after challenge addition
2022-05-19 19:31:17 +05:30
10d34ed240
feat: adopt changes to save hostname with challenge creation
2022-05-19 19:15:10 +05:30
0a4b5dd62c
feat: setup file listing for download
2022-05-19 18:25:18 +05:30
593f3d5c17
feat: add logging to crawl method
2022-05-19 17:35:47 +05:30
0ca420d1ff
feat: impl get and submit DNS challenge
2022-05-19 17:35:22 +05:30
a2582fdce8
feat: use constant format challenge TXT key
2022-05-19 16:24:18 +05:30
2d07f7f0ca
feat: mod navbars and base templates, setup loading templates and fix
...
ctx loading
2022-05-19 15:45:44 +05:30
a8b58da3eb
feat: bootstarp loading templates
2022-05-19 14:33:33 +05:30
6cd0313a01
feat: load templates
2022-05-18 20:28:26 +05:30
26a4d1f39f
feat: bootstrap error handling
2022-05-18 20:26:58 +05:30
d7c8d4a2f6
feat: embed static assets into bin
2022-05-18 20:26:17 +05:30
5add143318
feat: bootstrap actix-web
2022-05-18 17:39:53 +05:30
d0fd8166e3
feat: add federation file writes in crawl method
2022-05-17 20:12:30 +05:30
f03bd5aaae
feat: setup federation file writes
2022-05-17 20:12:14 +05:30
65eab4e488
chore: rename data::Data to ctx::Ctx
2022-05-17 19:57:57 +05:30
aefc691033
feat: migrate gitea interfaces to use forge/gitea interfaces
2022-05-17 01:04:44 +05:30
a146386e68
chore: update deps
2022-05-05 00:49:23 +05:30
59aafc037e
feat: save repositories and tags
2022-05-04 23:51:05 +05:30
3d98149244
feat: username save on spider::crawl
2022-04-30 23:51:38 +05:30
a57759ea80
feat: add owner field and implement Hash for all Gitea response types
2022-04-30 23:50:45 +05:30
c0303ba8c5
feat: create instance the first time it is encountered and load DB from
...
test env
2022-04-13 14:12:29 +05:30
efb5401691
feat: load and init db-sqlx-sqlite with testing environment setup
2022-04-13 12:20:26 +05:30
b39ce2098a
fix: loading sqlite database URL from env var
...
SUMMARY
sqlite caused problems(panic) when trying to break its database URL
when trying to break it down into host, protocol, path and port,
etc. with crate::settings;:DatabaseBuilder. Bypassing
DatabaseBuilder and directly setting crate::settings::Database.url,
fixes this issue.
2022-04-12 17:17:24 +05:30
9d137f8dcf
feat: check if provided URL points to a Gitea instance
2022-04-06 10:10:38 +05:30
8a305d6db1
feat: crawl gitea and get all repository information
2022-04-06 10:09:49 +05:30
35aa155c0e
feat: initialize app data and apply clippy lints
2022-04-06 10:08:15 +05:30
307e9397fc
feat: configuration option for wait time before next API call
2022-04-06 10:05:34 +05:30
7852ae634d
feat: add crawler configuration options
2022-04-03 19:59:45 +05:30
e37f335652
feat: load settings from configuration file
2022-04-02 16:29:23 +05:30
efd4db8e1c
feat: Gitea search results datatypes
2022-04-02 16:18:51 +05:30