Utilities / File Location Listing


Web crawler that indexes URL metadata - filenames, locations, types etc - but does not the underlying content



Onion Details



Page Clicks: 0

First Seen: 03/12/2024

Last Indexed: 10/23/2024

Domain Index Total: 98



Onion Content



Utilities / File Location Listing: File Location Listing Projects Utilities / File Location Listing Commits Wiki Containers Web crawler that indexes URL metadata - filenames, locations, types etc - but does not the underlying content. Issues Key Title Status Created #1 Design Project Fixed/Done Task closed 28 Dec 23 #2 Create Crawler Fixed/Done New Feature closed 28 Dec 23 #3 Implement Search Fixed/Done New Feature closed 28 Dec 23 #4 Create Search Portal Fixed/Done New Feature closed 28 Dec 23 #5 Markdown Support Fixed/Done Improvement closed 28 Dec 23 #6 Regex based skip rules Fixed/Done New Feature closed 29 Dec 23 #7 Tidy up image preview modal Fixed/Done Improvement closed 29 Dec 23 #8 Add filesize to search portal results Fixed/Done Improvement closed 29 Dec 23 #9 Add Mime-Type indicator to search results Fixed/Done New Feature closed 29 Dec 23 #10 Meta Keywords Support Fixed/Done New Feature closed 29 Dec 23 #11 fu support in searches Fixed/Done New Feature closed 29 Dec 23 #12 Handling of searches with multiple words Fixed/Done Improvement Informational closed 29 Dec 23 #13 Build and Deploy into Kubernetes Fixed/Done Task closed 29 Dec 23 #14 Revalidation Support Fixed/Done New Feature closed 29 Dec 23 #15 Make index rebuilds atomic Fixed/Done Improvement closed 29 Dec 23 #16 Search Performance Fixed/Done Improvement closed 29 Dec 23 #17 Site specific path allowlist Fixed/Done New Feature closed 30 Dec 23 #18 Path Hints Config Fixed/Done New Feature closed 30 Dec 23 #19 Minimum Search Phrase Length Fixed/Done Improvement closed 30 Dec 23 #20 Limit number of results returned Fixed/Done Improvement closed 30 Dec 23 #21 Repeated reads of files Bug Fixed/Done closed 30 Dec 23 #22 To cache or not to cache? Improvement Won't Fix closed 30 Dec 23 #23 Caching Support Fixed/Done Improvement closed 30 Dec 23 #24 OR support Fixed/Done New Feature closed 30 Dec 23 #25 Prefix dork Fixed/Done New Feature closed 31 Dec 23 #26 Satistfy `domain` dork using index Fixed/Done Improvement closed 31 Dec 23 #27 NOT filters cause exception Bug Fixed/Done closed 01 Jan 24 #28 Invalid Last-Mod Date format Bug closed 01 Jan 24 #29 Refactor Javascript Task opened 01 Jan 24 #30 Apply least expensive search criteria first Fixed/Done Improvement closed 01 Jan 24 #31 Gzip the index Fixed/Done Improvement closed 01 Jan 24 #32 Searching with matchtype triggers exception Bug Fixed/Done closed 01 Jan 24 #33 Ignore specific keywords/tags when indexing Fixed/Done New Feature closed 06 Jan 24 #34 Tags are case-sensitive Bug Fixed/Done closed 06 Jan 24 #35 Drop default Search Portal count to 100 Fixed/Done Improvement closed 06 Jan 24 #36 Ability to set tag equivalence to create Implied Tags Fixed/Done New Feature closed 07 Jan 24 #37 Markdown Specific Indexing (was Markdown rendering) Fixed/Done Improvement closed 07 Jan 24 #38 Nest results within the API Response Format Fixed/Done Improvement closed 07 Jan 24 #39 Related Items don't render Bug Fixed/Done closed 07 Jan 24 #40 Stats endpoint Fixed/Done New Feature closed 09 Jan 24 #41 Result Count Mode Fixed/Done New Feature closed 10 Jan 24 #42 Add query time stats to stats endpoint Fixed/Done Improvement closed 13 Jan 24 #43 Index Handling Improvements Fixed/Done Improvement closed 21 Jan 24 #44 Potential Tombstone Race Bug Fixed/Done closed 21 Jan 24 #45 Domain Blocklist Fixed/Done New Feature closed 26 Jan 24 #46 Revalidation should take crawler version into account Fixed/Done New Feature closed 05 Feb 24 #47 Stats fetch requests should be able to trigger index reloads Fixed/Done Improvement closed 26 Feb 24 #48 Make Index Freshness Check period configurable Fixed/Done Improvement closed 26 Feb 24 #49 Deterministic Result ordering Fixed/Done New Feature closed 03 Mar 24 #50 Whitespace can break storage headers Bug Fixed/Done closed 03 Mar 24 #51 Search by new tag not working until portal restarted Bug Invalid closed 17 Apr 24 #52 Exception in new deployment Bug Fixed/Done closed 31 May 24 #53 Should images inherit tags? Improvement Won't Fix closed 31 May 24 #54 Time based dorks New Feature opened 02 Jun 24 #55 Allow published date to override last-mod for ordering purposes Improvement opened 02 Jun 24 #56 Count only mode throws AttributeError: 'int' object has no attribute 'get' Bug Fixed/Done closed 02 Jun 24 #57 Don't run as root Fixed/Done Improvement closed 03 Jun 24 #58 Meta keywords aren't correctly being extracted Bug Fixed/Done closed 03 Jun 24 #59 Docker container should run waitress Fixed/Done Improvement closed 04 Jun 24 #60 Experimental: indexing headings Fixed/Done New Feature Task closed 16 Jun 24 #61 URLs are not extracted from plaintext files Bug Fixed/Done closed 21 Jul 24 #62 File types aren't correctly recognised if the server includes a charset Bug Fixed/Done closed 21 Jul 24 #63 Index may include sites outside the allowed list opened 21 Jul 24 #64 Consume headings index when searching Improvement opened 21 Jul 24 #65 Add support for YAML frontmatter to markdown parsing Fixed/Done Improvement closed 22 Aug 24 #66 Exception when moving headings index Bug Fixed/Done closed 23 Aug 24 #67 Tidy up config Improvement opened 24 Aug 24 Project Labels Bug Fixed/Done Improvement Informational Invalid New Feature Task Won't Fix Releases Name Released v0.2.9 24 Aug 24 13:30 v0.2.8 21 Jul 24 14:23 v0.2.7.1 05 Jun 24 12:40 v0.2.7 03 Jun 24 22:47 v0.2.6 18 Mar 24 18:51 v0.2.5 13 Jan 24 11:41 v0.2.4 07 Jan 24 17:43 v0.2.3 07 Jan 24 17:01 v0.1 06 Jan 24 19:56 v0.2.1 06 Jan 24 19:56 v0.2.2 06 Jan 24 19:56 Milestones Title Status vnext active v0.2.9 closed v0.2.8 closed v0.2.7.1 closed v0.2.7 closed v0.2.6 closed v0.2.5 closed v0.2.4 closed v0.2.3 closed v0.2.2 closed v0.2.1 closed backlog active v0.1 closed proof-of-concept closed