/t/ - Technology

Discussion of Technology

Index Catalog Archive Bottom Refresh
Options
Subject
Message

Max message length: 12000

files

Max file size: 32.00 MB

Total max file size: 50.00 MB

Max files: 5

Supported file types: GIF, JPG, PNG, WebM, OGG, and more

E-mail
Password

(used to delete files and posts)

Misc

Remember to follow the Rules

The backup domains are located at 8chan.se and 8chan.cc. TOR access can be found here, or you can access the TOR portal from the clearnet at Redchannit 3.0.

RIP David Lynch

8chan.moe is a hobby project with no affiliation whatsoever to the administration of any other "8chan" site, past or present.

You may also be interested in: AI

(4.11 KB 300x100 simplebanner.png)

Hydrus Network General #10 Anonymous Board volunteer 07/24/2024 (Wed) 20:55:28 No. 15721
This is a thread for releases, bug reports, and other discussion for the hydrus network software. The hydrus network client is an application written for Anon and other internet-fluent media nerds who have large image/swf/webm collections. It browses with tags instead of folders, a little like a booru on your desktop. Users can choose to download and share tags through a Public Tag Repository that now has more than 2 billion tag mappings, and advanced users may set up their own repositories just for themselves and friends. Everything is free and privacy is the first concern. Releases are available for Windows, Linux, and macOS, and it is now easy to run the program straight from source. I am the hydrus developer. I am continually working on the software and try to put out a new release every Wednesday by 8pm EST. Past hydrus imageboard discussion, and these generals as they hit the post limit, are being archived at >>>/hydrus/ . Hydrus is a powerful and complicated program, and it is not for everyone. If you would like to learn more, please check out the extensive help and getting started guide here: https://hydrusnetwork.github.io/hydrus/ Previous thread >>>/hydrus/21127
Edited last time by hydrus_dev on 08/27/2024 (Tue) 02:53:42.
>>16977 Yeah, in terms of imageboards, outside of a once-in-a-blue-moon post (e.g. asking a site admin in some /meta/ board about a CDN issue), I don't post as hydev or talk about Hydrus anywhere else.
when I double-click on the thumbnail of a collection, I get this error v604, linux, source AttributeError 'ThumbnailMediaCollection' object has no attribute 'GetMediaResult' Traceback (most recent call last): File "/home/user/hydrus/hydrus git/hydrus/client/gui/QtPorting.py", line 2078, in eventFilter event_killed = event_killed or self._ExecuteCallbacks( 'EVT_LEFT_DCLICK', event ) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/user/hydrus/hydrus git/hydrus/client/gui/QtPorting.py", line 2051, in _ExecuteCallbacks if not callback( event ): event_killed = True ^^^^^^^^^^^^^^^^^ File "/home/user/hydrus/hydrus git/hydrus/client/gui/pages/ClientGUIMediaResultsPanelThumbnails.py", line 917, in EventMouseFullScreen self._LaunchMediaViewer( t ) File "/home/user/hydrus/hydrus git/hydrus/client/gui/pages/ClientGUIMediaResultsPanel.py", line 832, in _LaunchMediaViewer first_media_result = first_media.GetMediaResult() ^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'ThumbnailMediaCollection' object has no attribute 'GetMediaResult' entering with the enter key still works though
>>16976 > >>>16971 > Do you mean the file dialog that boots when you click Lain (the anime girl in 'import downloaders')? I will make sure it filters to .png (or, I think, .json) files. It didn't show .json when the filter showed .json. I think it also happened to .png.
>>16980 and I think it showed subdirectories, so it's not a permissions issue.
>>16979 Thank you for the report, and sorry for the trouble. I put out a hotfix, so please get the v604a and you should be good. Links here >>16931 are all updated to the new build. >>16980 >>16981 Ah, now I do not understand. You do not see any files at all? I see pic related--the filter is "All Files (*)" and I see all my normal files, any type. I thought you were asking for me to change the filter to just show pngs and json, but if you see nothing at all, we have an actual bug. Can you talk about the problem a bit more? Here are some questions: - Where is the dialog--is it the anime girl dialog under network->downloaders->import downloaders, or are you talking about network->downloader components->manage parsers/url classes, or somewhere else? - Do any file dialogs work correctly for you, or are they all not showing anything but subdirectories? - What happens if you select file->options->gui->ANTI-CRASH BUGFIX: Use Qt file/directory selection dialogs, rather than OS native?
>>16967 >>>16960 >That is the error state that I blocked in v604. The new mpv dll we were testing would do this on a handful of apngs and webms. Are you getting it on many files? That would suggest your computer is getting overloaded by mpv rendering. Are you using the extract zip or installer I put out in my release posts, or running from source? If you are using my extract, you are on the (safe) older dll, which suggests your machine was getting CPU saturated when playing mpv before, probably some crazy error logs happening silently in the background. If you are running from source, I recommend you roll back to the 2023-08 dll as here: https://sourceforge.net/projects/mpv-player-windows/files/libmpv/mpv-dev-x86_64-20230820-git-19384e0.7z >You might like to try this out: >- boot the client fresh >- turn on ''help->debug->report modes->mpv report mode >- load a video you know will fail >A big dump of load info and probably error spam will dump to your log. I'd be interested in seeing if you can pastebin it, but you'll want to give the content a once-over to make sure there's nothing too private in there. Not the anon you were replying to but get this same error on an angimated gif. mpv debug log: https://pastebin.com/2X8ARF2w
>>16983 This is with the mpv.dll shipping with v604a.
>>16982 >- Where is the dialog--is it the anime girl dialog under network->downloaders->import downloaders, or are you talking about network->downloader components->manage parsers/url classes, or somewhere else?OS native? network->downloader components->manage ...->import >- Do any file dialogs work correctly for you, or are they all not showing anything but subdirectories? The one with Lain works, it shows All files. >- What happens if you select file->options->gui->ANTI-CRASH BUGFIX: Use Qt file/directory selection dialogs, rather than Doesn't help. It's on Linux, so I don't think there is any non-Qt "native" dialog for Hydrus.
I had a great week working on small fixes and lots of code cleanup. There's also a user contribution that shows file ratings on thumbnails! The release should be as normal tomorrow. >>16985 Thanks I think I have it fixed for tomorrow--let me know how you get on!
>>16986 >There's also a user contribution that shows file ratings on thumbnails! Hell yeah! I've had this in the back of my mind for a while, actually. Speaking of user contributions and small features. Could I beg priority for a small little QoL feature or at least get you to chuck it into the next "small thing roundup"? It's not original to me since it comes up from time to but since I'm using danbooru more these days so it's definitely on my mind lately. Basically just an options menu to let you configure how namespaces are ordered in the tag menu. Having to rewire my pattern recognition between hydrus' pure alphabetical and the booru's artist->copyright->etc. order is a consistent trip when I use one or the other for long periods. How exactly it should look you have a few options but I'd think under "sort by tag"s umbrella as "a-z, z-a, custom1, custom2, user" makes the most sense but I don't have a super strong preference. Other than the fact it, in theory, doesn't change much about the program other than ergonomics and is probably an unsexy problem to solve it can't be that hard to implement, right? So if not I'd love to see it as a little thing in the near future. If you do add it as a feature I'll go through and make the presets to match all the boorus and post them so you can include those in the update after.
for the past few weeks I've been having a lot of problems with mpv in Hydrus. there's been this weird bug where near the end of a file playing, if I try to pause or move to another file, it'll stay on that file and the audio of the file will keep playing for a second or 2 while the visuals are paused, and then it only moves to the other file once the video ends. It started a few weeks ago. I Don't remember which version exactly. There's also an issue where videos will randomly crash and stop working in Hydrus and Hydrus's log will give a "too many events queued" error. this also never happened before, but keeps happening now. I'm running on Linux from source and it says I have mpv api version 2.2
>>15935 so, there was a parser for reddit that let you download the galleries, i'm not 100% sure when it broke, I noticed it about 2 days ago, looking through files, its probably been broken for close to 2 weeks, a lot of the subs I have in subs dont post galleries so I didn't catch it sooner. im wondering if anyone has an updated parser for it
small ui suggestion: when you press ctrl+T to open a new tab, it brings up this videogame-like "quick select" menu with an option for left, up and ,down. the "special" option has a sub menu of "duplicates processing" and "page of pages". since they're 2 options and there's room for one more option on the parent menu, I think the "special" option should be removed and the 2 options under it should just be brought up to the first level. so the top-level quick select menu would look something like: file search download duplicates processing page of pages (not sure if that'll render right)
>>16990 yeah that didn't render right at all. I hope you get what I was trying to show though
https://www.youtube.com/watch?v=6INL_pxX8L4 windows zip: https://github.com/hydrusnetwork/hydrus/releases/download/v605/Hydrus.Network.605.-.Windows.-.Extract.only.zip exe: https://github.com/hydrusnetwork/hydrus/releases/download/v605/Hydrus.Network.605.-.Windows.-.Installer.exe macOS app: https://github.com/hydrusnetwork/hydrus/releases/download/v605/Hydrus.Network.605.-.macOS.-.App.dmg linux tar.zst: https://github.com/hydrusnetwork/hydrus/releases/download/v605/Hydrus.Network.605.-.Linux.-.Executable.tar.zst I had a great week working on a bunch of small issues and cleanup. There's also a user contribution that adds ratings to thumbnails! Full changelog: https://hydrusnetwork.github.io/hydrus/changelog.html highlights First, if you would like to try showing ratings on your thumbnails, each rating service panel in services->manage services now has a couple new checkboxes to show the ratings, either only when the file has a rating, or all the time. Unfortunately, the ratings can sometimes get washed out by the text banner or thumbnail image behind them, and while I tried to fix it with a very very subtle backing shadow, I think it needs a bit more work to look 'nice' (the whole ratings system does). Let me know what you think! I gave the advanced deletion dialog's 'deletion reason' list a full pass (the code behind the scenes was super ugly), and it is now more stable and highlights and sets 'existing deletion reason' and, optionally, 'last used reason' much more reliably. If you use e621 a lot, there's a new non-default downloader that grabs the (new?) 'contributor' namespace, which tracks VAs and modellers different to the primary artist. There's also an update to the e621 style, thanks to a user. Check the changelog for more details. In the duplicates filter, the two files are renamed from 'A' and 'B' to 'File One' and 'File Two'. It is a silly change, but I'm firming up some nomenclature behind the scenes as I work on duplicates auto-resolution. The filter's hover window now also shows the score difference between the two files as a number--let's see if it is useful. I fixed a ton of jank layout this week. Many panels will now expand more sensibly or are simply laid out cleaner. I'm may have typo'd something or didn't realise some knock-on effect somewhere that I didn't test, so if you see any text in an out-of-the-way dialog suddenly out of alignment somewhere, let me know! next week I finished another duplicates auto-resolution tab this week. I've now got two difficult things and a bunch of tying-together to do and we'll be ready for an IRL test. I'm feeling great about it and I want to keep pushing. Otherwise more small work and cleanup like this.
Great work on Hydrus! Started using it 3 months ago for managing/viewing image collections and love it so far. One unusual question (or bug?) though: I recently updated from version 592 to 604a and noticed that, when selecting a single image, the GUI bar on the bottom-left corner of a page no longer lists the image's width and height. For example, right now (in version 605) it might say something like "256 images - 1 jpeg selected, archived, totaling 573 KB" whereas in the past it also included "726 x 1017". Was this a deliberate change (that I couldn't find in any changelogs)? Or is there an option I missed that could make it display again?
>>16993 Yeah, sorry, I changed it just recently. In the v605 I just put out, I reworked the options to make it more obvious how to set it how you want. Edit what the 'media viewer top hover text' says under options->media viewer and add it back for the status bar in single-thumbnail-selection under options->thumbnails.
>>16994 Perfect, thank you for the quick reply!
>>16987 > Could I beg priority for a small little QoL feature or at least get you to chuck it into the next "small thing roundup"? It's not original to me since it comes up from time to but since I'm using danbooru more these days so it's definitely on my mind lately. Basically just an options menu to let you configure how namespaces are ordered in the tag menu. Was asked and answered here: >>16811 Hydev will try to eventually add this feature. Being able to have presets is a cool idea though.
Why did my 603 suddenly start showing "just woke up from sleep" or saying the computer did?
Images that I save manually, I convert to webp or avif. This way they are much smaller in size before importing into hydrus network. But images downloaded from imagebur directly, immediately go into the database if you use the program as a grabber. Is there any way to optimize them after downloading? Sorry for the mistakes, English is not my native language and thank you for developing such a wonderful program!
>>16998 not at the moment, but this is a commonly requested feature. Hydev said once before that he does want to eventually™ implement a feature like this specifically for JXL images, but other than that... probably not
>>16998 also important warning. avif is not actually a lossless format. it's a near lossless format. I had the unpleasant surprise of discovering that myself after converting a few hundred images. Webp afaik does have a truly lossless mode though.
>>16998 >Is there any way to optimize them after downloading? There is not at the moment, but Hydev said he wants to implement it someday. This is essentially a big thing that stops me from going all in with Hydrus. I'm still trying to think about a good workflow, how to get smaller files without losing all tags. Example: Often boorus let you download either a small 'sample_' file, which can have bad quality or the original, which then sometimes is a PNG with 15MB or something like that. For my use 1-3MB per 4k and lower is plenty. If i would convert the files outside of Hydrus (after for example export the original 15MB files to folder), the hash changes and i would have to duplicate process everything to copy over the tags from the big files that were recognized within the PTR. That's why i have to probably wait until a good conversion tech is implemented. I think it would be useful or essential to link the hashes of the new converted files to the old ones (and maybe let us see/copy the old hashes too), so that if you import the original 15MB file again, it would say "already in db (converted/converted to [...]) and also make it possible to refetch the tags from the original file url to the new converted one. Someone found a good workflow for that problem? >>16999 Saw your comment being posted while i wrote mine lol
(35.83 KB 864x788 cute click.jpg)

>>16998 >apologises for mistakes >made no mistakes at all My little ESLchan can NOT be this cute...
>>17006 >apologises Apologizes* :^)
>>17008 Now, now, colonial. That anon specifically said they were not native fluency in English, of which they made no mistakes. YOU, on the other hand... c|:^)
>>17009 Goddamn limeys.
>>16955 >person pretty sure thats already an agreed upon standard >event worthless, belongs un-namespaced >group make favourite searches my personal shitty namespace no one else uses is outfit. "outfit:maid" clarifies that the wearer may not really be a maid. "outfit:kemomimi" vs "kemomimi" clarifies the difference between a catgirl and a girl wearing a cat ear head piece. can be used for cosplay via "outfit: [character name]", can contain descriptors such as "outfit: dirty" or "outfit: ripped" imho to avoid being clutter a namespace should 1. apply to a large percentage of your library 2. hold semantic value over just leaving the tag bare & 3. be something youd ever search for. 1 can be optional if its significant enough as a category (like contributor honestly) but 2 and 3 are mandatory.
>>16959 oh disregard, i didnt realize you meant drawn for an event and not a depiction of an event with your christmas example
>>17012 >my personal shitty namespace no one else uses is outfit. "outfit:maid" clarifies that the wearer may not really be a maid. "outfit:kemomimi" vs "kemomimi" clarifies the difference between a catgirl and a girl wearing a cat ear head piece. can be used for cosplay via "outfit: [character name]", can contain descriptors such as "outfit: dirty" or "outfit: ripped" I just use a clothes: namespace to cover all that and whatever else they're wearing that interests me.
>>17013 >pretty sure thats already an agreed upon standard Well I lumped booru categories in with namespaces because I consider them analogous de facto in that they serve the same purpose and de jure given that importers treat them as such. So yeah, on the PTR? Yeah. I don't know any boorus using it however. character:person is usually used which I think is bad practice due to searchability reasons. Though hydrus norms being more advanced than booru norms is a fairly noncontrovertial assertion around here. :^) >oh disregard, i didnt realize you meant drawn for an event and not a depiction of an event with your christmas example Well, like I said any good namespace should have several usecases rolled up into it in my opinion. If it were just christmas and new years etc. I'd actually agree with your initial point (for reasons that will soon become logically apparent). But since there are so many things it CAN be used on, that are pointedly different and purposeful... that if you're going to implement it for specific events (pixivsnow, cirno day, comiket2019, girls fronline 2 art contest FA 2024, etc.) you might as well extend the umbrella to its fullest while you're implementing it and move christmas from series: to a much more logical place now that it exists in this framework. But I believe you understand that having read the reply now, yeah. >>17012 >my personal shitty namespace no one else uses is outfit. "outfit:maid" clarifies that the wearer may not really be a maid. See our thinking merges and clashes here. We agree there is a line past which bluetags exist for a reason but disagree on what is useful to know at a glance by colour. Generic costumes are an ideal blue tag merely for searching, character costumes go in the character space. We already know Hong Meiling isn't a maid inherently if we know who she is, if she's dressed up like one she's merely in an [alternate costume], [maid_uniform] as opposed to a [maid] proper. Anybody who didn't already know this could glean it from how we tagged it this way. Hairstyles, costumes, jewelry, these are descriptive and per hydev "tags are for searching not describing", to the extent you want to search these differences out to post them I understand (I have an inordinate amount of images of hong meiling being dressed up like a maid by/for/like sakuya myself, as well as images of sakuya with really long hair) but I don't see an argument to be a namespace with its own colour and subsequent popout effect. I will add a second aphorism purely of my own "namespaces are for user recognition not categorising", that is we make the spaces to block off relevant info either for human readable tag context or for the human user to pick between search results quickly via colour. >pic related The namespacing specifically lets what I'm looking for be searched with fewer typed characters then a click of colour recognition. So the rubric (to me) for if something belongs namespaced or not is "for the bulk of people/the maintainer is it useful to know with a single glance a unique category of image when browsing or searching?". Even if we "extend the umbrella" and include character outfits from gacha games or arc clothing changes for anime/manga that do that a la one piece (Nico Robins Thriller Bark look is still my favourite for the record) how often does somebody searching need a clear colour barrier to differentiate that when searching? Or needs that to pop out when looking at tags? In my example "scarlet" I have so many results it's very very nice to have a clear colour barrier. So, relevant to that, would you ever need to see a hypthetical [costume:Pure White That Will Be Stained Scarlet] (remilia's oath skin in touhou lost word) from the other [character:remilia scarlet], [group:scarlet devil mansion], [creator:chiren_scarlet], [event:remilia scarlet's trick or bullet] and all the [title:something something scarlet] in a search or tag summary quickly? Your points are good but apply to tags broadly, not namespaces specifically. Which, to me, exist for readability. To go after the underpinnings of the namespace itself does [outfit:Pure White That Will Be Stained Scarlet] make any sense outside of the context of [character:remilia scarlet] such that [character:Remilia Scarlet (Pure White That Will Be Stained Scarlet)] doesn't work better? If an arc costume change why not [character:Nico Robin (Thriller Bark)]? If a generic outfit, why can't a costume be a mere blue search term? [nurse_uniform], [alternate_costume] covers this entirely. Is there a case where it being a new colour in hydrus or colour/category on a booru would be useful to your immediate recognition of [outfit:Dirty Clothes] from say [series:Dirty Pair] and [character:Dirty Harry] upon typing "dirty"? These aren't retorical or argumentative questions, mind you. You seem to use this system so I'd be interested to hear your opinion given my expounded logical framework and reasoning. I told you I fucking LOVE me some tagtism.
>>17015 >character costumes go in the character space. Not that anon.I put them in the clothes: namespace and add the relevant character as a parent tag, along with clothes:alternate_character for any character that's dressed up as another non-generic character, which itself is a child tag of clothes:alternate_outfit. Now I know some characters dressed as others may be themselves generic, so alternate_outfit doesn't really apply to them as they have no default, but I encounter this little enough for it not to be much of a problem to me. I've also always had an issue with images where characters are referenced but not present, and I still can't think of an elegant way to represent that, as I find it unideal to search a tag and get results that do not actually contain the characters searched, but also unideal to not include clear references to, and discussion of, that character. The latter is again so rare though, that I can generally ignore the logical problem.
>>17016 > I've also always had an issue with images where characters are referenced but not present, and I still can't think of an elegant way to represent that, as I find it unideal to search a tag and get results that do not actually contain the characters searched, but also unideal to not include clear references to, and discussion of, that character. MMMMMMMMMMMmmmmmmmmmmmm..... This is a very very good point actually, yes. What DOES one do? I have a system but no pretentions that it is an objectively best practice. >[series:Girls' Frontline], [character:Colphne] [character:9A-91] [character cosplaying character] Given that it is so very rare I just eat the weirdness you pointed out that I acknowledge is a part of it and when I do search the character and they aren't there but are being cosplayed I just see it in the thumbnail. I've never had an "elon musk: I'm a cat girl! *posts kagerou imaizumi*" moment but I could see how it would be embarassing lol. So for that I COULD see how A coloured namespace could be a warning you're about to drag over an image that isn't actually character X at all even if overall I don't find clothing:/outfit:/hairstyle: to warrant itself as one. It doesn't come up often but it IS tricky, isn't it? Every immediate solution has something funky about it. Maybe a [meta:character not present]? That yellow IS very vivid... What even are the alternatives? [character:Character(Other Character)] the same way you might do >[character:Belfast(Azur Lane)], [character:Belfast(Shopping with the Head Maid)] but >[character:Colphne], [character:Colphne(9A-91)], [alternate costume], [character cosplaying character] for an image where it's her and her in an alternate costume? Maybe... The problem there is you'll basically never reuse these tags(much), searching them is funkier and there would be no good sibling for them since they're basically ad hoc and setting up parents would be a bit tedious for something you'll use one to three times. But since it's rare enough, is that even a problem? I'unno.
>>17016 >I've also always had an issue with images where characters are referenced but not present, and I still can't think of an elegant way to represent that, as I find it unideal to search a tag and get results that do not actually contain the characters searched, but also unideal to not include clear references to, and discussion of, that character. Another anon here. Personally, I don't think this is an issue at all. I think if the character is referenced or implied to be present it's fine to tag it, because they're on-topic for what you're searching. Take "tag what you see" too literally and you end up making it hard to find pictures that are tangentially related to the topic you're interested in. These pictures that you might have been interested in may end up never appearing in your searches if you're too strict with your tagging. And that's a bad thing because tags aren't just for searching for a particular image, they're also for browsing. If you're searching for one image in particular, including just one or two more tags will quickly remove the chaff and narrow down the search, so there's no problem there. But when you're browsing for images of a character just to see what you have, why wouldn't you want to see all the pictures that are about them?
>>17018 Another thought that I wanted to add on to this. The images you have in hydrus are presumably ones you've already curated and decided were worth downloading. You aren't going to see images that you don't like in hydrus, because you would delete them or just not download them in the first place. So there's no need to be hemming and hawing about whether a specific tag really truly should go on this image or not - you like this image, so the you in the future who's searching for this tag probably wouldn't mind seeing it again. I guess this doesn't apply if you're committing to the PTR, though.


Forms
Delete
Report
Quick Reply