I want to extract and process the metadata from PNG images and the first line of .safetensors files for LLM’s and LoRA’s. I could spend ages farting around with sed or awk but formats of files are constantly changing. I’d like a faster way to see a summary of training and a few other details when they are available.

  • palordrolap@kbin.run
    link
    fedilink
    arrow-up
    1
    ·
    7 months ago

    There are probably pre-written awk scripts out there that already do what you want, not that I know where they’d be.

    That said, you might be better off using one of the bigger but still fairly commonly installed languages. There’s bound to be things on PyPI (for Python) or CPAN (for Perl) that could be bolted together for example.

    If you’re really lucky there might even be something that covers your whole use-case, but I haven’t checked.