• 9 Posts
  • 73 Comments
Joined 1 year ago
cake
Cake day: June 15th, 2023

help-circle
  • Endless Sky. The save game is a text file. Save a file on the mobile app (F-Droid), and on the PC (Flatpak), and note the last line. This is the line you must swap to transfer the save file. It is the first game I have played on both practically. The game mechanics are different between the two and you need to alter your strategy accordingly. On mobile, I travel with a ship setup for boarding pirate vessels and never target enemies directly; all of my guns are automatic turrets. I just use a fast ship and travel with a large group of fighters. It is more of a grind on mobile, but it can be used to build up resources and reserves. The game is much bigger than it first appears to be. You need to either check out a guide or explore very deep into the obscure pockets of the map.




  • Oobabooga is the main GUI used to interact with models.

    https://github.com/oobabooga/text-generation-webui

    FYI, you need to find checkpoint models. In the available chat models space, naming can be ambiguous for a few reasons I’m not going to ramble about here. The main source of models is Hugging Face. Start with this model (or get the censored version):

    https://huggingface.co/TheBloke/llama2_7b_chat_uncensored-GGML

    First, let’s break down the title.

    • This is a model based in Meta’s Llama2.
    • This is not “FOSS” in the GPL/MIT type of context. This model has a license that is quite broad in scope with the key point stipulating it can not be used commercially for apps that have more than 700 million users.
    • Next, it was quantized by a popular user going by “The Bloke.” I have no idea who this is IRL but I imagine this is a pseudonym or corporate alias given how much content is uploaded by this account on HF.
    • This model is based on a 7 Billion parameter dataset, and is fine tuned for chat applications.
    • This is uncensored meaning it will respond to most inputs as best it can. It can get NSFW, or talk about almost anything. In practice there are still some minor biases that are likely just over arching morality inherent to the datasets used, or it might be coded somewhere obscure.
    • Last part of the title is that this is a GGML model. This means it can run on CPU or GPU or a split between the two.

    As for options on the landing page or “model card”

    • you need to get one of the older style models that have “q(numb)” as the quantization type. Do not get the ones that say “qK” as these won’t work with the llama.cpp file you will get with Oobabooga.
    • look at the guide at the bottom of the model card where it tells you how much ram you need for each quantization type. If you have a Nvidia GPU with the CUDA API, enabling GPU layers makes the model run faster, and with quite a bit less system memory from what is stated on the model card.

    The 7B models are about like having a conversation with your average teenager. Asking technical questions yielded around 50% accuracy in my experience. A 13B model got around 80% accuracy. The 30B WizardLM is around 90-95%. I’m still working on trying to get a 70B running on my computer. A lot of the larger models require compiling tools from source. They won’t work directly with Oobabooga.


  • WizardLM 30B at 4 bits with the GGML version on Oobabooga runs almost as fast as Llama2 7B on just the GPU. I set it up with 10 threads on the CPU and ~20 layers on the GPU. That leaves plenty of room for a 4096 context with a batch size of 2048. I can even run a 2GB Stable Diffusion model at the same time with my 3080’s 16GBV.

    Have you tried any of the larger models? I just ordered 64GB of ram. I also got kobold mostly working. I hope to use it to try Falcon 40. I really want to try a 70B model at 2-4 bit and see how its accuracy is.



  • Cookies are not needed. They are shifting the security onto the user. Secure the information on the server just like any other business. Offloading onto the client is wrong. It leads to ambiguity and abuses. Visiting a store and a business on the internet are no different. My presence gives no right to my person, searches, or tracking in the location or outside of it. Intentions are worthless. The only thing that matters is what is possible and practiced. Every loophole is exploited and should be mitigated. The data storage and coding practices must change.


  • Nah, it should be the default state of affairs. Data mining is stalking and theft. It centers around very poor logic and decisions.

    Things like browser cookies are criminal garbage. Storing anything on a user’s computer is stalking. Draw the parallel here; if you want to shop in any local store, I want you to first tell me everything you are wearing and carrying in a way that I can tell every possible detail about it, tell where you came from before you visited this store, where you are going next. They also want to know everything you looked at, how you react to changes in items presented to you and changes in prices. They want enough information to connect you across stores based on your mode of transportation, and have enough data to connect your habits over the last two decades.

    Your digital existence should not be subject to slavery either. Ownership over ourselves is a vital aspect of freedom. Privacy is about ownership and dominion. If you dislike all the digital rights management and subscription services nonsense, these exist now as a direct result of people neglecting ownership. In the big picture, this path leads all of humanity back into another age of feudalism. The only difference between a serf and a citizen is ownership over property and tools. Everything happening right now is a battle over a new age of slavery. “You will own nothing and you will be happy about it.” Eventually this turns into 'Your grandchildren will own nothing and say nothing or they will be dead about it." What you do about your privacy now will be a very big deal from the perspective of future generations.


  • Hey there Lionir. Thanks for the post. Can the Beehaw team please look into copying or getting the creator of this bot to work here? https://lemmy.world/u/[email protected]

    I think the person that created that bot is somehow connected to the piped.video project. I know the whole privacy consciousness thing isn’t for everyone, but this bot’s posts are quite popular elsewhere on Lemmy.

    FYI, the main reason to use piped.video links is that it is setup as an alternative front end for YT that automatically routes all users through a bunch of VPNs to help mitigate Alphabet’s privacy abuses and manipulation.



  • Not exactly. Stupid people with advanced tools make stupid outputs. Venture capital is pushing the propaganda sauce hard and a lot of stupid people are jumping on AI as a corporate trend. These are the idiots.

    The tools are next level. We are on the edge of this tech becoming a really big deal. There are several research papers making breakthroughs regularly and making double digit percentile improvements on efficiency and accuracy. The reason it is a big deal is because you can have around 1/4 of the knowledge of the entire internet running on hardware as powerful as a current flagship phone. Sure it lies around 1/2 the time, but these are problems that are being solved. Like, the latest and greatest models are ancient history in a matter of 2-3 weeks. To be honest, have a casual conversation with an offline and uncensored LLM. You may know it is lying from time to time, but if you’re being objective, so are most humans you encounter under casual circumstances. The sociological function and potential value of this tech is pretty powerful medicine. Like if you need someone to talk to, or to talk out an issue in private, this is a way to make that happen.













  • I was a buyer for a chain of high end bike shops for many years. Amazon really only sells junk products. Any real quality brands of niche products can’t support amazon and the typical brick and mortar business inventory structure. Like, I spent between $100k-$500k in preseason bike brand commitments for 3 stores. If any of those brands decided to allow sales on Amazon I would drop them immediately. Multiply this by every bike shop that exists. This is more than Amazon could compete with by a long shot. The issue is that every Buyer in a shop knows what they are able to sell effectively and buys accordingly. I tailored my orders for every shop independently. It would be impossible for Amazon to predict and fund high end bikes at this scale.

    “So what,” you say, “it’s just bikes.” No it is not. The bike brands are usually part of a group of brands that include several parts, clothing, and accessory products. These are part of preseason commitments with the bike brands too. So all of these are not sold on Amazon either. This is the case with most things, the best or even decent stuff is not sold on Amazon.

    The worst thing with amazon is that they aggregate all identical products in their warehouses. This makes it trivial for a seller to insert fake goods into a product pool and it is completely untraceable back to them.