Turun

joined 1 year ago
[–] [email protected] 1 points 5 months ago

Addendum:

The docs say

For reproducible outputs, set temperature to 0 and seed to a number:

But what they should say is

For reproducible outputs, set temperature to 0 or seed to a number:

Easy mistake to make

[–] [email protected] 1 points 5 months ago

I appreciate the constructive comment.

Unfortunately the API docs are incomplete (insert obi wan meme here). The seed value is both optional and irrelevant when setting the temperature to 0. I just tested it.

[–] [email protected] 1 points 5 months ago* (last edited 5 months ago) (3 children)

Yeah no, that's not how this works.

Where in the process does that seed play a role and what do you even mean with numerical noise?

Edit: I feel like I should add that I am very interested in learning more. If you can provide me with any sources to show that GPTs are inherently random I am happy to eat my own hat.

[–] [email protected] 2 points 5 months ago (1 children)

Ah, gotcha.

Is there like a list where you can enter your server so that other people use it as an ntp server? Or how did you advertise it to have 2800 requests flooding in?

[–] [email protected] 1 points 5 months ago* (last edited 5 months ago)

Crypto is basically cash for online transactions. Pretty niche, but cool and definitely in demand for some situations.

Just how in the real world you're shit outta luck if you lose your wallet. Or if you give someone money, but they laugh you in the face you can either cut your losses or try your luck in a fist fight. It's the same with crypto.

With banks you have a separate authority that can handle all these cases, which is desirable in 99% of all transactions.

Unfortunately it's volatile af, and the most popular crypto currency (Bitcoin)has untenable transaction costs and transaction limitations (10 transactions per second, globally - what a stupid design decision)

[–] [email protected] 2 points 5 months ago

I've used it to improve selected paragraphs of my writing, provide code snippets and find an old comic based on a crude description of a friend.

I feel like these interactions were valuable to me and only one (code snippets) could have been easily replaced with existing tools.

[–] [email protected] 1 points 5 months ago* (last edited 5 months ago)

I have similar specs and cost with ionos

[–] [email protected] 3 points 5 months ago

It says posted 4 days ago, updated yesterday.

For most stuff the pi4 is also enough. Jellyfin (no transcoding) works fine on mine. It takes a bit to generate the chapter images and the timeline peek images when ingesting a new movie, but I've never had any issues with playback.

[–] [email protected] 2 points 5 months ago (3 children)

Wait what? Do I understand that correctly? You have a raspberry pi with a direct network connection to an atomic clock? That's so awesome!

[–] [email protected] 4 points 5 months ago (5 children)

Yes it is intentional.

Some interferences even expose a way to set the "temperature" - higher values of that mean more randomized (feels creative) output, lower values mean less randomness. A temperature of 0 will make the model deterministic.

[–] [email protected] 0 points 5 months ago

It does not perform very well when asked to answer a stack overflow question. However, people ask questions differently in chat than on stack overflow. Continuing the conversation yields much better results than zero shot.

Also I have found ChatGPT 4 to be much much better than ChatGPT 3.5. To the point that I basically never use 3.5 any more.

[–] [email protected] 1 points 5 months ago

No, it's simply contradicting the claim that it is possible.

We literally don't know how to fix it. We can put on bandaids, like training on "better" data and fine-tune it to say "I don't know" half the time. But the fundamental problem is simply not solved yet.

view more: ‹ prev next ›