> I went out to enjoy the Half Moon Bay 4th of July parade, occasionally checking in and prompting the next step for Fable from my phone.
This intensification of work will not be good for workers’ health. Like, put your phone down man. You can’t be modeling this behavior to young people.
Further, the intensification of work is probably not even good for productivity in the long term. This periodic half-thinking about things without stepping away from the problems you are working to solve will lead to more half-assed solutions. Ideas need room to breathe and dedicated focus.
I've been reading articles that are telling me how they're prompting from their phone at 2am(and how they know that's not great) and when they're out driving their kids to their activities etc. They say all that as if it's something to be proud of. And what for? Oh they released all these packages that no one is going to use.
Burnout is real and these people have lost track of what's important.
For my personal efforts yes I very much want on demand access, I want the thoughts to flow. It doesn't feel like that would be anything but great at my job too, if my job didn't define such narrow bounds of mandatory butts in chairs. What work says it wants is not effective, is not going to get my best work, is not going to really make sense. It didn't make sense before & it's absurdly out of pace with the Happy Warrior mode of software development today.
Idk about you but this type of intensification of my work has been extremely good for my mental health, on all points:
1. I feel genuinely more productive, spending a lot less time on boilerplate and much more of my genuine time is spent thinking and communicating the thinking process.
2. I can take a ton of breaks, basically whenever I want. "Flow" is now entirely design flow and can be interrupted much more easily without damaging it.
3. If there is anything I actively dislike in my workflow or that makes me not enjoy my time... I can fix my workflow so that either I'm not the one doing it, or the item in question is no longer necessary.
AI is crazy. I get it, if you're at a shitty job that doesn't understand how to adapt well, it's tough... but if you're working on your own (like Simon does on this project), it's absolutely amazing and you're in full control of your life.
The problem I have with this workflow is that the models are still too eager to please. If I ask it to scan a release and note possible issues, it absolutely will find issues. If I keep running the same prompt, it will keep finding issues. I’ve spammed GitHub PR reviews and it just keep finding (or inventing?) new issues. There is never a “Nothing found, good to go!”. I have to keep reminding myself that the model will always give me what I ask for, regardless of the reality/truth.
You didn’t do it enough. They stop finding bugs eventually. Also, different models can find different bugs (though they do find the same ones, too, which is good and expected). For best results you want to run multi model reviews in loops.
If you had multiple people look at your PRs multiple times on different days results would be very similar.
It'll find a non-existent bug - fix it - figure out it broke a previously working thing - try to fix again - etc..
The "keep improving" the code base prompt have been tried and it never works. The LLM has no consciousness of where to stop and where to draw the lines of reasonableness.
No, depending on the complexity of the issue models can be into loops, where they go "this is definitely an issue and must be fixed", and then the resulting fixed code gets "this is definitely an issue and must be fixed", and then the resulting fixed code has the original 'issue'.
For a normal review loops you can ask the model to return with nothing found if nothing is found and not invent things and it will do a better job of exiting without anything found.
I get this sometimes when I ask the agent on GitHub to suggestion improvements to my Julia code. It's kind of fun to watch it struggle to please. I'm reminded of the old "Doctor" mode in Emacs.
I’ve found that Claude is really good at picking up tone of voice in prompts / queries.
If I go “find issues in this code” it will hallucinate some, but if I say “can you check the recent change, there might be some things that introduced regressions, maybe?” Then it will be more cautious.
Also especially fable but opus too can talk back and advise you against going into a direction it thinks unwise.
And I’ve had much more success in clearing out why I think that is a better approach or asking it to clarify itself, as if if I tell it my assumption, sometimes it self corrects and starts doing what I needed in the first place, it was just coming at it from a different direction before. For example assuming I don’t care about cost and providing “the best solution” or trying to make something reusable where what I needed something quick (or vice versa)
It really is best to think of it as a gradient plane where it might get stuck in local minima, or you can prime it to “teeter on the edge” and able to flow into different directions.
> There is never a “Nothing found, good to go!”. I have to keep reminding myself that the model will always give me what I ask for, regardless of the reality/truth.
Tell it something like:
Before doing any commits or producing a summary for the user, you must run a verification sub-agent.
Its goal is to adversarially and critically check your supposed findings to look out for false positives and hallucinations.
Doing so with a separate sub-agent with relatively clean context (but with all the relevant details of the problem space that appear to be facts) should improve our confidence in the findings.
Maybe also something like:
Try to classify each found issue as either SERIOUS, CRITICAL or NITPICK, discard nitpicks, we only care about impactful issues.
It should somewhat cut down on the useless output.
I've largely found the same in regards to generating code - the initial pass will often have bugs that the model itself can find but only when run as a separate sub-agent without the confidence poisoning in its own previous output.
Like when you do recursive programming, have you tried providing more/better stop conditions? If you literally just say "Continue until there are no more issues" then it'll do just that, but if you scope it better, like "Only mention issues related to X, Y or that leads to Z" and so on, you'll get less noise and more focus on issues that actually matter (to you).
also helps adding negative conditions like "do not nitpick", or specific bad attractors that you see "do not investigate/report anything related to symlinks, they are not a concern"
You need to create review skill and there define what "issue" or "good" are for you to limit sensitiviness. Otherwise you depend on model's random threshold or non of such then you get perfection chasing.
Anyway it will never match your judgemend completely unless you upload your brain dump into model.
Definitely not. I've never seen a human trapped in that kind of infinite loop. Humans know that if they don't stop at the end of the day, they don't get to go home to their wife, and if they don't finalize their list of issues, they never get their contract paid out.
Pay people per hour of work and even if there is no actual work, people will definitively find a way of spending hours doing things. If you've worked with contractors/outsourced roles before this will happen from time to time.
There is a point of diminishing returns though; the issues suggested will get speculative, or point out comment unclarity, or "defense in depth". But I agree it’s somewhat annoying to rarely get clear pushback in terms of "no, this looks good enough to me, release it"
I use Claude Code and one of the steps in my workflow is do a review loop until no issues are found and it never loops. So my experience is entirely different. Even if I say: fix all issues. So not only the critical issues.
I think this was true with older models, but at least with GPT 5.5 it can genuinely tell you "no issues found" after a few passes of finding real issues.
If I keep running the same prompt, it will keep finding issues.
I've had the same experience, but whenever I've reviewed what it finds it's basically right. It's pedantic, and a lot of the problems aren't things I really care about, but they definitely are real problems.
I'm not sure you can blame the AI for always finding problems if a) you asked it to, and b) there are problems to find.
Great to see such write ups in particular with money.
At least 2 things the random LinkedIn post will ignore, on purpose or not :
- price today remains low (even though they might feel higher than before), Uber is the business model, no secret there, it's a VC classic
- $150 spent by an expert, a software engineer with significant practical knowledge in AI, is not equivalent to the exact same amount spent by a novice.
Yet now that a number is out, you bet it will be used. Expect alarmist posts tomorrow morning in your feed claiming building software is now as cheap as diner at the restaurant.
Expert software engineers will still accidentally burn $500 or $5000 on tasks that don't work, or are not efficient. Amateurs will accidentally spend $100 to get something great.
So part of the change is a change in the risk structure of using frontier models. Before, you'd burn your quota; now, you can burn uncapped (less-capped) money.
I'm kind of surprised that there is no test case that would have identified the fact that delete_where() leaves the state corrupted. There would be no need to ask Fable if the problem gets identified by the test. And having a test will also catch all future problems that might arise in the same function. So maybe instead of asking Claude what is wrong it would be wiser to invest in test coverage.
I also stopped reading the article there. This is major version 4 of a library about providing higher level db actions, i.e. transactions are paramount to make them atomic
I'm a big fan of sqlite-utils, but I really don't like how Python (particularly 3.12+) changes how sqlite's transactions work -- the native behavior explained in the sqlite docs is much better IMO. I understand why Python had to change it (to be compatible with other databases) but I don't think it's a good model for sqlite.
Therefore, I created apsw-utils, a port of sqlite-utils to the amazingly-awesome apsw lib -- which is a really idiomatic sqlite lib for python. It's here: https://answerdotai.github.io/apswutils/
I've used it in lots of projects including in significant production stuff, and it's always worked great for me. IMO if you're serious about doing sqlite in python, at some point you'll probably want to check out apsw.
They're probably talking about the addition of the autocommit flag, which hides more fine-grained transaction control in favor of more uniform behavior across multiple databases:
> False: Select PEP 249-compliant transaction behaviour, implying that sqlite3 ensures a transaction is always open.
This means you don't get to control the isolation level of the transaction, because [1]:
> sqlite3 uses BEGIN DEFERRED statements when opening transactions.
If you want to use `IMMEDIATE` or `EXCLUSIVE` isolation level[2] for your sqlite transaction using the new flag, you have to set `autocommit=True` to be able to open the transaction yourself with `.execute("BEGIN IMMEDIATE")`.
However, with `autocommit=True`, the connection's `.commit()` and `.rollback()` methods will *silently do nothing* and you have to execute the respective raw SQL yourself to commit or abort your manually-opened transaction. This also concerns the context-manager behavior of the connection object, which will not commit or abort manual transactions on context exit in this case.
So, the autocommit flag becomes a little complicated and foot-gunny if you want more precise control over when exactly other readers or writers should get blocked by sqlite.
The link had some of the details, but not the intelligent thought linking them into a narrative, much appreciated! This is something super important I would have been foot-gunned on at some point.
SQLite behavior is here: https://sqlite.org/lang_transaction.html . The regular implicit transactions there plus explicit where needed aren’t supported in any python mode.
> The regular implicit transactions there plus explicit where needed aren’t supported in any python mode
Specific examples would be extremely useful. You've done some work learning and deducing this stuff, others could learn if you would share and explain it.
Why not ask claude (or a cheaper model) to actually use this and report any unexpected outcomes? I mean, at least a few times, but better would be to do it a lot and have automated result tracking.
The title cost is only if this was raw API usage, but it was included in a subscription, so it's a small subset of the $200 plan:
> I upgraded to the Claude Max $200/month plan (I was previously on $100/month) to increase my Fable allowance for the remaining time until the July 7th Fablepocalypse, when even Claude Max subscribers will have to pay full API cost for the model.
I really wonder if Anthropic will stick with their decision to keep Fable on extra usage credits until they "get more compute", especially in the light of GPT 5.6 very likely coming out next week (it's confirmed to have the exact same pricing as GPT 5.5)
> especially in the light of GPT 5.6 very likely coming out next week
Finally have an explanation why GPT 5.5 xhigh felt dumber and dumber these last few weeks, always the same thing when a new model release is about to come out...
I have never noticed a degradation in either Claude or OpenAI models, and the benchmarks people set up have never shown a statistically significant deviation either: https://marginlab.ai/trackers/claude-code
Yet the same claim is being posted every single day, including new claims that the Fable 5 model has degraded compared to the initial release, guardrails aside.
Almost slipping into conspiracy territory, but without insights into what the labs actually do internally, hard not to:
Anyways, heard about A/B testing before? ML people tend to like it a lot, hard to imagine neither OpenAI or Anthropic are already deep into categorizing people into buckets and running an wild amount of A/B testing all over the place, especially in the weeks leading up to new model releases, in various ways.
Yes, and we can see A/B testing on the ChatGPT website all the time.
They are also testing the new models in their coding tools with select customers first.
People working at OpenAI have publicly denied that they are performing any kind of hidden routing or quantization of models after release for Codex. I tend to believe them.
Had this been a corporate environment the net saving by using one person partly and an agent as opposed to one person full time for the time it would take to implement this, would be a net saving enough to cover utilities, water and food for an entire village.
It’s silly to act like this was an added cost in a vacuum, or that any costs translate directly into charity for arbitrary families. Also in some place it would even cover rent for half a day.
Glad to see others dual wielding: “I used to think that the idea of having one model review the work of another was somewhat absurd—it felt weirdly superstitious. The problem is it really does work”
Fun fact: because AI written works don't have copyright (in the EU at least) and the level of prompting many people engage in doesn't suffice to create a copyrightable "work" and software licenses require you to actually be able to grant a license using rights you hold on a work, not only are many AI generated "works" not actually protected by copyright but by selling licenses you're actually in breach of contract law and may end up owing the licensee software you don't have.
> I went out to enjoy the Half Moon Bay 4th of July parade, occasionally checking in and prompting the next step for Fable from my phone.
This intensification of work will not be good for workers’ health. Like, put your phone down man. You can’t be modeling this behavior to young people.
Further, the intensification of work is probably not even good for productivity in the long term. This periodic half-thinking about things without stepping away from the problems you are working to solve will lead to more half-assed solutions. Ideas need room to breathe and dedicated focus.
I've been reading articles that are telling me how they're prompting from their phone at 2am(and how they know that's not great) and when they're out driving their kids to their activities etc. They say all that as if it's something to be proud of. And what for? Oh they released all these packages that no one is going to use.
Burnout is real and these people have lost track of what's important.
I worked for a startup in Canada, with Dutch founders, and operations in France and California.
That meme about how different countries treat out-of-office is very accurate.
Ideally it means a massive relaxation of the 9-5.
For my personal efforts yes I very much want on demand access, I want the thoughts to flow. It doesn't feel like that would be anything but great at my job too, if my job didn't define such narrow bounds of mandatory butts in chairs. What work says it wants is not effective, is not going to get my best work, is not going to really make sense. It didn't make sense before & it's absurdly out of pace with the Happy Warrior mode of software development today.
[dead]
Idk about you but this type of intensification of my work has been extremely good for my mental health, on all points:
1. I feel genuinely more productive, spending a lot less time on boilerplate and much more of my genuine time is spent thinking and communicating the thinking process.
2. I can take a ton of breaks, basically whenever I want. "Flow" is now entirely design flow and can be interrupted much more easily without damaging it.
3. If there is anything I actively dislike in my workflow or that makes me not enjoy my time... I can fix my workflow so that either I'm not the one doing it, or the item in question is no longer necessary.
AI is crazy. I get it, if you're at a shitty job that doesn't understand how to adapt well, it's tough... but if you're working on your own (like Simon does on this project), it's absolutely amazing and you're in full control of your life.
To late
You either do it, or you are out
The problem I have with this workflow is that the models are still too eager to please. If I ask it to scan a release and note possible issues, it absolutely will find issues. If I keep running the same prompt, it will keep finding issues. I’ve spammed GitHub PR reviews and it just keep finding (or inventing?) new issues. There is never a “Nothing found, good to go!”. I have to keep reminding myself that the model will always give me what I ask for, regardless of the reality/truth.
You didn’t do it enough. They stop finding bugs eventually. Also, different models can find different bugs (though they do find the same ones, too, which is good and expected). For best results you want to run multi model reviews in loops.
If you had multiple people look at your PRs multiple times on different days results would be very similar.
I've had it find bug, I asked it to make test to trigger the bug, and then it figured out it's not a bug. It will absolutely do wish fulfilment
Yeah when these models find a bug i like to ask it to write a test that will fail if the bug is real and pass when the bug is solved.
It’s not perfect but usually it works pretty well, and I’ve had the model come back to me with oh actually the test passed, the bug doesn’t work exist
As a bonus, you’ve now got a test that can detect that bug if it comes up again.
It'll find a non-existent bug - fix it - figure out it broke a previously working thing - try to fix again - etc..
The "keep improving" the code base prompt have been tried and it never works. The LLM has no consciousness of where to stop and where to draw the lines of reasonableness.
No, depending on the complexity of the issue models can be into loops, where they go "this is definitely an issue and must be fixed", and then the resulting fixed code gets "this is definitely an issue and must be fixed", and then the resulting fixed code has the original 'issue'.
That's a different kind of loop.
For a normal review loops you can ask the model to return with nothing found if nothing is found and not invent things and it will do a better job of exiting without anything found.
I've ran into this in the before times with linters and static analyzers. Nothing new.
yeah, happened to me: "A is very wrong, you should do B", and on the next fresh review loop "B is very wrong, you should do A"
typically this means there is some ambiguity in the specification, and the model flips between alternative interpretations
I get this sometimes when I ask the agent on GitHub to suggestion improvements to my Julia code. It's kind of fun to watch it struggle to please. I'm reminded of the old "Doctor" mode in Emacs.
I’ve found that Claude is really good at picking up tone of voice in prompts / queries.
If I go “find issues in this code” it will hallucinate some, but if I say “can you check the recent change, there might be some things that introduced regressions, maybe?” Then it will be more cautious.
Also especially fable but opus too can talk back and advise you against going into a direction it thinks unwise.
And I’ve had much more success in clearing out why I think that is a better approach or asking it to clarify itself, as if if I tell it my assumption, sometimes it self corrects and starts doing what I needed in the first place, it was just coming at it from a different direction before. For example assuming I don’t care about cost and providing “the best solution” or trying to make something reusable where what I needed something quick (or vice versa)
It really is best to think of it as a gradient plane where it might get stuck in local minima, or you can prime it to “teeter on the edge” and able to flow into different directions.
> There is never a “Nothing found, good to go!”. I have to keep reminding myself that the model will always give me what I ask for, regardless of the reality/truth.
Tell it something like:
Maybe also something like: It should somewhat cut down on the useless output.I've largely found the same in regards to generating code - the initial pass will often have bugs that the model itself can find but only when run as a separate sub-agent without the confidence poisoning in its own previous output.
A second look is always useful when using these damn things.
> There is never a “Nothing found, good to go!”.
Like when you do recursive programming, have you tried providing more/better stop conditions? If you literally just say "Continue until there are no more issues" then it'll do just that, but if you scope it better, like "Only mention issues related to X, Y or that leads to Z" and so on, you'll get less noise and more focus on issues that actually matter (to you).
also helps adding negative conditions like "do not nitpick", or specific bad attractors that you see "do not investigate/report anything related to symlinks, they are not a concern"
You need to create review skill and there define what "issue" or "good" are for you to limit sensitiviness. Otherwise you depend on model's random threshold or non of such then you get perfection chasing.
Anyway it will never match your judgemend completely unless you upload your brain dump into model.
> There is never a “Nothing found, good to go!”
Not entirely true IME. Eventually the bug hunt will end with general design advices that may not be suitable to your use case and that you can skip.
You get the same result if you pay humans a good sum of money to find issues.
Definitely not. I've never seen a human trapped in that kind of infinite loop. Humans know that if they don't stop at the end of the day, they don't get to go home to their wife, and if they don't finalize their list of issues, they never get their contract paid out.
Pay people per hour of work and even if there is no actual work, people will definitively find a way of spending hours doing things. If you've worked with contractors/outsourced roles before this will happen from time to time.
There is a point of diminishing returns though; the issues suggested will get speculative, or point out comment unclarity, or "defense in depth". But I agree it’s somewhat annoying to rarely get clear pushback in terms of "no, this looks good enough to me, release it"
I use Claude Code and one of the steps in my workflow is do a review loop until no issues are found and it never loops. So my experience is entirely different. Even if I say: fix all issues. So not only the critical issues.
I think this was true with older models, but at least with GPT 5.5 it can genuinely tell you "no issues found" after a few passes of finding real issues.
You could ask the model to say "nothing found" if the improvement was stylistic, or other constraints.
You need to run them in review loops, this is the only way to reduce or eliminate these issues.
If I keep running the same prompt, it will keep finding issues.
I've had the same experience, but whenever I've reviewed what it finds it's basically right. It's pedantic, and a lot of the problems aren't things I really care about, but they definitely are real problems.
I'm not sure you can blame the AI for always finding problems if a) you asked it to, and b) there are problems to find.
That's just plain wrong. The new models do not hallucinate as much as they used to (in my personal experience)
> plain wrong > (in my experience) What are you even saying.
That their vibes are more real than your vibes
What do you mean? Are they valid flaws or not?
Would you like it to stop when there's still flaws in the code?
It's not eagerness to please (that's anthropomorphising), rather it's a desire to bill you more money/use more tokens
(The fixed prices are just temporary discounts)
[dead]
Great to see such write ups in particular with money.
At least 2 things the random LinkedIn post will ignore, on purpose or not :
- price today remains low (even though they might feel higher than before), Uber is the business model, no secret there, it's a VC classic
- $150 spent by an expert, a software engineer with significant practical knowledge in AI, is not equivalent to the exact same amount spent by a novice.
Yet now that a number is out, you bet it will be used. Expect alarmist posts tomorrow morning in your feed claiming building software is now as cheap as diner at the restaurant.
It's also about variance in the number.
Expert software engineers will still accidentally burn $500 or $5000 on tasks that don't work, or are not efficient. Amateurs will accidentally spend $100 to get something great.
So part of the change is a change in the risk structure of using frontier models. Before, you'd burn your quota; now, you can burn uncapped (less-capped) money.
[dead]
I'm kind of surprised that there is no test case that would have identified the fact that delete_where() leaves the state corrupted. There would be no need to ask Fable if the problem gets identified by the test. And having a test will also catch all future problems that might arise in the same function. So maybe instead of asking Claude what is wrong it would be wiser to invest in test coverage.
I also stopped reading the article there. This is major version 4 of a library about providing higher level db actions, i.e. transactions are paramount to make them atomic
I'm a big fan of sqlite-utils, but I really don't like how Python (particularly 3.12+) changes how sqlite's transactions work -- the native behavior explained in the sqlite docs is much better IMO. I understand why Python had to change it (to be compatible with other databases) but I don't think it's a good model for sqlite.
Therefore, I created apsw-utils, a port of sqlite-utils to the amazingly-awesome apsw lib -- which is a really idiomatic sqlite lib for python. It's here: https://answerdotai.github.io/apswutils/
I've used it in lots of projects including in significant production stuff, and it's always worked great for me. IMO if you're serious about doing sqlite in python, at some point you'll probably want to check out apsw.
> changes how sqlite's transactions work
What specifically are you referring to? The apswutils website also does not explain.
They're probably talking about the addition of the autocommit flag, which hides more fine-grained transaction control in favor of more uniform behavior across multiple databases:
https://docs.python.org/3/library/sqlite3.html#sqlite3.Conne...
You can still use previous behavior with "legacy" mode that lets you control when transactions are opened in which isolation level.
> hides more fine-grained transaction control
In what way does having autocommit=False hide more fine-grained transaction control?
autocommit=False gives full control to the programmer to do whatever they want.
From the link in my previous post[0]:
> False: Select PEP 249-compliant transaction behaviour, implying that sqlite3 ensures a transaction is always open.
This means you don't get to control the isolation level of the transaction, because [1]:
> sqlite3 uses BEGIN DEFERRED statements when opening transactions.
If you want to use `IMMEDIATE` or `EXCLUSIVE` isolation level[2] for your sqlite transaction using the new flag, you have to set `autocommit=True` to be able to open the transaction yourself with `.execute("BEGIN IMMEDIATE")`.
However, with `autocommit=True`, the connection's `.commit()` and `.rollback()` methods will *silently do nothing* and you have to execute the respective raw SQL yourself to commit or abort your manually-opened transaction. This also concerns the context-manager behavior of the connection object, which will not commit or abort manual transactions on context exit in this case.
So, the autocommit flag becomes a little complicated and foot-gunny if you want more precise control over when exactly other readers or writers should get blocked by sqlite.
[0] https://docs.python.org/3/library/sqlite3.html#sqlite3.Conne...
[1] https://docs.python.org/3/library/sqlite3.html#sqlite3-trans...
[2] https://sqlite.org/lang_transaction.html#deferred_immediate_...
Thank you!
The link had some of the details, but not the intelligent thought linking them into a narrative, much appreciated! This is something super important I would have been foot-gunned on at some point.
Pythons options are here: https://docs.python.org/3/library/sqlite3.html
SQLite behavior is here: https://sqlite.org/lang_transaction.html . The regular implicit transactions there plus explicit where needed aren’t supported in any python mode.
> The regular implicit transactions there plus explicit where needed aren’t supported in any python mode
Specific examples would be extremely useful. You've done some work learning and deducing this stuff, others could learn if you would share and explain it.
Why not ask claude (or a cheaper model) to actually use this and report any unexpected outcomes? I mean, at least a few times, but better would be to do it a lot and have automated result tracking.
The title cost is only if this was raw API usage, but it was included in a subscription, so it's a small subset of the $200 plan:
> I upgraded to the Claude Max $200/month plan (I was previously on $100/month) to increase my Fable allowance for the remaining time until the July 7th Fablepocalypse, when even Claude Max subscribers will have to pay full API cost for the model.
I really wonder if Anthropic will stick with their decision to keep Fable on extra usage credits until they "get more compute", especially in the light of GPT 5.6 very likely coming out next week (it's confirmed to have the exact same pricing as GPT 5.5)
> especially in the light of GPT 5.6 very likely coming out next week
Finally have an explanation why GPT 5.5 xhigh felt dumber and dumber these last few weeks, always the same thing when a new model release is about to come out...
Opus has been extremely stupid recently, reckon that's because Fable needs to look appealing?
I have never noticed a degradation in either Claude or OpenAI models, and the benchmarks people set up have never shown a statistically significant deviation either: https://marginlab.ai/trackers/claude-code
Yet the same claim is being posted every single day, including new claims that the Fable 5 model has degraded compared to the initial release, guardrails aside.
Almost slipping into conspiracy territory, but without insights into what the labs actually do internally, hard not to:
Anyways, heard about A/B testing before? ML people tend to like it a lot, hard to imagine neither OpenAI or Anthropic are already deep into categorizing people into buckets and running an wild amount of A/B testing all over the place, especially in the weeks leading up to new model releases, in various ways.
Yes, and we can see A/B testing on the ChatGPT website all the time.
They are also testing the new models in their coding tools with select customers first.
People working at OpenAI have publicly denied that they are performing any kind of hidden routing or quantization of models after release for Codex. I tend to believe them.
[dead]
This is to prevent Chinese labs distilling Claude again right? And free advertising again?
just a note. in most parts of the world 149.25 USD can cover utilities, water, and food for a month for 1 adult person or even a family.
Had this been a corporate environment the net saving by using one person partly and an agent as opposed to one person full time for the time it would take to implement this, would be a net saving enough to cover utilities, water and food for an entire village.
It’s silly to act like this was an added cost in a vacuum, or that any costs translate directly into charity for arbitrary families. Also in some place it would even cover rent for half a day.
just hire someone in Bangladesh or some remote Philipines/Indonesia/Vietnam or even eastern EU.
no need for charities or any sort. plenty of people in Software and plenty of people laid off every day.
In Sydney Australia its < 2 days of median rent.
severely overpriced.
That's my electricity bill for a year, okay
I meant in total. food + electricity/water + housing = 150USD / month.
yep. same. my electircity is ~100 USD / year.
That's my electricity bill for a month
do you have like 10 AC or something? or are you in Germany?
In others it's pizza night for family or half a bill for sushi dinner, so what?
severely overpriced. that's what.
it's not overpriced but high-priced looking from other countries and mostly not a markup, normal considering median wages.
[dead]
Glad to see others dual wielding: “I used to think that the idea of having one model review the work of another was somewhat absurd—it felt weirdly superstitious. The problem is it really does work”
Did you check the cost calculation? I wouldn’t trust it to give the correct amount if i put the amount in the prompt
Brutal bugs for a release candidate.
Skynet wants to make us poorer.
[dead]
[flagged]
Fun fact: because AI written works don't have copyright (in the EU at least) and the level of prompting many people engage in doesn't suffice to create a copyrightable "work" and software licenses require you to actually be able to grant a license using rights you hold on a work, not only are many AI generated "works" not actually protected by copyright but by selling licenses you're actually in breach of contract law and may end up owing the licensee software you don't have.
And nothing happened and zero people got in trouble over it.
- Narrator
...So far
IMO the real "fun fact" is that supposed "IP monopolists" like Microsoft and Oracle's lawyers are apparently totally fine with this stuff.
So obviously people are going to take their lead and not get legal advice from some greasy dweeb at the bottom of HN.