Ultramarine 1 Flash

(paperinstruments.com)

79 points | by i_rush_carriers 1 day ago

10 comments

  • kadoban 1 hour ago
    > We present Ultramarine 1 Flash, an agentic model for professional knowledge work. Ultramarine applies large-scale reinforcement learning to a strong open base model, GLM-5.3 Flash, and improves on it across all six knowledge-work benchmarks we evaluate [...]

    In case anyone was curious what it's based on. (No judgement either way from me, IMO depends how well they did the post-training, which I can't tell).

    • ra 1 hour ago
      Nice - I use GLM 5.3 flash for knowledge work now - will check this out.
  • Jackobrien 1 hour ago
    These guys are awesome and I’m really impressed. The model alone looks great (according to benchmarks), and very cool they’ve done so much in building out the harness of top of it all.
  • chicagobuss 1 hour ago
    why does the pareto cost per task chart not have 6.1 sol?
  • sudo_cowsay 1 hour ago
    I have a question, what is considered a Frontier Model? Because its performance is kinda similar to Luna (Max)... I thought frontier meant like 6.1 Sol or 6 Astra or Opus 5.5??? Could someone explain this to me?
    • tibbar 1 hour ago
      These days people often mean the cost/performance Pareto frontier. That is, it is the best performance you can get for that cost profile.
    • Harukadia 31 minutes ago
      they think the frontier mainly as more cheaply and faster. When we use that kinda model in backgroud procudure, it's actually useful a bit other open model.
    • handfuloflight 1 hour ago
      They didn't claim it's a frontier model. They claim frontier level performance.
  • tonyhart7 57 minutes ago
    so its for working only right ???? it cant do/bad at coding
    • randomblock1 47 minutes ago
      Doesn't seem like coding was a focus. DeepSWE: 61.5 (this), 63.4 (GLM 5.3 Flash, which this is based on). TerminalBench 2.1 is also slightly worse.

      So... potentially? The improvements in other areas might help coding, but aren't that big either, except on their own benchmark.

    • midnitewarrior 19 minutes ago
      You can use a rock to hammer a nail, it will sorta get the job done but it won't be great at it.
  • zer00eyz 1 hour ago
    Someone will report back "It didn't one shot my odd ball task"

    Did it do it in 2 tries? 10? It's still coming out cheaper. Brute force the work. This is the path that the labs are taking. It's the 1200 agents trying to solve Hacking Bench hacking hugging face. It's anthropic telling you that its 1000's of staff commits like 10k engineers.

    Treat AI like you're deploying interns who don't need coffee, food or bathroom breaks. With the right metrics they will get to an optimal (enough) solution.

    • plaguuuuuu 38 minutes ago
      there's a problem with that. Probabilistic slot machine works for anything with a deterministic eval (coding, troubleshooting, etc). It doesn't work for anything subjective, like the thing this model is targeting, professional work.
    • kridsdale1 38 minutes ago
      Like Zerglings.
  • moralestapia 35 minutes ago
    "Ultramarine 1 Flash is Fable-class on knowledge work"

    Oh no! That means it's going to destroy humanity!

    It will:

    * Hack into everything that has a computer, like your home appliances, even a toaster could be and will be weaponized against you.

    * Break cryptography, it's gone, the end of the internet as we know it.

    * Be impossible to contain as it can even escape airgapped environments by changing the temperature of CPUs to transmit information to other servers nearby which would sense the fluctuations in ambient temperature[1].

    Or wait ... maybe the people at Anthropic/OpenAI are just a bunch of lying crooks that would say anything to make a bit of cash. Who would've thought?

    1: This completely imbecile statement was made by one of OpenAI's "top scientists", it was not a joke.

    • anon373839 9 minutes ago
      You were joking about the toaster, but Anthropic literally just wrote a blog post claiming that dangerous open source models could persist themselves to smart ovens. You can’t make this shit up.
      • m00x 7 minutes ago
        How many smart ovens have 800GB+ in space?
  • desireco42 1 hour ago
    With Jev to make decisions and Ultramarine to produce document manipulations if I understood it correctly, this is pretty useful in office. I would be excited if I was a big corp.
  • Harukadia 30 minutes ago
    I signed up, then wait a long. You will be same
  • tills13 35 minutes ago
    I don't care, I'm extremely bullish on distillation models like this. Plus anything that'll take the wind out of Anthropic's and OpenAI's IPO sails.