Hacker Newsnew | past | comments | ask | show | jobs | submit | throwaway81523's commentslogin

Python's zlib does support incremental compression with the zdict parameter. gzip has something similar but you have to do some hacky thing to get at it since the regular Python API doesn't expose the entry point. I did manage to use it from Python a while back, but my memory is hazy about how I got to it. The entry point may have been exposed in the code module but undocumented in the Python manual.

Wait is Jupyter closed source? I didn't know that. It's disappointing to hear.

Jupyter is definitely open source:

BSD 3-Clause license

.https://jupyter.org/governance/projectlicense/

I do not understand the motivation behind this project or how it differs from Jupyter or Marimo, which are open source and run locally.


as a (very) minor contributor to some parts of the jupyter ecosystem, i can confirm: it is absolutely, 110% open source/BSD-3 licensed!

Most Jupyter tools are licensed with BSD-3 Clause license [1].

[1] https://github.com/jupyter


Dang this was my reaction too! I thought a large part of it was open source (i remember the old anaconda days). TIL I guess!

"I made an open-source jupyter alternative" should be read as "I made a jupyter alternative which is also open-source".

ER=EPR says something completely shocking about the nature of the universe. If there is anything to it, we have almost no clue about how it works or what its consequences are.

Sean Carroll's own favorite topics (emergent gravity, and the many worlds interpretation) are also things that we don't have any clue about.

Yes there is stuff we can calculate to very high precision. Being able to calculate it, and understanding it, are not necessarily the same thing.


The video tape law was created basically a reaction to someone finding out and revealing Robert Bork (then a SCOTUS nominee)'s video rentals. The rentals themselves were bland, featuring stuff like Disney films, but I guess Congress got scared. It passed by wide margins at the time. I wonder if they are still scared the same way.

Background: https://en.wikipedia.org/wiki/Video_Privacy_Protection_Act


Now they'd just pass a law providing only themselves privacy, like how chat control in the EU always has an exemption for those in power.

It's one of my favorite examples of those in power absolutely losing their shit when surveillance and violation of privacy happens to them.

Gad, they sure like to say "BM25" over and over again. That's a near worthless approach to result ranking. Doing any halfway ok job requires much more tuned and/or more powerful approaches.

It's common to do a hybrid of BM25 with other fuzzy search or pgvector.

BM25 is quite bad and needs to be retrained for each corpus anew. SPLADEv2 is much better and there are even better sparse embeddings these days.

Can you please elaborate why?

GCC alread has this for x64, I thought. https://gcc.gnu.org/onlinedocs/gcc/_005f_005fint128.html

RISC-V has no carry bit and this whole thing becomes awkward.

I am under the impression that boost::multiprecision has specialized templates for 128 and 256 bit math, but maybe I'm wrong. In practice when I've wanted extended precision, I've just used GMP or a language with bignums.

I would expect the best x86 machine code for many 128 bit operations would use XMM instructions, no? But I haven't investigated.


>GMP

When I was a teenager I downloaded some pirated games and reverse-engineered the installer/unpacker and discovered it used UHARC, which seemed to be almost magic in how well it could compress data compared to winzip. Knowing absolutely nothing about compression algorithms or information theory, I decided I'd write my own compression algorithm, as one does.

I reasoned that since any computer value can be represented as a binary number, you could store the exponents to which you'd raise 2 and then just write those exponents to a file. Voila, lossless compression, can't believe nobody thought of this before. I used GMP so that I could "compress" arbitrarily large files (which would require handling arbitrarily large exponents).

Except of course binary bits are already optimal for dense data, so my "compression" algorithm made things orders of magnitude larger, not smaller. But it was fast!

All that to say GMP is a great library. Performant, and even an absolute moron like me could figure out how to use it in the days before ChatGPT.


Fool! You're supposed to subtract 1 from the number, and drop leading zeroes. Then you can compress the file recursively until it's 0 bytes!

I had a similar idea as a teenager - calculate md5 hash and store that plus a hint/offset to then brute force the original content. I had dial up and wanted a more practical way to get large files.

Anyway I emailed the Winrar developers about my idea and they politely explained why they didn't think it was feasible (appreciate they even took the time to respond!)


RVV defines add/sub with carry.

https://rvv-isadoc.readthedocs.io/en/latest/arith_integer.ht...

Interesting, I didn't know that. I wonder how much hassle the setup for that is. Maybe too much overhead to use for general purpose int128. But, there is also a 128-bit extension that might or might not have implementations.


Seems pretty scannable. Maybe someone could do that and put it online (estate permitting), or even print and sell photographic reproductions of the scroll, complete with scotch tape splices every 12 feet.

There's a file on docs.python.org explaining the C api. The rest is pretty straightforward, at least until recently when free threading was introduced (IDK about now). Main hassle is manually having to track reference borrowing etc. Understandable in Python 2, but another tragedy in Python 3.

Memes might continue but WH credibility won't. As if there was any in the first place.


The voter base doesn't care. Federal agents are sent to a state against the governor's will, a man gets shot and killed while carrying a holstered pistol, and all the MAGA 2nd amendment republicans think this was a justified killing because he had a gun on him.


Their voter base - and not the rest of us.

There will be a reckoning - and it may originate from the most unexpected place.


When and where from?


The other side of the voters has happily expanded the power of the executive for decades while demonizing those who would put in some restraint. Both sides do this and here we are. The people voting against Trump still gave him power, just not while he was in office.


> Federal

> against the governor's will

that's kind of the idea


Can you elaborate?


A Federal intervention is generally not called for unless a State pointedly does not get with some Federal mandate or another. See desegregation in the South for another notable historic example.

Of the Little Rock 9 in Arkansas:

>When integration began on September 4, 1957, the Arkansas National Guard was called in to "preserve the peace". Originally at orders of the governor, they were meant to prevent the black students from entering due to claims that there was "imminent danger of tumult, riot and breach of peace" at the integration. However, President Eisenhower issued Executive order 10730,[18] which federalized the Arkansas National Guard and 1,000 soldiers from the US Army and ordered them to support the integration on September 23 of that year, after which they protected the African American students. The Arkansas National Guard would escort these nine black children inside the school as it became the students' daily routine that year.

Ideally though, this type of intervention should be exceedingly rare or reserved for the most egregious cases. Unfortunately, the present administration sees only the mechanism, and is motivated more by pettiness than any real commitment to Statecraft.


their voter base is drenched in lies and agitprop spewing 24/7 from the computer in their pockets


Arguably, that's the point. For post-truth politicians, the objective isn't to present a narrative as objectively factual, but to bring the entire notion of factual objectivity into question.

It's not "This is the truth." Rather, it's "The truth is unknowable." If nobody knows what's true and false anyway, there's no reason to concern yourself with "facts" that disturb your preconceptions.


> White House Deputy Communications Director Kaelan Dorr defended the post after criticism of the image manipulation.

> “Enforcement of the law will continue. The memes will continue. Thank you for your attention to this matter,” Dorr wrote.

The banner image on Dorr's X account reads: "oMg, diD tHe wHiTE hOuSE reALLy PosT tHiS?"

You're right, and I'd add that the agenda goes well beyond muddying the waters. This administration is deliberately normalizing bad faith, lying, and trolling. Discrediting critics as humorless, pathetic pearl-clutchers. I don't believe that their supporters strictly "believe" in Trump's alternate reality - they know that Trump and his cronies lie non-stop, and they like it. Accepting these lies serves as a shibboleth and lays the groundwork for discrediting fair elections, bogus prosecutions of political opponents, and everything else this administration is doing to corruptly hold on to power and demoralize their opponents.


The corollary is that literally everything that the US government communicates should be assumed to be a lie. Even normal, boring announcements from the USDA and such are communicated in the voice of a terminally-online twitter troll.


Its the Firehose of falsehood. Pioneered in Putin's Russia. It is extremely effective.


Credibility is irrelevant. As you said, they never had it to begin with yet here we are.

Dunking on the administration only serves to pat one another on the back and not make any actual political progress.


> Moreover it'll ruin USD as a reserve currency another unforced error.

I think that is intentional, based on some bizarre reasoning somewhere in the Project 2025 docs.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: