I built this for local RAG https://github.com/kbrisso/byte-vision it uses llama.cpp and Elasticsearch. On a laptop with 8 GB GPU it can handle a 30K token size and summarize a fairly large PDF.

elasticsearch is the true limitation of rag systems...

The vector search works great once you figure it out. I wanted to focus on writing the application and not have to rewrite a document store.

The scary thing? Who says Trump is going away?

Who needs mandatory id systems? State ID's and passports work just fine. What if I don't want an ID?

I think the answer is in the article, you get a mobile app that acts as a defacto national ID with the officers using the app explicitly being allowed to ignore any other ID documents.

I agree.

What if they scanned you and the result was illegal alien? How would you feel?

This is America and we shouldn't have to put up with this. We shouldn't allow mask men running around terrorizing people because of race. But we can't stop it. American freedom is about being free from this form of harassment. American freedom is about being left alone to make something for yourself and your family. America is built on a bad marriage and is not perfect but to let this administration continue to do these types of illegal acts and cause one constitutional crisis after another is the down fall of this country in my opinion. As far as I'm concerned there will be no more elections in the future. What do we do then?

Unfortunately a highly motivated third of the population is authoritarian, and they've been motivated by a cult of personality around Trump whom they see as their savior or instrument for setting all the things wrong with America right. And anyone, any institution or any law in the way needs to be removed. They seemed to have learned nothing from history, or all the fictional stories and tropes warning about this.

It's like a bad dream.

I've given up on America. Democracy has essentially been destroyed in front of our eyes. So many of the current ICE and administrations acts are clearly setting up/testing response to secure the midterms through fear, intimidation, corruption, and blatant disregard for the law. And it will succeed because there is no one at this stage in authority to speak up, and they already fired anybody who wasn't aligned/acolytes.

Now I just hope these Nazi tactics don't continue to become a playbook in my country. Meanwhile, actual Nazis are emboldened and encouraged.

> This is America

It's probably not, but your post almost reads like satire in reference to the tv show by Sacha Baron Cohen with the same name. Living with so many contradictions for so long just leaves one confused and disoriented when it all shatters around you. American exceptionalism means the freedom to poison the well and the freedom to die from drinking poisoned water.

I'm a libertarian until it comes to human safety and corruption. We need regulations to regulate greed. I also believe in privacy and personal freedom as long as you don't hurt others. If you want to come to this country and work - please come and do so. Freedom isn't a flag on a truck or to poison the well and the and die from drinking poisoned water.

Americans have the politics of toddlers, the most manipulated people on the planet. "I'm a libertarian, we need to regulate greed" just like wtf even

Free trade along with capitalism has brought more people out of poverty than any other economic theory/system. It's not perfect but you can't deny it's impact.

Actually you are only looking at one part of the cycle. As subsets of the world prosper, they leave the rest of the world that does not subscribe to their values in the status quo which they label as poverty. The optimal system for any subset of the world depends on the population density it has to serve. Who is impoverished by ‘progress’?

> It's not perfect

See, if anyone who said that took it seriously, or even partway seriously, I would find the prospect of free trade much less offensive. Yet the beneficiaries of "current account deficit equals capital account surplus" squeal like stuck pigs and cry "socialism! communism!" if one even hints at the possibility that they might pay a tax to help counterbalance the extent to which the asset pump / export dump negatively affects employment and drives inequality.

I chunk the documents and use Elasticsearch to store the vectors. On a laptop with 8GB of GPU I can have a pretty large context window and not hallucinate.

Nice! Will have to give it a go, looks interesting. Thanks for sharing.

Byte-Vision is a privacy-first document intelligence platform that transforms static documents into an interactive, searchable knowledge base. Built on Elasticsearch with RAG (Retrieval-Augmented Generation) capabilities, it offers document parsing, OCR processing, and conversational AI interfaces.

https://github.com/kbrisso/byte-vision