There are other tunneling solutions that support both and https, websockets using ssh tunnels for the communication. For example I use https://tuns.sh which is a managed sish instance
The only time I preferred light mode was as when I was on vacation in Florida and worked out of a sun room. I find myself normally working in low light environments which makes dark mode better overall. But it doesn’t have to be black background in fact I like the other “dark themes” that are darker shades of blue
My take is that a huge part of human intelligence is pattern matching. We just didn’t understand how much multidimensional geometry influenced our matches
Yes, it could be that intelligence is essentially a sophisticated form of recursive, brute force pattern matching.
I'm beginning to think the Bitter Lesson applies to organic intelligence as well, because basic pattern matching can be implemented relatively simply using very basic mathematical operations like multiply and accumulate, and so it can scale with massive parallelization of relatively simple building blocks.
Intelligence is almost certainly a fundamentally recursive process.
The ability to think about your own thinking over and over as deeply as needed is where all the magic happens. Counterfactual reasoning occurs every time you pop a mental stack frame. By augmenting our stack with external tools (paper, computers, etc.), we can extend this process as far as it needs to go.
LLMs start to look a lot more capable when you put them into recursive loops with feedback from the environment. A trillion tokens worth of "what if..." can be expended without touching a single token in the caller's context. This can happen at every level as many times as needed if we're using proper recursive machinery. The theoretical scaling around this is extremely favorable.
I don't think it's accurate to describe LLMs as pattern matching. Prediction is the mechanism they use to ingest and output information, and they end up with a (relatively) deep model of the world under the hood.
The "pattern matching" perspective is true if you zoom in close enough, just like "protein reactions in water" is true for brains. But if you zoom out you see both humans and LLMs interact with external environments which provide opportunity for novel exploration. The true source of originality is not inside but in the environment. Making it be all about the model inside is a mistake, what matters more than the model is the data loop and solution space being explored.
"Pattern matching" is not sufficiently specified here for us to say if LLMs do pattern matching or not. E.g. we can say that an LLM predicts the next token because that token (or rather, its embedding) is the best "match" to the previous tokens, which form a path ("pattern") in embedding space. In this sense LLMs are most definitely pattern matching. Under other formulations of the term, they may not be (e.g. when pattern matching refers to abstraction or abstracting to actual logical patterns, rather than strictly semantic patterns).
> I don't think it's accurate to describe LLMs as pattern matching
I’m talking about the inference step, which uses tensor geometry arithmetic to find patterns in text. We don’t understand what those patterns are but it’s clear it’s doing some heavy lifting since llm inference is expressing logic and reasoning under the guise of our reductive “next token prediction”
> Then you look around and see "startup X gets to $1M ARR a month after launch" and shit like that and I'm feeling terrible about how we're barely growing.
Comparison is the thief of joy. I fall into this trap almost weekly. Success stories are incredibly rare and we only see the splash, not the iceberg of failure just beneath the surface.
I think about my current business constantly even though on paper we are making enough to keep this thing going forever but it never feels enough.
Slow growth is awesome! Slow growth gives you time to address the challenges of growth, and think through sensible solutions.
Rapid growth feels like you're constantly plugging holes in the dike or putting out fires.
Like you I've had brief moments of jealously seeing a company that started after mine and grew faster. But when I think rationally, I just wish them well, and realize I'm happy with any pace of growth that's not negative.
This is a very cool idea and I like the simplicity of the business model! SSH has a ton of great features and its ergonomics are excellent for terminal enthusiasts. Most of us want to ssh into our cloud compute anyway. As a founder of an ssh platform (https://pico.sh) I just wanted to say welcome and good luck!
Also If you ever want to chat about ssh feel free to reach out!
This is the part that I like the most, which is why I created https://pico.sh
Further, when building ssh "apps" you can build out tooling for client clis that already exist (e.g. rsync, sftp, scp, sshfs). This provides ergonomics because now users aren't required to install extra tools to deploy static sites, for example.
The entire experience is pretty seamless since all developers use SSH anyway.
reply