Reality has a surprising amount of detail (2017)

(johnsalvatier.org)

347 points | by vinhnx 6 days ago ago

125 comments

  • WastedCucumber 20 hours ago ago

    The first time I built a freestanding bookshelf, I put a lot of effort into making the feet level and the back straight and at a right angle to the feet. Once I put it up against the wall I'd built it for, I realized I'd solved completely different problem than the problem I really had. I needed crooked bookshelf, since the wall was totally tilted.

    In the end I screwed some wall shelves in and called it good enough.

    • macNchz 19 hours ago ago

      One of my first real DIY projects during a summer in college nearly 20 years ago was replacing the rotted out basement bulkhead doors on the ~120 year old house I grew up in. I took measurements of the old ones, bought some nice tongue-and-groove cedar and high-quality hardware, and built the new doors in the garage. When they were fully assembled, I carried them over to install on the old stone frame. I took off the old ones, put mine in their place...and they didn't fit properly at all.

      Momentarily baffled, I realized that, despite appearances, the old frame was actually not square, in fact it was a parallelogram. I'd measured the height and width and assumed it was square. The previous (experienced) carpenter who'd built the doors I was replacing had clearly noticed this, and simply allowed for the misalignment in his design. He built perfectly square-appearing doors that mounted to the not-square frame. I had to go back and rework mine considerably for them to fit without looking ridiculous. They're still there and holding up well, but I also still think of this lesson on a regular basis in my day to day life now.

      • barrenko 7 hours ago ago

        You notice this when you start to learn drawing (at least I did) - it's not that you don't know how to draw, say a horse, it's that you have no idea what a horse really looks like. Ordinarily you just jump to a whole lot of conclusions.

      • jadbox 19 hours ago ago

        I feel this in my soul. I thought I could replace a door in a day, but months of fiddling, I discovered by frame is not only a parallelogram but it literally shifts by over an inch between seasons. (~100yr old house 2nd floor)

        • bigmattystyles 18 hours ago ago

          That’s why most doors come prehung in a jamb. Just add shims and then cover them with trim.

        • ErroneousBosh 7 hours ago ago

          I lived in a flat in a 200-ish-year-old building when I was at uni. Lovely flat, handy for uni, handy for work, near the shops, near a park, flatmates were pretty okay, comfortable, airy, well-lit, and warm.

          Here's the thing we - a flat full of nerdy tech students - never figured out.

          The walls in two of the bedrooms (including mine) were perfectly plumb, all four walls straight. Bookshelves lined up nicely with the walls. The floor was flat and level.

          But the room was 10cm narrower at the ceiling.

          • pkaeding 4 hours ago ago

            Have you ever been to The Mystery Spot[1]? It is a fun tourist trap with all sorts of conundrums like that.

            [1]: https://www.mysteryspot.com/

          • VagabundoP 3 hours ago ago

            obviously a small space-time anomaly. Nothing to be alarmed about. Sapphire and Steel have been assigned.

            • ErroneousBosh 2 hours ago ago

              This is the answer we came up with. Guy in the flat downstairs must have been dicking about with supermassive dark matter.

        • xeonmc 15 hours ago ago

          I wonder if this could all be solved if doors are triangles instead of quadrilaterals.

          • kQq9oHeAz6wLLS 15 hours ago ago

            Or round, like the hobbits do

            • 21asdffdsa12 10 hours ago ago

              You lough, but the cork always plugs the bottle eventually. Cone shaped round doors with cork on the rim.

              • psd1 8 hours ago ago

                Leather with a drawstring, like a purse. Never needs oil, and my granny knots will keep the lock-picking lawyer out longer than your yale.

          • LoganDark 14 hours ago ago

            You guys have doors?

        • srean 8 hours ago ago

          Check if it's the hinges that are yielding.

      • alliao 14 hours ago ago

        they can lean at all sort of weird angles too, experienced finish carpenter are worth their weight in gold

    • glaslong 18 hours ago ago

      A related thing that took me a while to accept when I started woodworking is that wood moves, a lot.

      If you built the bookshelf in wood, it will be expanding, contracting and shifting over time with temperature and humidity variation throughout the day and season. And asymmetrically depending on the grain.

      The straight right angles won't stay that way, and it's better to design such that they change in complementary ways, rather than remain perfect.

    • bartread 9 hours ago ago

      Sounds about right. I approached this in a different way in my office.

      The walls aren't straight, either vertically or horizontally, and they're not even consistently wonky along any given axis.

      So I installed uprights vertically, using transparent polycarbonate spacers of different depths at the attachment points[0]. I then installed shelves on the uprights and aligned them horizontally.

      The variation is only +/- 6mm or so (for around 12mm variation across the 2.5m x 2.44m wall) but, if I hadn't done this, my shelves wouldn't be level, and wouldn't even be consistently non-level, so would have been awkward to install along the full length of the wall, would all be misaligned with eachother, and would have looked incredibly janky.

      [0] In hindsight I wish I'd gone for these in different colours rather than just plain transparent, to make more of a feature of them. The walls are white so I think orange, blue, red, and yellow would have worked well.

    • wkjagt 7 hours ago ago

      Someone once told me when I was putting something exactly level in a crooked old house: you want it level with the house, not the universe.

    • jonathanlydall 4 hours ago ago

      My father, (who by profession was a CA with MBA, but is exceptionally handy) has regularly reminded me that walls/floors and ceilings are pretty much never straight and level, and over here they're brick and mortar, not wood.

      This must be a well-known fact to all trades people who work on cupboards, tiling, door mounting, etc. But when you understand this, then you realize that everything is built to be forgiving of this reality.

      E.g. prefabricated bedroom cupboards will always be fitted with fillers on each side and a kickboard for the bottom. This allows you to use feet/wedges underneath the cupboard to make it stand-up perfectly straight (which is not necessarily parallel with the floor and/or walls), but because of the fillers/kickboard being wide/tall enough and cut to fit the irregular/skew shape, you don't tend to notice.

      Beading around wooden door frames is for the same reason, it hides the little gap that is invariably at points around it, either due to the hole in the wall being skew and/or slightly arched.

      • jonathanlydall an hour ago ago

        As I got a downvote I can only assume my tone came across as “how could you not know this?”, but my feeling when I wrote this was that it’s a bit of a funny and interesting anecdote the parent wrote and I’ve been similarly frustrated with how I easily make mistakes with seemingly simple tasks such as putting up a shelf, to which I have to laugh at myself about when thinking about it many years later.

        I definitely prefer that with software it can be “perfect” and easily changed later if you find it’s not.

    • Modified3019 9 hours ago ago

      Hah, yeah same. I grew up in a house built with hand tools sometime around 1910 (family bought it from an old lady whose father built it), not a single corner was square (though things were generally good vertically by some miracle), but it wasn’t noticeable until whenever were doing major work.

      Also learned that lath and plaster needs some special consideration when screwing/nailing things for securement, as the lath (wood strips) could split, causing a subsequent crack in the plaster. Basically for screws or bigger nails, it’s a good idea to drill a small hole first to lessen the pressure, or do a bigger hole and use a spring bolt anchor.

      • Sesse__ 7 hours ago ago

        I once measured a 80s-communally-built event space with a laser meter (it was useful to have digital floor maps for event planning). No measurement was a perfectly round number. No angle was perfectly right. Nothing really lined up. Except… there was this one set of stairs leading up to the stage. It was perfect. Every step was exactly the same in all dimensions, to the millimeter. It was perfectly level. I always wondered who this stair craftsman was, who prided themselves on doing such professional work among the presumed chaos. :-)

    • amatecha 18 hours ago ago

      Coincidentally just had this realization last night. Leaned a piece of furniture against the wall, realized the ~perfectly straight/level edge didn't lean smoothly against the wall -- the wall is not perfectly straight!! :-O

    • tolerance 19 hours ago ago

      I recognized this submission from its title but did not remember what it was about. For some reason this anecdote reminded me. Yes now I know it's about the man who built staircases with his father.

      I can never look at staircases the same.

    • aswegs8 9 hours ago ago

      I have been getting a lot more into DIY and that's my experience myself. I keep running back to the store because there is some detail I haven't considered. Iteration time is so much slower than software... kinda bugs me how much you have to plan upfront and think through instead of just YAGNI and agile-ing your way through it.

    • atoav 15 hours ago ago

      When I worked as a camera guy on film sets, this was a typical occurrence. You level out the camera trypod with the magic eye on the tripod. The magic eye being a small amount of liquid with a single bubble inside, pointing always upward.

      Soon you realize that an surprising amount of walls are just not straight or level.

      • mjmas 10 hours ago ago

        aka spirit level?

        • tonyedgecombe 9 hours ago ago

          On that subject a laser level is indispensable for any work that needs to be straight. I don’t know how I managed without one before.

    • hahahaa 13 hours ago ago

      Maybe some thin wood underneath to level it and a wall anchor? Or would it look to crappy still? Trying to imagine if the wall is uneven or tilting?

    • IncreasePosts 15 hours ago ago

      This is what molding is for. A lot of people view it as "ornate" or old fashioned, but it served a functional purpose originally and then people started making it fancier.

    • UltraSane 13 hours ago ago

      This is why shims are incredibly useful.

    • esikich 12 hours ago ago

      "Never trust the carpenter"

    • ErroneousBosh 7 hours ago ago

      I've done this twice.

      I put up a notice board in my kitchen when I moved into a new place, and it looked squint even though my level said it was straight. I flipped the spirit level end-for-end, still straight - if the level was off and the workpiece was straight, then flipping it would make it read wrong.

      Nope. Level was okay. Checked the wall, wall is plumb. Wait a sec - the wallpaper is not straight.

      So the notice board went on lined up with the wallpaper, not reality.

      The other one was fitting a six metre aluminium pole with a two metre aerial on top to a brand new multi-million pound building. The brackets and pole were absolutely straight and plumb. Got back down off the cherry picker, walked back across the yard to the van, pole looks really squint.

      After much upping and downing and to-ing and fro-ing, it became clear that I needed to pack the aerial pole mounting to lean it over by a couple of degrees so it didn't look wrong!

      The pole was straight, the multi-million pound brand new high end amazing building was distinctly on the piss with not one truly plumb vertical component anywhere.

  • farfatched 19 hours ago ago

    > If you’re a programmer, you might think that the fiddliness of programming is a special feature of programming, but really it’s that everything is fiddly, but you only notice the fiddliness when you’re new, and in programming you do new things more often.

    I think I'm drawn to programming because the fiddliness is tractable, and fixable.

    In which other domain can I:

    * introspect the relevant processes/state, step by step

    * snapshot/undo

    * fix niggles, once and for all, and for everyone; and get their fixes too

    * probe and test my inputs and outputs, checking for quality. Get notified if a part changes in a way that breaks me.

    And the only tool I need is a commodity general purpose PC.

    When I try woodwork, or even electronics, I'm struck by much friction is in even simple tasks: tools, parts, lead time, safety, space, physical effort, cost, ...

    • dwd 18 hours ago ago

      Unless you have endless budget, many things can be one-shot. You can't do a test run first, or roll back a cut if the length is too short. You can patch misplaced nail holes, or re-dig a hole (messing up filling a hole with concrete is another matter) and hope you don't kill a tree transplanting it, but the end result isn't clean.

      The best I could do with woodworking in the end to approximate programming was live with wasting some timber, leave a lot of margin on the main cuts and size all the pieces as a whole.

      • smokefoot 16 hours ago ago

        Woodworking taught me a lot about planning and design. As a young person, I was like the authors brother. I just wanted to do the thing, not draw a diagram and figure out how much wood I need, or build a fixture to mark the stair lines.

        Woodworking (the more constructive, furniture-making kind), rewards a deliberate, controlled process and it savagely penalizes mistakes. Those lessons transfer well to other disciplines. I’d have been a much better student if I’d learned wood working in high school.

        • dwd 16 hours ago ago

          Absolutely.

          Woodworking was part of my first 3 years of high school, but it was mainly about learning safety and tool usage and not planning, estimating, selecting or purchasing timber.

          These days I only want to go to the lumberyard once for a project. Learnt the hard way on my first project that you need to take the time to carefully select the timber - checking straightness, matching grain and also colour before I started. Major hassle and waste of time to have to go back to swap boards.

          • vintagedave 10 hours ago ago

            That's also a lesson about what people will sell you. First time I went to a lumberyard, I was (coincidentally) with a friend who did a lot of woodwork. I thought, well, I've just paid for a pack of wood, I'll get it. The worker there was completely happy with that. My friend stopped me, and inspected each piece.

            Sure enough, several had cracks at the ends, knots in poor places, and other things that, had I bought it, would have caused me trouble.

            I can be a naive person in that I assume good faith. I would never knowingly sell something poor quality to someone else. I had assumed because I was being sold it, it was okay.

            • pclmulqdq 9 hours ago ago

              They aren’t “knowingly selling you poor quality” as some sort of scam. They are selling you wood to the spec you asked for. If you want higher-grade wood, you either have to spend money getting lumber graded to a higher spec or spend the time going through piles of low-spec boards to find the good ones. Many engineered wood structures are designed to use “poor-quality” wood, and they prefer it because it’s cheaper than using less high-grade wood.

              • vintagedave 2 hours ago ago

                The thing is, other packs of the same wood to the same spec were better. We were able to sort through and get one graded/rated the same, but without problems.

                I know about wood quality and I have deliberately bought higher and lower grade wood. But even so, quality varies greatly.

                • pclmulqdq an hour ago ago

                  Yeah, that is correct. Sawmills often produce only one or two grades of wood and don’t do aggressive binning. That’s why the quality is so variable within the grade. There are also factors that affect the grade but don’t necessarily impact every application (eg warping and knots are sometimes ok), so the bins are coarse-grained.

    • zipy124 5 hours ago ago

      The fiddliness isn't necessarily fixable though, at least in business code. The code has to represent the real-world, and if the real-world is fiddly then the code must be fiddly too. The only way to 'fix' this is to restrict your code's representation of the world to some non-fiddly sub-set, but this isn't always possible.

    • inatreecrown2 18 hours ago ago

      Until the next OS update...

      With wood you are up against nature. With software you are up against corporations and comities.

      • Animats 14 hours ago ago

        > With wood you are up against nature.

        You're up against your wood vendor. Anyone familiar with Home Depot "fresh from the tree" lumber has discovered this.

    • joshpicky 18 hours ago ago

      I think this is a very common sentiment among a lot of people, including me.

      And also that’s why AI tools create mix reactions. A couple of months ago a post went viral which was really insightful on what I was originally drawn to cs.

      https://news.ycombinator.com/item?id=46881264

  • smalltorch 5 hours ago ago

    >Consider building some basement stairs for a moment. Stairs seem pretty simple at first, and at a high level they are simple, just two long, wide parallel boards (2” x 12” x 16’), some boards for the stairs and an angle bracket on each side to hold up each stair. But as you actually start building you’ll find there’s a surprising amount of nuance.

    I have to point out stairs aren't typically made like this. That's a really complicated way to do it.

    I really like this article though. Something that stuck out to me early in my career was a master trim carpenter who told me God is in the Details.

    Carpenters constantly battle physics and make dozens of little micro adjustments with the end result being something that is pleasing to the eye that will stand the test of time.

    Can't help but think that translates to anything in life no matter what you're doing. Mastering those micro adjustment, whatever your craft may be, takes things to a whole new level.

    • zomiaen 2 hours ago ago

      >I have to point out stairs aren't typically made like this. That's a really complicated way to do it.

      What do you mean? That's exactly how most residential stairs are built. Two to four stringers with risers and thread boards attached to them.

      Granted, they will draw a template on one board and copy it to the others to make the stringers quickly well before mounting anything.

      • smalltorch 2 hours ago ago

        >angle bracket on each side to hold up each stair.

        You add a serious amount of un needed complexity by using brackets described.

        The rise is typically the only thing you need to know in order to calculate all other dimensions of the stairs.

        The main difference between how the author describes the construction is stringers get cut, this description skips that step.

        Things like tread depth, riser height can be modified too if needed.

  • Jtsummers 20 hours ago ago
  • gobdovan 8 hours ago ago

    I usually view it the opposite way from the article's perspective. There's surprisingly little detail we rely on, yet things work out somehow.

    There's the Popper observation that any model of reality has zero chance to be true, since our models are finite, yet we're trying to describe a fractal reality. It's amazing how few levels of decomposition we need to go through to get something useful, like the stairs in the article (3 decomposition steps, as compared to thousands). If I were to never interact with reality and rely on pure reason alone, I would expect nothing humans ever do to work.

    Abstraction and exploration are unreasonably effective.

    • danielmarkbruce an hour ago ago

      "We" doesn't mean what you think it means... You don't realize how much detail (and work) you are in fact relying on, but the 8 billion (we) know it in aggregate.

      "We" (the 8 billion) have made some insanely great abstractions or puzzle pieces to work with. There is just an insane amount of work that goes into even elementary things to get the world to where it works this way.

    • marcosdumay 3 hours ago ago

      Well, there has been a lot of evolution forcing us to focus on the right kinds of detail.

      • danielmarkbruce an hour ago ago

        It's actually market forces. Evolution has almost zero to do with it. It's the past few thousand years where the vast majority of useful abstractions/tools/puzzle pieces have been built that enable any one person to do a lot without knowing so much.

  • mparramon 18 hours ago ago

    Related, amazing read about Meccano teaching you reality-based work, in contrast with Lego:

    https://contraptions.venkateshrao.com/p/truth-in-inconvenien...

    • fhe 15 hours ago ago

      I want to thank you for the following reasons: - that's an amazing, mind-opening essay; - I've been looking for this toy (Meccano) for my entire adult life. I remember playing with a set that my mom got me when I was a kid, but I didn't know what it was called, and neither did my mom. And when I describe it to people, everyone kept telling me it was Lego (Lego is a much better-known toy brand in this part of the world). I had pretty much given up on ever finding it, thinking it might have just been a niche toy that had ceased production. Words are not enough to describe my joy when I opened the link and saw images of Meccano pieces!

      • dcrazy 13 hours ago ago

        In the U.S., Meccano is known as Erector.

        • boomskats 11 hours ago ago

          I'm amazed it's not more popular with a name like that!

  • mlsu 18 hours ago ago

    I have read this article already and "reality has a surprising amount of detail" has become a phrase for me. But, I read it again today because the writing is so good. This guy is a gifted writer.

    • onemoresoop 16 hours ago ago

      I liked it too. His other posts on his blog are interesting as well.

  • adi_pradhan 4 hours ago ago

    One of my favorite articles. I see people using this as an argument for why LLMs are fundamentally flawed, but that fails to realize that most humans don't get into the details. In fact, many don't have the vocabulary to be in the details.

    There is an argument to be made for using humans, but I think we need humans to be more capable, more curious, more adaptive. LLMs are far better than the average human, but they are fundamentally inferior to the motivated human working with an LLM to augment themselves at the frontier.

  • mcswell 16 hours ago ago

    One thing he didn't mention is getting the first and last steps to be the same vertical distance as the others. Nothing will trip you up (literally!) so easily as a final step that is a different height than the other steps.

    I thought of this because this morning I was putting a small fence around some plants we want to protect from deer. The fence consisted of 20 sections (bought on Amazon), each about 24 inches wide. Our ground is like rock, and the fence was not that sturdy, so I had to pound a heavy spike into the ground to the depth of the fence posts, then pull the spike out and put each section's legs in, leaving room for the next section's leg to go into the same spike hole. I wanted to be sure I was putting each section in at the right position, lest I end up with a 12 inch gap and have to go back and adjust lots of sections. Long story short, I pretty much succeeded, although when it cools down I may adjust a few sections. But the problem was sort of like the stairs: I wanted an integer number of fence sections, each the same length, to exactly fit around the bushes---just like you want an integer number of vertical steps in a diagonal stair, each of the same (more or less standard) height.

    • internet_points 10 hours ago ago

      Now I'm trying to imagine a staircase with a non-integer number of steps

      • dxdm 6 hours ago ago

        Trippy!

  • BatFastard 2 hours ago ago

    As someone who has spent years creating virtual environments, all I can say is "Its turtles all the way down" every detail contains more details.

  • usernametaken29 5 hours ago ago

    This article is awesome. It should be required reading for all engineers but probably mostly ML researchers. I’ve encountered my fair share of geniuses that are oblivious to the fact that the world is indeed complex and has a near infinite amount of detail. Of course, they’ve been trained as engineers, so they think in models and abstractions, but reality is almost always more complex than what people at desks estimate it to be.

  • didgetmaster 18 hours ago ago

    I think we have all written some code that looks bulletproof to us. We run a set of tests with all the inputs we can think of, and it passes with flying colors (after several iterations of course).

    Then we give it to someone else and it fails on their first or second attempt. They simply tried to use it in a way that we did not anticipate. It doesn't mean that we are dumb for not thinking of those possibilities; it just means that we did not think of every one of them.

    • natureiskino 12 hours ago ago

      >that looks bulletproof to us

      And it pretty much is most times. For us. But indeed I did run into the "why would they use it like that though" scenario, where it fails. So I have to patch that usecase. At which point I go all "ok now it's really done" until another fringe usecase pops up and so on and so forth. And I did think about how sure I was it was bulletproof, humbling moment.

  • cadamsdotcom 20 hours ago ago

    This sentence is the exact reason laying people off and replacing them with AI doesn’t work.

    • kouru225 20 hours ago ago

      The fact that machine learning can learn highly detailed patterns is the very reason why AI is so useful. So what you’re saying doesn’t really make much sense

      • zipy124 5 hours ago ago

        Right but the 'surprising level of detail' can often exhibit itself as exactly not a pattern. There are many jobs where you employ a human not because of the rote/pattern based work, but their ability to handle all the edge cases that are just frequent enough to need them, but not frequent enough for AI to be able to handle. That is the events that in this example would require the AI to ask the human to make some decision for them.

      • lelanthran 19 hours ago ago

        > The fact that machine learning can learn highly detailed patterns is the very reason why AI is so useful.

        AI doesn't deal with reality, it deals with tokens. This is why all those vibe-coded harnesses, little more than glue between various text IO interfaces, are several hundreds of thousands of source lines of code.

        It's why a SOTA model took 100kSLoK to write a C compiler to compile one specific project.

        It's why, when I asked for a simple markdown -> ansi escape codes converter (for terminal output) in Python, SOTA Claude and SOTA ChatGPT both give me +- 150 SLoC when my own LUT-based version came to under 10 lines of code + a LUT.

        Reality has a surprising amount of detail, but LLMs don't exist in reality, they exist in a virtual world made up off tokens.

        • kouru225 12 hours ago ago

          The discretization of those tokens can be manipulated to get any result you want. If it meaningfully benefits the AI to have a more fine-grained discretization, then you can do that. AI only compresses as much as we want it to. I understand your sentiment, but the logical conclusion of what you’re saying is that no form of compression is ever valuable. That’s just not a defensible argument.

          All information gets compressed. Even your own perception of reality gets compressed.

        • bonoboTP 19 hours ago ago

          Do you exist in reality? Or just in a virtual world made up of sensory signals? Do you have access to the Ding an sich any more than a (multimodal) LLM?

          • lelanthran 19 hours ago ago

            > Do you exist in reality?

            Yes.

            > Or just in a virtual world made up of sensory signals?

            No, definitely reality. Things affect my thought whether I sense them or not.

            • epihelix 18 hours ago ago

              How would you know? You have no external frame of reference; a virtual world of sensory signals would be identical from your perspective. (I agree that "reality" is the most parsimonious explanation by far, btw, but that's never been the point of the simulation thought experiment.)

              I think the more interesting corollary of this article is that if we're living in a simulation, it's an impossibly, improbably detailed one. I really want some compute time on the HPC that's running it.

              • lelanthran 10 hours ago ago

                > How would you know? You have no external frame of reference; a virtual world of sensory signals would be identical from your perspective.

                Okay, lets go with that :-)

                I might be living in a virtual reality, correct, I have no way of knowing.

                What I do know is that the reality I am in is many thousands of times higher in resolution than the reality of the LLM.

                As an analogy, the LLM is seeing a downscaled 32x32 pixel image while I see the original 8k image. Whether there is a larger 1b^2 image that I cannot see is not relevant to the question of whether the LLM can see my reality or not - it can't.

            • buildbot 19 hours ago ago

              Things affect LLMs besides tokens, like ECC errors or cosmic rays? …

          • airstrike 17 hours ago ago

            Come on, now. That's irrelevant.

            Reality is by definition our physical reality, which is about an infinite number of levels more detailed than the, you know, _virtual_ digital world computers exist in.

            Whatever world we construct for LLMs, no matter how detailed we make it, will always be a blocky projection of the real domain onto a virtual one.

            It follows then that any insight gained in the virtual world is at best a rough approximation which can be quite useful at times but also utterly faulty on occasion.

            How often it is useful vs. wrong is (partially) a function of how complete the real-to-virtual approximation for a given domain.

            Certain domains, given their limited degrees of freedom, can be quite accurately modeled, such as a subway map.

            But many domains cannot, and it's important to be aware of that inherent limitation in digital models including but not limited to LLM """reasoning"""

            • natureiskino 12 hours ago ago

              >Whatever world we construct for LLMs, no matter how detailed we make it, will always be a blocky projection of the real domain onto a virtual one.

              I don't know exactly why but I never really understood this argument. Might be some kind of control thing? Because for me it's pretty simple, it's basically free to give access to reality. Just add "sensory organs" as it were. I can argue you can make them perceive reality even better than we (humans) do, just enlarge the audio/video spectrums. Bam...more reality. The whole point of the argument is we're missing information.

              Again, I get the need for controlling the environment for what LLM/AI/AGI/whatever will be, but that will always cost more than giving them access to like...reality. Same reason I don't really believe in the whole simulation argument, it's just more expensive all around, loses resolution, let alone control. I don't doubt there will be some people that would indulge in neverending hedonism but not all people. You need to give up control for that.

              • airstrike an hour ago ago

                There are two reasons.

                First, reality is continuous whereas the digital world is discrete.

                Second, data in the real world is many orders of magnitude more detailed than what we're able to model with today's computers.

              • lelanthran 10 hours ago ago

                > Because for me it's pretty simple, it's basically free to give access to reality. Just add "sensory organs" as it were.

                I dunno what you mean by "free". The model is trained on text. To "give" the model sensory organs it would need to be trained on those sensory organs.

                Current models can predict text, because that's what the weights represent. Models with sensory organs will need to be trained on the output of those sensory organs.

                That sounds close to impossible in the foreseeable future.

                • natureiskino 25 minutes ago ago

                  >I dunno what you mean by "free".

                  Reality is free. You don't have to waste any resources to model it, you just need to capture it.

                  >The model is trained on text.

                  See in my previous reply:

                  >LLM/AI/AGI/whatever will be

                  LLMs don't even have a sense of time because they work differently to a human brain.

                • bonoboTP 9 hours ago ago

                  Vision and audio is already in use in multimodal LLMs. So it's possible in the past.

                  • lelanthran 6 hours ago ago

                    Who said anything about vision and audio?

    • farfatched 19 hours ago ago

      In the spirit of the article, what detail in the decision making of layoffs might you be missing?

      I expect there's a lot of detail that I'm unaware of relating to running a company (planning; risk; legal; ...) that might make a decision foolish to me, but make sense if given more context.

  • mapcars 19 hours ago ago

    Reality does not have amount of details, it is infinite in all directions. Its only that we perceived certain amount of details, some more some less. One can spend their whole life mastering a single aspect and there always will be room to improve.

    • epihelix 18 hours ago ago

      This is not my field, but are we sure that reality is not quantised at some level?

      Infinite is a very big claim.

      • esailija 12 hours ago ago

        Yeah that's why all models are wrong and everything ultimtately comes down to intution like supreme court's I know it when I see it.

        It's just that intuition doesn't scale and a lot of common cases can be handled with models, rules, definitions etc. People continue to be confused that just adding more rules eventually solves reality but it never has anywhere for anything so continuing to believe it will is wild

      • tick_tock_tick 10 hours ago ago

        A lot of physics, at-least appears, to end up at quantization which actually really bothers me.

    • atoav 11 hours ago ago

      The statement refers to human perception of reality.

  • elfly 7 hours ago ago

    So how do you trace the boards?

    I am assuming that you put the board at the correct angle on the floor, let it go over the upper entry floor, use a ruler to extend the line of the wall over to the board, trace that, cut it, then reverse the process but this time the part you just cut can go on the floor which will produce the correct angle on the wall?

    • glitchc 5 hours ago ago

      You need an angle finder to measure the angles between all relevant surfaces. Then cut the wood according to that.

  • kfarr 18 hours ago ago

    Tell me about it, I maintain an open source project in the civil engineering space and it's ... detailed.

    • aeve890 18 hours ago ago

      You have my curiosity

  • arzmir 19 hours ago ago

    Lovely article!

    Contemplating the details of a thing is really satisfying. At times I find myself sitting there and trying to decompose the astonishing amount of work, research, both evolutionary and revolutionary progress that has gone into reaching the current level of something. Buying myself a coffee and stare at the local ferry and acknowledge that someones life's work went into figuring out how to make the paint stick to metal.

    Naturally the other point also sticks.. I too often get stuck on the details. :P

  • utopiah 9 hours ago ago

    As a prototypist I can share :

    - you genuinely learn once your assumptions about how a system works break, you realize it, try differently, validate, get a better model of that system

    - your interfaces must remain permissive while providing feedback, namely you provide wiggle room then only once it behaves roughly as expected do you tighten then up

  • MASNeo 10 hours ago ago

    With the complexity of the systems we build it’s humbling and refreshing at the same time to read this. Indeed we are quick to default to what we know. Yet the answer may lie well outside of our expertise. I often build things many consider impossible and find that exactly the attention to detail and seeking contrarian views has helped avoid the worst mistakes.

  • lilerjee 14 hours ago ago

    This is one of basic reasons why current AI cannot solve many problems.

    No matter how many data centers are built, it is impossible to accommodate that level of detail.

  • jlightfire 10 hours ago ago

    Hanging a curtain rail that is centered both vertically and horizontally between the window and the ceiling, and it is leveled (with a bubble level), while in a ladder. Mark and then drill. It is harder than it seems at first. Maybe I'm just too a computer guy.

  • wxw 15 hours ago ago

    > Surprising detail is a near universal property of getting up close and personal with reality.

    > As you learn, notice which details actually change how you think.

    Lovely article. The older I get the more I appreciate this.

    One point worth making: in many cases, after learning to see & appreciate the details, you gain the power to ignore the details that don't matter to you. This can be quite freeing.

  • hobonation 19 hours ago ago

    Really generally shitty collision detection and detail. It's just that when you notice, it rolls back and adds resources until you think it's fine.

  • ChuckMcM 13 hours ago ago

    This is one of my all time favorite blog posts. Why? Because it strikes at something that is both true, and a huge trap for smart people. Specifically, people who are experts in one discipline will often imagine that something in some other discipline is "pretty straight forward." And yet, my experience is that it never is. But that doesn't stop smart people from promising something that turns out to be waaaaaay harder to do than they imagined it could be.

  • smokefoot 17 hours ago ago

    Yes but what about AI? (Perhaps the most annoying words written in the last few years mostly on LinkedIn).

    But actually in the years since this was written, I do think the world has shifted. Doing things on a computer used to be really hard. Even just installing a framework or getting >python to call the right python on windows. Then install Django and get Django to work with nginx etc. It was just a lot of thankless, frustrating work to get from zero to 1%.

    Aside from AI, the tools and packages and culture of computing has gotten better. But AI means you just get all the trivial but difficult stuff for free. And I think a lot of people who would have given up now make it through to see something work and they’ll feel the thrill of building something. It’s just better and easier now.

  • gregorymichael 18 hours ago ago

    My favorite post on HN. Upvote it everytime. Use this phrase so often now.

  • rconti 17 hours ago ago

    This hits for to me because I'm currently adding on to my house. Or rather, paying professionals to add on to my house, because I actually want it to get finished.

    I visit every couple of days. It's REMARKABLE how fast things get done. One day, there were no walls. The next day, almost all of the walls were in place!

    ... and yet, at the same time, things take a long amount of time because reality has a surprising amount of detail. I haven't taken into account how much you have to do to frame a house. So incredible amounts of work get done, day after day, but 3/4 of them are things I had no idea needed to get done! Gazing up into the roof, the detail is incredible. The PSL beams, the brackets, the joists, the trusses, just.. EVERYTHING!

    I thought the structural engineer's plans had an incredible amount of detail on them, and they do, but they also don't really say anything about _how_ to build the thing. How to put up the walls, how to hold them together temporarily, how to lift beams into place. In what order things can and should be done. That all just takes experience.

  • boron1006 20 hours ago ago

    This has always been the fun part of programming to me. I know most people hate it, but I really don’t mind being on-call (ok I hate being woken up) and fixing weird bugs that users run into. All these small edge cases that people run into because reality is odd. Of course I’m in scientific programming so that probably colors my view.

    It’s always a little disappointing to me when I think I’ve run into something unique but it ends up being user error or something.

    • ngm7 19 hours ago ago

      I echo this. The kind of entropy that real users bring has been refreshing to face as a founder.

      Being a founder has a lot of SRE like activities. Fortunately I used to actually like troubleshooting and hence love being a founder but I know a lot of people quit this path because of the "suprising amount of details" in reality!

  • nerdright 18 hours ago ago

    Such a great read. This sentence is particularly chilling:

    > you could be intellectually stuck right at this very moment, with the evidence right in front of your face and you just can’t see it.

    • lioeters 16 hours ago ago

      I agree, that conclusion made me reflect on my existence. What I think I know versus the infinite amount of detail I'm missing. It's good to be reminded that there's so much we don't know that we even don't know.

  • bigbangcmbr 13 hours ago ago

    i like to think along these lines too. sometimes it's paralyzing. one of the biggest mind blowing facts is that all this complexity started at a point in time: big bang. no one explicitly programmed it. all of it came from a soup of elementary particles 13.8b yrs ago.

  • qsera 15 hours ago ago

    This is exactly why I stick to programming computers and building "things" using it.

  • ekjhgkejhgk 4 hours ago ago

    I like this passage

    > Frames are made out of the details that seem important to you. The important details you haven’t noticed are invisible to you, and the details you have noticed seem completely obvious and you see right through them. This all makes makes it difficult to imagine how you could be missing something important.

  • ekjhgkejhgk 4 hours ago ago

    Reading this for the N-th time inspired in me the observation that one difference betweent software engineers and carpenters is that software engineers tend to spend most of their time dealing with things they've never seen before, or variations therefore (new bug, new OS, new framework, new programming langauge, etc etc) whereas carpenters tend to spend most of their time doing the things that they know how to do perfectly.

  • benmccarthy 17 hours ago ago

    One of my favourite essays. xkcd has a good take too 1741-Work

  • morpheos137 20 hours ago ago

    Based on what is the level of detail to reality suprising? To me suprising means mysteriously or improbably unexpected. Why should we expect reality to be simple. Note complex and simple are somewhat subjective. The human brain evolved to just sufficient baseline level be able to handle the level of complexity of reality. So why would it be unexpected that humans find realty complex when our brains are calibrated just enough to handle it.

  • Boom890 6 days ago ago

    Good read

    • james_ross 5 days ago ago

      a good read indeed! Makes me think about my use of coding agents differently, as the main thing they do is deal with a lot of details that matter to the execution but don't matter to me personally enough to figure them out. Would love to see this author's more recent take as this was written pre-LLMs taking over the world.....

      • sdenton4 20 hours ago ago

        That sort of abstraction has always existed, it's just been a matter of hiring experts or labor from other humans. Reality still has a surprising amount of detail. You deal with it by engaging directly, delegating to someone else to engage with, or just brute force your way to a crooked staircase.

        When you hire someone to work on the stairs for you, you /hope/ they know what they're doing, especially if you don't have the skills yourself to judge their work. Same for an agent.

  • cynicalsecurity 19 hours ago ago

    An ancient article that now looks even cheesier. It's so hard to make those goddamn stairs. So complex, such wisdom.