Hilbert space: Treating functions as vectors

(eli.thegreenplace.net)

43 points | by signa11 8 days ago ago

20 comments

  • constantcrying an hour ago ago

    As evidenced by the confusion of at least one commenter, I do not think it is a good didactic way to introduce vectors by how they can be written in a particular basis.

    It is just unhelpful in many ways. It fixates on one particular basis and it results in a vector space with few applications and it can not explain many of the most important function vector spaces, which are of course the L^p spaces.

    In most function vector spaces you encounter in mathematics, you can not say what the value of a function at a point is. They are not defined that way.

    The right didactic way, in my experience, is introducing vector spaces first. Vectors are elements of vector spaces, not because they can be written in any particular basis, but because they fulfill the formal definition. And because they fullfil the formal definition they can be written in a basis.

    • arjie 18 minutes ago ago

      Haha, this works if you already know what a vector space is. But I think pedagogy needs to provide motivational examples. I'll quote one section of a text by Poincaré (translated by an LLM since most here do not speak French).

      > We are in a geometry class. The teacher dictates: “A circle is the locus of points in the plane that are at the same distance from an interior point called the center.” The good student writes this sentence in his notebook; the bad student draws little stick figures in it; but neither one has understood. So the teacher takes the chalk and draws a circle on the board. “Ah!” think the students, “why didn’t he say right away: a circle is a round shape — we would have understood.”

      > No doubt, it is the teacher who is right. The students’ definition would have been worthless, since it could not have served for any demonstration, and above all because it would not have given them the salutary habit of analyzing their conceptions. But they should be shown that they do not understand what they think they understand, and led to recognize the crudeness of their primitive notion, to desire on their own that it be refined and improved.

      The learning comes from making the mistake and being corrected, not from being taught the definition, I think.

      Anyway, it's from Science and Method, Book 2 https://fr.wikisource.org/wiki/Science_et_m%C3%A9thode/Livre...

      There's more to the section that talks about the subject. I just find this particular paragraph amusingly germane.

      • constantcrying 13 minutes ago ago

        I have nothing against starting out with motivating examples, obviously they are needed for understanding. But they should motivate the definition of a vector space. Not the definition of vectors as mappings of indices.

        Functions are actually a great motivating example for the definition of a vector space, precisely because they are first look nothing like what student think of as a vector.

    • lanza 40 minutes ago ago

      > It fixates on one particular basis and it results in a vector space with few applications and it can not explain many of the most important function vector spaces, which are of course the L^p spaces.

      Except just about all relevant applications that exist in computer science and physics where fixating on a representation is the standard.

      • constantcrying 24 minutes ago ago

        Most relevant applications use L^2 spaces which can not be defined point wise.

        If you want to talk about applications, then this representation is especially bad. Since the intuition it gives is just straight up false.

  • petesergeant 3 hours ago ago

    > But we can take it even further; what if we allow any real number as an index?

    How can an uncountably infinite set be used as an index? I was fine with natural numbers (countably infinite) being an index obv, but a real seems a stretch. I get the mathematical definition of a function, but again, this feels like we suddenly lose the plot…

    • IronyMan100 an hour ago ago

      This Has it's use. The continouus Fourier Transform is is based on that. You are asking what frequencies is this continouus signal made of. Time is normally defined as a real number in that context, but If you have a continouus time you need continouus frequencies to map time space to frequency space. You can think about an Index as a lego Block, that you need to construct Something.

    • jhanschoo an hour ago ago

      You can look at use cases for an index, and see how well they hold up.

      Asking where the smallest greater number (next number) is no longer makes sense.

      Taking two numbers and asking whether one is greater than the other still makes sense. (and hence also whether they are equal)

      Taking two numbers and asking how far separated from each other still makes sense.

      You may already observe some uses for indexes in programming that don't use all of these properties of an index. For example, the index of a hash set "only cares about equality", and "the next index" may be an unfilled address in a hash set.

    • ncfausti 2 hours ago ago

      I think that’s why the author put “vector” in quotes. I kind of imagine it as an ephemeral, infinite list where for some real, when we use that real value as an index into our “vector”/function, we get the output value as the item in this infinite, ephemeral list.

      I think the only thing that matters is that the indices have an ordering (which the reals obviously do) and they aren’t irrational (i.e. they have a finite precision).

      Imagine you have a real number, say, e.g. 2.4. What stops us from using that as an index into an infinite, infinitely resizable list? 2.4^2 = 5.76. Depending on how fine-grained your application requires you could say 2.41 (=5.8081) is the next index OR 2.5 (=6.25) is the next index we look at or care about.

      I could be misunderstanding it, though.

      • a57721 2 hours ago ago

        A vector is always a vector -- an element of something that satisfies the axioms of a vector space. The author starts with the example of R^n, which is a very particular vector space that is finite-dimensional and comes with a "canonical" basis (0,...,1,...,0). In general, a basis will always exist for any vector space (using the axiom of choice), but there is no need to fix it, unless you do some calculations. The analogy with R^n is the only reason the "indices" are mentioned, and I think this only creates more confusion.

        > and they aren’t irrational (i.e. they have a finite precision)

        No, if you want only rational "indices", then your vector space has a countable basis. Interesting vector spaces in analysis are uncountably infinite dimensional. (And for this reason the usual notion of a basis is not very useful in this context.)

      • Natsu an hour ago ago

        > and they aren’t irrational (i.e. they have a finite precision).

        I'm not sure if I'm misunderstanding what you mean by 'finite precision' but the ordinary meaning of those words would seem to limit it to rational numbers?

    • hodgehog11 2 hours ago ago

      We do it all the time. An index is just indicative that there is a mapping (a function), usually from the integers. However we don't use the subscript notation when indexing by a continuum due to the discomfort you describe.

      The point is that we need some way to deal with objects that are inherently infinite-dimensional.

    • eucyclos 2 hours ago ago

      I'm probably ignorant of how indexes work at a nuts-and-bolts level, but intuitively this seems like a good idea for certain situations. E.g if we want to keep entries in a specific order but don't know ahead of time how many entries will be added between two existing ones. House numbers in areas with a lot of development are an example of the kind of problem this seems ideal to solve, when there's a clear 'order' based on geography but no clear limit on the number of addresses that could be added 'between' existing addresses.

      • codebje 2 hours ago ago

        I think you're still describing a countably infinite set: there's a bijection between the natural numbers and the set of houses.

        One way to think about it is that, even though you're defining an index that permits infinite amounts of subdivision, from any given house there's always a "next house up" in the vector: you can move up one space.

        In a real-indexed vector, that notion doesn't apply. It's "infinity plus one" all the way down: whatever real value you pick to start with, x, there's no delta small enough to add to it such that there's no number between x and x+d.

        • mb7733 2 hours ago ago

          > In a real-indexed vector, that notion doesn't apply. It's "infinity plus one" all the way down: whatever real value you pick to start with, x, there's no delta small enough to add to it such that there's no number between x and x+d.

          Just to clarify, uncountability isn't necessary for this. It's true for the rational numbers too, which are countable.

      • ncfausti 2 hours ago ago

        That’s kind of how I understand it as well.

    • codebje 2 hours ago ago

      The only difference of note, I think, is that you can't enumerate the elements. Instead of being able to say "for each element, ..." you'd have to say "for all elements, ...", like the example of vector length defined as an integral over the full number range.

    • sorokod 2 hours ago ago

      The author is stretching an analogy, it's a price to pay for starting with R^3 as a motivational example. There is nothing in the general definition of a vector space that requires it's elements to be "indexed"

    • majikaja an hour ago ago

      Consider a function on R as an |R|-dimensional vector...

    • drdeca 2 hours ago ago

      What do you understand “index” to mean here? To me, a family indexed by some set is mostly just a different notation for, and attitude towards, a function with domain the indexing set.