Learning Jazz Pianist Style with Cross-Attention Conditioning

(almostimplemented.github.io)

51 points | by ishan0102 2 days ago ago

15 comments

  • shermantanktop 2 days ago ago

    Reading about the book that inspired this, written by an artist who closely studied the styles of others— that’s impressive.

    Reading an AI-generated site about some AI model that shits out some fake Bill Evans on command—that’s not. Any moron with enough tokens can do it. Congratulations.

    • speerer a day ago ago

      I think the last sentence of your comment is the most exciting thing about this whole article!

      There are at least three enormous gulfs here:

      First, just understanding music and even jazz as a prerequisite to being able to do this.

      Second, being able to do this using machines instead of a piano itself, which is unaffordable for a lot of people.

      Third, the capturing of the je ne sais quoi of musical style, which is almost impossible to articulate.

      So for me bringing this all together, it allows you to capture an improved understanding of different styles without needing to invest a huge amount of time because you can feed the same input into multiple style models and see how it diverges. That's a control which can't usually be obtained!

      As a technical feat, what AI research allows across domains is a remarkable thing.

      • shermantanktop a day ago ago

        > First, just understanding music and even jazz as a prerequisite to being able to do this.

        Do you have to understand music to train an ai to do this? You can be a fan without understanding music. You can be motivated and have an ear for what Cedar Walton sounds like without knowing anything about what harmonic and rhythmic vocabulary he had or didn’t have.

      • guitarlimeo a day ago ago

        > Second, being able to do this using machines instead of a piano itself, which is unaffordable for a lot of people.

        What? You can get a piano or a keyboard for a couple hundred dollars.

        Unless you mean actually training and being good at the piano being unaffordable, no, that's just lack of skills and/or will to train to become good at it. Anyone can afford to buy an instrument and become good at it if they cared.

        I'm sure no actual musician is actually impressed by this slop, and as the GP comment says the actual book written by a human to whose experience I can relate to and be inspired by is really impressive.

      • Drupon 8 hours ago ago

        >which is unaffordable for a lot of people

        Noooo shut the fuck up. This is nonsense. Any dumbass can get a free acoustic piano on Facebook marketplace near them right now. You can get very cheap digital pianos. The whole "um muh heckin sweet AI music is good because AvAILabILitY" is horseshit fuck you

    • TurkishPoptart 19 hours ago ago

      [dead]

  • Rochus a day ago ago

    This is amazing. I like very much that the approach is using symbolic music information instead of audio. It might help to better understand music some day (i.e. "really understand", not the helper projections the traditional music science works with). It's also interesting to notice the slight time jitter, likely due to the more discrete and limited "information density", or possibly round-off errors due to limited resolution of the weights. Maybe the paper answers it.

  • quaverquaver a day ago ago

    please don't do this kind of thing! go cure cancer or something.

  • jszymborski a day ago ago

    The Oscar Peterson one does seem to mostly understand that he had less mobility in one of his hands after the stroke but it uh... doesn't really get much else right.

    • Jeff_Brown 21 hours ago ago

      Yeah the four samples I heard all sounded kind of formulaic. Too obligated to continue the mold of the last thirty seconds. Impressive and quite pleasant but no big ideas and no thrill of flight.

  • mastazi a day ago ago

    That “transcription” using piano roll (but without even showing the actual keys on the side, and without bar lines) is impossible to follow and doesn’t make sense for jazz, where chromaticism, key changes and syncopation are so common. I see a note and then another note that looks a little higher, are they a major third apart? Or maybe it’s a minor third? Was the first note a pickup? Or is it on the one? No way to know

  • jawilson2 a day ago ago

    "One X, Twelve Y"

    If you don't care enough to write it, I don't care enough to read it. Will be checking out the Hyman book though.

    • rerdavies a day ago ago

      If you don't care enough to read it, perhaps you should not care enough to comment.

  • hidude562 a day ago ago

    this is cool don't listen to the haters. wonder if you can embed the chords / context somehow so it can play with real music?

  • Drupon a day ago ago

    To simulate a jazz legend of a different instrument, Buddy Rich: It sounds like shit. Fuck you.