Thanks devil, after +10 years with Linux I still feel uncertain about what is legit to do and what is not.
Adding the firmware and renaming it resolved the issue. Now I can use bluetoothctl to pair and connect to a bluetooth speaker. But I can't get any sound to it. If I open up Multimedia in System Settings, the speaker is available as a playback device, but it is grayed out. What am I doing wrong?