“Necessity is the mother of invention.”
What you’re likely seeing here is innovation similar to the early tech sector. The hardware limitation (no Nvidia chips) means different (usually more complex) solutions are needed.
These solutions usually require a deep understanding of a specific area of mathematics, and expertise in coding. The person making it normally has to be heavily invested, since it still eats a lot of hours.
I often joke, the mathematician who finds a faster algorithm for matrix operations is sitting on a billion dollar idea.
As a mathematician who has worked in tech, this I am very much aware of XD