Using AI to Optimize ParametersNovember 16, 2015
I came across this interesting paper today, which describes a way of doing Markov Chain Monte Carlo in a way that speeds up optimizing the parameters of a probabilistic model up to 200x. And of course, no big surprise, it's about using intelligent approximation.
This brings to mind to possibility that one day the algorithm we use to do optimization may actually use "AI". What I mean by that is that exploring a curve in hyperspace to find the minimum is in some sense like many other problems: You can look around and collect clues as to the characteristics of the curvature, and use those clues to build a kind of mental model of the dynamics at play, and then ultimately to use what you know about the space to intelligently explore it as quickly as you can.
Imagine a "neural net" of sorts that had been trained on millions of example optimization problems, and was able to very efficiently build an internal model of the topology of a hyper-surface, using that to calculate the optimum parameters... it might be hundreds, or thousands of times faster than naive human attempts that use exact algorithms... and for problems that are just mind-blowingly complex and viewed as semi-intractable today, it might be trillions of times faster.
An amusing side realization is that optimization is a core requirement for building AIs / neural nets in the first place, and so it's conceivable that there could be a recursive benefit to using AIs to do optimization... back to our good old exponential improvements in technology game: Your now supercharged ability to do optimization allows you to train an even more capable neural net, which allows an even faster optimization algorithm, which allows even more capable neural nets, and back and forth you go.LaserQuest VRNovember 10, 2015
A realization today: In the near future, it would be possible to take a company like LazerQuest and have everyone wear a VR headset. You would no longer be able to see anything real around you, but rather the VR headset would be responsible for recreating the LaserQuest building as accurately as possible -- it would need to know with high precision where you were in the building, and what direction your face was pointing.
It would also need to know the precise positions of everyone else, to be able to digitally recreate them in the "game".
This would allow a kind of VR experience where you can actually run around, climb up ladders, etc.
And of course, now that you're in VR land, you could have monsters, robots, etc.
If the VR game made a wall look like a window, then the window could even open up into a larger part of the world... you might have tanks rolling down the street trying to blast you. Rather than a roof, you might have jets flying low passes overhead trying to get you.
I could imagine it being pretty compelling once the technology is powerful enough.SkyTran: Very interesting conceptNovember 10, 2015