I'm fairly confident that the new reddit React implementation can be improved in performance by a factor of 3x to 10x. I would be interested to hear others who have good reason to explain why not. I can certainly imagine React-like systems that are capable of statically determining DOM influence sufficient to make comment-collapsing negligible.
Do you have any details on the experiment procedures? E.g. hardware, training time, loss curves? It is difficult to confidently reproduce research without at least some of these details.
You can do Q-Learning with a transformer. You simply define the state space as the observation sequence. This is in fact natural to do in partially observed settings. So your distinction does not make sense.
TFP cites decision transformers. Just using a transformer does not bypass the credit assignment problem. Transformers are an architecture for solving sequence modeling problems, e.g. the credit assignment problem as arises in RL. There have been many other such architectures.
The hardness of the credit assignment problem is a statement about data sparsity. Architecture choices do not "bypass" it.
Can you provide some technical details on what you do? Do you divide the number of channels on each real layered network by 4? I don't see anything describing this in the paper.
This model is showing predictions one day into the future. The "test set" plot is all predictions made with data from 1 day ago. The input sequences have size 1, so no recurrence is happening (see to_1dimension in https://github.com/miguelgfierro/sciblog_support/blob/master...). If you predict that tomorrow will have the same price as today you'll get better plots under the same operating conditions.
In[2]: TIME_AHEAD = 1
Train set has ~1e-6 MSE, Test set has ~0.8 (0.94^2).
EDIT: I should say this person is probably learning, and a lot of this is honest mistake.
Most of the research in compressed sensing type applications now is focused on more sophisticated prior distributions than sparse/Laplacian. These more general bayesian approaches provide significant performance improvements over LASSO etc.
Not to mention that it appears they're comparing against networks of the same architecture. If you build your quaternion components with with same number types as your reals you effectively have 4 times the number of parameters, which could be most of the benefit. They should also benchmark against similar architectures with equivalent parameter counts.
Regarding this and previous discussions on this topic on HN, it seems to me that one of the primary motivating factors when constructing a new ranking system should be the possibility of cyclical dominance a la rock/paper/scissors, which we should expect to see in many modern complex games. If one wanted to solve that problem, I think it would require some form of multidimensional ranking. Then one would have added flexibility so you could accurate predict winners from the scoring with some function f(x_1,x_2) even in cyclical cases. This would be less interpret-able, but it would have a fair shot at actually modelling/predicting/depicting the dominance relationships between players.
Bayesian optimization is often applied on problems where the cost of function evaluation greatly exceeds the cost of any posterior updates etc. In this case sample efficiency is the real benchmark, and you should be looking at realistic problems with d>>2.
Investors that investigate companies, identify hidden problems and report on them to the public help enable more accurate price discovery. This wouldn't happen at all if they couldn't trade against it.
For instance, I recall a story where a hedge fund sent PIs to determine that a factory reported running was actually closed down. They can't just trade against that info - it also has to be made public for them to realize gains. I can't imagine how you'd consider activity like this "getting away with it", when the alternative is companies performing unscrupulous acts in secret.
Cash is cheaper for merchants, but people have only continued to use credit cards more. Further, if crypto becomes attractive from a cost perspective Visa will just be forced to bring down fees and stay competitive. It's pretty near impossible to imagine crypto with costs less than Visa's database.