• 404-507-6104
  • info@hqconsultinginc.com
“Above the Trend Line” – Your Industry Rumor Central for 5/5/2022

“Above the Trend Line” – Your Industry Rumor Central for 5/5/2022

Above the Trend Line: your industry rumor central is a recurring feature of insideBIGDATA. In this column, we present a variety of short time-critical news items grouped by category such as M&A activity, people movements, funding news, financial results, industry alignments, customer wins, rumors and general scuttlebutt floating around the big data, data science and machine learning industries including behind-the-scenes anecdotes and curious buzz.

Research Highlights: Transformer Feed-Forward Layers Are Key-Value Memories

Research Highlights: Transformer Feed-Forward Layers Are Key-Value Memories

In this regular column, we take a look at highlights for important research topics of the day for big data, data science, machine learning, AI and deep learning. It’s important to keep connected with the research arm of the field in order to see where we’re headed. In this edition, if you (like me) have wondered what the feed-forward layers in transformer models are actually doing, this is a pretty interesting paper on that topic. Enjoy!