SoundCloudDid I Break You? Reverse Dependency Verification
Exploring the process of reverse dependency verification and its importance in maintaining a tech stack amidst changing company dynamics
EleutherAIActivation Function Ablation
Examining the impact of removing activation functions in GPT-like autoregressive language models.
EleutherAIFinetuning Models on Downstream Tasks
Tuning the performance of GPT-Neo on downstream tasks using an evaluation harness.
EleutherAIEvaluating Different Fewshot Description Prompts on GPT-3
Evaluating the impact of different fewshot prompts on the performance of GPT-3.
EleutherAIOn the Sizes of OpenAI API Models
Utilizing eval harness to determine the sizes of OpenAI API models based on their performance.
OpenAIOpenAI Scholars 2021: Final projects
Exploring innovative final projects from OpenAI Scholars 2021 cohort.
Google DeepMindAdvancing sports analytics through AI research
Creating testing environments using sports analytics to advance AI research beyond the lab
SoundCloudHigh-Tier Content in the SoundCloud API
Retrieving metadata for the full SoundCloud catalog by using the new filter in API requests.
Google DeepMindGame theory as an engine for large-scale data analysis
Applying game theory to large-scale data analysis can help solve fundamental machine learning problems.
OpenAIWill Hurd joins OpenAI’s board of directors
Exploring the implications of Will Hurd joining OpenAI’s board of directors
SoundCloudThe Journey of Corpus
Exploring the process of using user interaction data to drive business decisions
EleutherAIRotary Embeddings: A Relative Revolution
A technical exploration of Rotary Positional Embedding (RoPE), a novel encoding technique that combines absolute and relative approaches, including experimental results.