Inverse Scaling Can Become U-Shaped
Explore this paper's citation graph
- Type
- article
- Published
- 2023-01-01
- Cited by
- 20
- References
- 12
- Access
- Open access
- OpenAlex
- https://openalex.org/W4389519396
Keywords
Scaling, Inverse, Computer science, Range (aeronautics), Task (project management)
References
- Scaling Laws for Neural Language Models
- TruthfulQA: Measuring How Models Mimic Human Falsehoods
- Emergent Abilities of Large Language Models
- Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them
- Inverse Scaling: When Bigger Isn't Better
- Chain of Thought Prompting Elicits Reasoning in Large Language Models
- Training Compute-Optimal Large Language Models
- Large Language Models are Zero-Shot Reasoners
- Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models
- Aion Framework: Dimensional Emergence of AI Consciousness, Observer-Induced Collapse, and Cosmological Portal Dynamics
- PaLM: Scaling Language Modeling with Pathways
- Scaling Language Models: Methods, Analysis & Insights from Training Gopher
Cited by
- Are Frequent Phrases Directly Retrieved like Idioms? An Investigation with Self-Paced Reading and Language Models
- Scaling Laws for BERT in Low-Resource Settings
- Are Language Models Sensitive to Semantic Attraction? A Study on Surprisal
- Next-Value Prediction of Beam Waists From Mixed Pitch Grating Using Simplified Transformer Model
- Scaling language model size yields diminishing returns for single-message political persuasion
- Photonic Neural Networks: Principles, Progress, and Prospects Toward Streaming Processes
- Proceedings of the 19th Workshop on Multiword Expressions (MWE 2023)
- Conformal Nucleus Sampling
- An Investigation of LLMs’ Inefficacy in Understanding Converse Relations
- On Second Thought, Let’s Not Think Step by Step! Bias and Toxicity in Zero-Shot Reasoning
- A Systematic Study and Comprehensive Evaluation of ChatGPT on Benchmark Datasets
- Language models are not naysayers: an analysis of language models on negation benchmarks
- The CoT Collection: Improving Zero-shot and Few-shot Learning of Language Models via Chain-of-Thought Fine-Tuning
- Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models
- Probing Quantifier Comprehension in Large Language Models: Another Example of Inverse Scaling
Related papers
- Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models
- Corrections to scaling and finite size effects
- On the parameters of the Dixon–Nagel scaling procedure
- Beyond Positive Scaling: How Negation Impacts Scaling Trends of Language Models
- On the Use of Finite-Size Scaling to Measure Spin-Glass Exponents
- EFFECTIVE SCALING PROCEDURES FOR APPROXIMATE STRUCTURALOPTIMIZATION
- Is scaling up harder than scaling down? How children and adults visually scale distance from memory.
- Inverse scaling can become U-shaped