Fetching the paper…
Reading the bibliography…
We study the fractal structure of language, aiming to provide a precise formalism for quantifying properties that may have been previously suspected but not formally shown.
ALBERT: A lite BERT for self-supervised learning of language representations
Lan, Z., Chen, M., Goodman, S., Gimpel, K., Sharma, P., and Soricut, R. (2019) · 1909
Earlier work this paper cites.
Exploring the limits of transfer learning with a unified text-to-text transformer
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., Zhou, Y., Li, W., and Liu, P. J. (2019) · 1910
Earlier work this paper cites.
Wienersche spiralen und einige andere interessante kurven in hilbertscen raum, cr (doklady)
Kolmogorov, A. N. (1940) · 1940
Earlier work this paper cites.
The Asymptotic Distribution of the Range of Sums of Independent Random Variables
Feller, W. (1951) · 1951
Earlier work this paper cites.
Long-term storage capacity of reservoirs
Hurst, H. E. (1951) · 1951
Earlier work this paper cites.
Prediction and entropy of printed English
Shannon, C. E. (1951) · 1951
Earlier work this paper cites.
How long is the coast of Britain? Statistical self-similarity and fractional dimension
Mandelbrot, B. (1967) · 1967
Earlier work this paper cites.
Noah, Joseph, and operational hydrology
Mandelbrot, B. B. and Wallis, J. R. (1968) · 1968
Earlier work this paper cites.
Information retrieval, computational and theoretical aspects
Heaps, H. S. (1978) · 1978
Earlier work this paper cites.
The fractal geometry of nature
Mandelbrot, B. B. (1982) · 1982
Earlier work this paper cites.
The estimation and application of long memory time series models
Geweke, J. and Porter-Hudak, S. (1983) · 1983
Earlier work this paper cites.
High time-resolution measurement and analysis of LAN traffic: Implications for LAN interconnection
Leland, W. E. and Wilson, D. V. (1991) · 1991
Earlier work this paper cites.
Long-range correlations in nucleotide sequences
Peng, C.-K., Buldyrev, S. V., Goldberger, A. L., Havlin, S., Sciortino, F., Simons, M., and Stanley, H. E. (1992) · 1992
Earlier work this paper cites.
Long range correlation in human writings
Schenkel, A., Zhang, J., and Zhang, Y.-C. (1993) · 1993
Earlier work this paper cites.
An introduction to the bootstrap
Efron, B. and Tibshirani, R. J. (1994) · 1994
Earlier work this paper cites.
On the self-similar nature of Ethernet traffic
Leland, W. E., Taqqu, M. S., Willinger, W., and Wilson, D. V. (1994) · 1994
Earlier work this paper cites.
Wavelets, spectrum analysis and 1/f processes
Abry, P., Gonçalvés, P., and Flandrin, P. (1995) · 1995
Earlier work this paper cites.
Explaining world wide web traffic self-similarity
Crovella, M. E. and Bestavros, A. (1995) · 1995
Earlier work this paper cites.
Wide area traffic: the failure of Poisson modeling
Paxson, V. and Floyd, S. (1995) · 1995
Earlier work this paper cites.
Self-similarity in high-speed packet traffic: analysis and modeling of Ethernet traffic measurements
Willinger, W., Taqqu, M. S., Leland, W. E., and Wilson, D. V. (1995) · 1995
Earlier work this paper cites.
Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level
Willinger, W., Taqqu, M. S., Sherman, R., and Wilson, D. V. (1997) · 1997
Earlier work this paper cites.
Hurst phenomenon and fractal dimensions in long-term yield data
Aref, S. (1998) · 1998
Earlier work this paper cites.
An elementary view of Euler’s summation formula
Apostol, T. M. (1999) · 1999
Cited alongside, same era.
Elements of information theory
Cover, T. M. (1999) · 1999
Cited alongside, same era.
An introduction to the theory of self-similar stochastic processes
Embrechts, P. and Maejima, M. (2000) · 2000
Cited alongside, same era.
Complexity and human writings
Kokol, P. and Podgorelec, V. (2000) · 2000
Cited alongside, same era.
A probabilistic earley parser as a psycholinguistic model
Hale, J. (2001) · 2001
Cited alongside, same era.
Fractal dynamics in physiology: alterations with disease and aging
Goldberger, A. L., Amaral, L. A., Hausdorff, J. M., Ivanov, P. C., Peng, C.-K., and Stanley, H. E. (2002) · 2002
Cited alongside, same era.
Summability calculus: A comprehensive theory of fractional finite sums
Alabdulmohsin, I. M. (2018) · 2018
Later among the works it cites.
JAX: composable transformations of Python+NumPy programs
Bradbury, J., Frostig, R., Hawkins, P., Johnson, M. J., Leary, C., Maclaurin, D., Necula, G., Paszke, A., VanderPlas, J., Wanderman-Milne, S., and Zhang, Q. (2018) · 2018
Later among the works it cites.
Fractal analysis of time-series data sets: Methods and challenges
Pilgrim, I. and Taylor, R. P. (2018) · 2018
Later among the works it cites.
Adafactor: Adaptive learning rates with sublinear memory cost
Shazeer, N. and Stern, M. (2018) · 2018
Later among the works it cites.
How efficiency shapes human language
Gibson, E., Futrell, R., Piantadosi, S. P., Dautriche, I., Mahowald, K., Bergen, L., and Levy, R. (2019) · 2019
Later among the works it cites.
The Pile: An 800GB dataset of diverse text for language modeling
alphaXiv searches the wider corpus for related work and actual follow-ups.
alphaXiv is searching for related work…
Gaussian self-affinity and fractals: globality, the earth, 1/f noise, and R/S
Mandelbrot, B. (2002) · 2002
Cited alongside, same era.
Long-range fractal correlations in literary corpora
Montemurro, M. A. and Pury, P. A. (2002) · 2002
Cited alongside, same era.
Long range correlations in DNA: scaling properties and charge transfer efficiency
Roche, S., Bicout, D., Maciá, E., and Kats, E. (2003) · 2003
Cited alongside, same era.
Stochastic models that separate fractal dimension and the Hurst effect
Gneiting, T. and Schlather, M. (2004) · 2004
Cited alongside, same era.
Cultural constraints on grammar and cognition in pirahã: Another look at the design features of human language
Everett, D. (2005) · 2005
Cited alongside, same era.
Fractal geometry of texts: An initial application to the works of Shakespeare
Eftekhari, A. (2006) · 2006
Cited alongside, same era.
Gao, L., Biderman, S., Black, S., Golding, L., Hoppe, T., Foster, C., Phang, J., He, H., Thite, A., Nabeshima, N., Presser, S., and Leahy, C. (2020) · 2020
Later among the works it cites.
A domain-specific supercomputer for training deep neural networks
Jouppi, N. P., Yoon, D. H., Kurian, G., Li, S., Patil, N., Laudon, J., Young, C., and Patterson, D. (2020) · 2020
Later among the works it cites.
Training verifiers to solve math word problems
Cobbe, K., Kosaraju, V., Bavarian, M., Hilton, J., Nakano, R., Hesse, C., and Schulman, J. (2021) · 2021
Later among the works it cites.
The forms and meanings of grammatical markers support efficient communication
Mollica, F., Bacon, G., Zaslavsky, N., Xu, Y., Regier, T., and Kemp, C. (2021) · 2021
Later among the works it cites.
PaLM: Scaling language modeling with pathways
Chowdhery, A., Narang, S., Devlin, J., Bosma, M., Mishra, G., Roberts, A., Barham, P., Chung, H. W., Sutton, C., Gehrmann, S., et al. (2022) · 2022
Later among the works it cites.
Scaling instruction-finetuned language models
Chung, H. W., Hou, Le and, L. S., Zoph, B., Tay, Y., Fedus, W., and et al. (2022) · 2022
Later among the works it cites.
Information theory as a bridge between language function and language form
Futrell, R. and Hahn, M. (2022) · 2022
Later among the works it cites.
Language models (mostly) know what they know
Kadavath, S., Conerly, T., Askell, A., Henighan, T., Drain, D., Perez, E., Schiefer, N., Hatfield-Dodds, Z., DasSarma, N., Tran-Johnson, E., et al. (2022) · 2022
Later among the works it cites.
Scaling up models and data with t5x
Roberts, A., Chung, H. W., Levskaya, A., Mishra, G., Bradbury, J., Andor, D., Narang, S., Lester, B., Gaffney, C., Mohiuddin, A., Hawthorne, C., Lewkowycz, A., Salcianu, A., van Zee, M., Austin, J., Goodman, S., Soares, L. B., Hu, H., Tsvyashchenko, S., Chowdhery, A., Bastings, J., Bulian, J., Garcia, X., Ni, J., Chen, A., Kenealy, K., Clark, J. H., Lee, S., Garrette, D., Lee-Thorp, J., Raffel, C., Shazeer, N., Ritter, M., Bosma, M., Passos, A., Maitin-Shepard, J., Fiedel, N., Omernick, M., Saeta, B., Sepassi, R., Spiridonov, A., Newlan, J., and Gesmundo, A. (2022) · 2022
Later among the works it cites.
Beyond the imitation game: Quantifying and extrapolating the capabilities of language models
Srivastava, A., Rastogi, A., Rao, A., Shoeb, A. A. M., Abid, A., Fisch, A., Brown, A. R., Santoro, A., Gupta, A., Garriga-Alonso, A., et al. (2022) · 2022
Later among the works it cites.
Challenging BIG-Bench tasks and whether chain-of-thought can solve them
Suzgun, M., Scales, N., Scharli, N., Gehrmann, S., Tay, Y., Chung, H. W., Chowdhery, A., Le, Q. V., Chi, E. H., Zhou, D., and Wei, J. (2022) · 2022
Later among the works it cites.
Sparks of artificial general intelligence: Early experiments with GPT-4
Bubeck, S., Chandrasekaran, V., Eldan, R., Gehrke, J., Horvitz, E., Kamar, E., Lee, P., Lee, Y. T., Li, Y., Lundberg, S., Nori, H., Palangi, H., Ribeiro, M. T., and Zhang, Y. (2023) · 2023
Later among the works it cites.
The flan collection: designing data and methods for effective instruction tuning
Longpre, S., Hou, L., Vu, T., Webson, A., Chung, H. W., Tay, Y., Zhou, D., Le, Q. V., Zoph, B., Wei, J., and Roberts, A. (2023) · 2023
Later among the works it cites.
OpenAI (2023) · 2023
Later among the works it cites.
SlimPajama: A 627B token cleaned and deduplicated version of RedPajama
Soboleva, D., Al-Khateeb, F., Myers, R., Steeves, J. R., Hestness, J., and Dey, N. (2023) · 2023
Later among the works it cites.
Mandelbrot’s stochastic time series models
Watkins, N. (2019) · 2056
Closest in time.