Welcome to The Nonlinear Library, where we use Text-to-Speech software to convert the best writing from the Rationalist and EA communities into audio. This is: Intermittent Distillations #4: Semiconductors, Economics, Intelligence, and Technological Progress, published by Mark Xu on the AI Alignment Forum This post was written by Mark Xu based on interviews with Carl Shulman. It was paid for by Open Philanthropy but is not representative of their views. A draft was sent to Robin Hanson for review but received no response. Summary Robin Hanson estimates the time until human-level AI by surveying experts about the percentage progress to human-level that has happened in their particular subfield in the last 20 years, and dividing the number of years by the percentage progress. Such surveys look back on a period of extremely rapid growth of compute from both hardware improvements and more recently skyrocketing spending. Hanson favors using estimates from subsets of researchers with lower progress estimates to infer AI timelines requiring centuries worth of recent growth, implying truly extraordinary sustained compute growth is necessary to surpass human performance. Extrapolated compute levels are very large to astronomically large compared to the neural computation that took place in evolution on Earth, and thus likely far overestimate AI requirements and timelines. Introduction Suppose that you start with $ 1 that grows at 10% per year. At this rate, it will take ~241 years to get $ 10 billion ($ 10 10 ). When will you think that you’re ten percent of the way there? You might say that you’re ten percent of the way to $ 10 billion when you have $ 1 billion. However, since your money is growing exponentially, it takes 217 years to go from $ 1 to $ 1 billion and only 24 more to go from $ 1 billion to $ 10 billion, even though the latter gap is larger in absolute terms. If you tried to guess when you would have $ 10 billion by taking 10x the amount of time to $ 1 billion, you would guess 2174 years, off by a factor of nine. Instead, you might say you’re ten percent of the way to $ 10 10 when you have $ 10 1 , equally spacing the percentile markers along the exponent and measuring progress in terms of log(wealth). Since your money is growing perfectly exponentially, multiplying the number of years it takes to go from $ 1 to $ 10 by ten will produce the correct amount of time it will take to go from $ 1 to $ 10 10 When employing linear extrapolations, choosing a suitable metric that better tracks progress, like log wealth over wealth for investment, can make an enormous difference to forecast accuracy. Hanson’s AI timelines estimation methodology Hanson’s preferred method for estimating AI timelines begins with asking experts what percentage of the way to human level performance the field has come in the last n years, and whether progress has been stable, slowing, or accelerating. In Hanson’s convenience sample of his AI acquaintances he reports typical answers of 5-10% of stable progress over 20 years, and gives a similar estimate himself. He then produces an estimate for human-level performance by dividing the 20 year period by the % of progress to produce estimates of 200-400 years. Age of Em: At the rate of progress seen by AI researchers in their subfields over the last 20 years, it would take about two to four centuries for half of these AI subfields to reach human level abilities. As achieving a human level AI probably requires human level abilities in most AI subfields, a broadly capable human level AI probably needs even longer than two to four centuries. Before we engage with the substance of this estimate, we should note that a larger more systematic recent survey using this methodology gives much shorter timeline estimates and more reports of acceleration, as summarized by AI impacts: 372 years (2392), based on responses collected in Robin Hanson’s informal 2012-2017 survey. 36 years (2056), based on all responses colle...