The problem with Moore's Law



While Moore's Law has fueled the semiconductor industry, it has also fueled this spiral of increasing costs and shrinking fab customer bases. As transistors have shrunk, the cost of fabricating a semiconductor device has grown commensurately. While the fabrication cost per transistor has steadily declined, other expenses have skyrocketed resulting in increased total cost. For example, small features are more susceptible to process variation than larger ones, increasing the range of variation and the proportion of faulty chips. In addition, the smaller the transistor, the more of them that can fit in a given amount of silicon. The result is that circuit complexity has been increasingly outstripping designer productivity, in a phenomenon referred to as Moore's Law's corollary of "compound complexity".

Industry has dealt with these challenges by increasing the engineering effort that goes into each chip. This effort manifests itself as larger design teams, or longer product cycles, and often both at once. The vast majority of this engineering effort is incurred once per chip design, and does not vary with the number of chips produced. Accordingly, this expense is called the non-recurring engineering cost (NRE) of a chip. Industry analysts estimate that the NREs for a typical 90nm standard cell ASIC can range from $5M up to $50M.



Maintaining a particular price per chip in the face of skyrocketing NREs requires larger and larger batches of chips. This is because the single NRE is shared evenly across the population of chips produced. The larger the population, the smaller the impact of the NRE on individual chip cost, so chips produced in large batches cost less than chips produced in small batches. Growing NREs are pushing the line that divides "small" from "large" higher and higher. The result of this situation is that only high-volume chip manufacturers, or those who can sell smaller batches at high prices, can afford to be in the chip business.

Moreover, at the same time that complexity and engineering effort have been soaring, the commercial market has been demanding and rewarding short chip design cycles. This is due to shrinking product lifetimes and the increasing competitive importance of being the first to market with a new product. A technology that succeeds in reducing engineering effort will simultaneously attack the cost of chip preparation as well as its time to market. This research seeks to develop such a technology: one that reaps the benefits of Moore's Law (e.g., high clock speeds, integration) without incurring the downsides (e.g., high NRE costs, long time to market). A viable technology with these characteristics would serve markets that today are economically unreachable.

Brick and Mortar Chips



We propose a system, called brick and mortar, which is designed to allow fabricated ASICs to be used in many different chip designs. In this way, brick and mortar achieves high volume usage of the individual ASIC components while producing small batches of any given chip. The purpose is to reduce the non-recurring engineering costs as much as possible while maintaining, to the largest extent possible, the other benefits of ASICs.

At the heart of the brick and mortar manufacturing technique are two architectural components: bricks, which are mass-produced pieces of silicon containing processor cores, memory arrays, small gate arrays, DSPs, FFT engines, and other IP (intellectual property) blocks; and mortar, an I/O cap, that is a mass-produced silicon substrate containing inter-brick communication infrastructure and I/O support. In the brick and mortar process, engineers design chips by assembling an application-specific layout of bricks. This arrangement of bricks is then bonded, as illustrated below, to the I/O cap that interconnects them.



Applications can execute on this chip exactly as they would on a traditional chip. Because this chip is constructed from discrete dies, the difference between local communication within a functional core and between functional cores is more pronounced. Thus, it is especially critical for performance on such a chip that an application be carefully partitioned and mapped to the functional cores.

There are a number of key advantages brick and mortar chips offer.

These benefits will not come for free. Brick and mortar chips will achieve them only through careful design of the necessary hardware, software, and manufacturing subsystems:

Publications