Starting the Era of 1-bit LLMs – With Microsoft Research

itNet is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}. It matches the full-precision (i.e., FP16 or BF16) Transformer LLM with the same …

Read more

BREAKTHROUGH CMOS N-Type Diamond Transistors

Diamond CMOS needs symmetrical doping control like we have for semiconductor silicon and diamond n-MOS is needed. The n-channel diamond MOSFETs are demonstrated. This work will enable the development of energy-efficient and high-reliability CMOS integrated circuits for high-power electronics, integrated spintronics, and extreme sensors under harsh environments. Currently, p-channel diamond MOSFETs have been extensively developed …

Read more

Ultraviolet Metalenses Mass Produced. Will Enable Future AI Chips

Extreme Ultraviolet lithography for computer chips have been critical to letting us efficiently get better than 14 nanometer computer chips. Deep ultraviolet lithography were used for 14 nanometer feature sizes. China chip companies do not have access to EUV lithography equipment and have pushed deep ultraviolet lithography to 7 nanometer feature sizes. Metalenses are 10,000 …

Read more

Superconducting Magnet Reduces the Cost for a Fusion Reactor by a Factor of 40

A new 20 Tesla Superconducting magnet reduces the cost per watt of a fusion reactor by a factor of almost 40. MIT worked with Commonwealth Fusion Systems, a startup with over $2 billion in funding. The funders of CFS include Temasek Holdings (Singpore), the U.S. Department of Energy, Tiger Global Management, Bill Gates, Google and …

Read more

AI Can Now Forget Copyrighted and Other Material

Researchers at The University of Texas at Austin have developed what they believe is the first machine unlearning method applied to image-based generative AI. This method offers the ability to look under the hood and actively block and remove any violent images or copyrighted works without losing the rest of the information in the model. …

Read more

How to Optimize the Structure and Quality of Thin Film Nobium for Superconducting Circuits

The performance of superconducting microwave circuits is strongly influenced by the material properties of the superconducting film and substrate. While progress has been made in understanding the importance of surface preparation and the effect of surface oxides, the complex effect of superconductor film structure on microwave losses is not yet fully understood. In this study, …

Read more