JD com : Explore Academy’s Vega v1 Sets New World Record for GLUE Benchmark
January 14, 2022 at 02:22 am EST
Share
by Yiming Yan
The Vega v1 model proposed by the JDExplore Dream Team beats Microsoft, Facebook, and Stanford University to top the General Language Understanding Evaluation (GLUE) list with an overall average score of 91.3, setting a new world record. GLUE is an important metric to measure natural language processing (NLP) and has been widely adopted across the industry.
Utilizing the paradigm of pre-training and fine-tuning, Vega v1 achieves breakthroughs by using several pre-training innovations such as the efficient parallelized training framework, the innovative model architecture with billions of parameters, and the improved self-supervised signals. The future Vega versions will also integrate trusted artificial intelligence and other technologies to enhance both stability and privacy while constantly improving text understanding capabilities.
The Vega v1 ranked first in four of the nine subtasks, particularly in sentiment analysis tasks The Stanford Sentiment Treebank (SST-2) and Winograd NLI (WNLI), where Vega v1 exceeded the human mind for the first time. The Academy is going to further push forward the research of smart cities, supply chain management, smart retail, and other applications, which will boost the blooming of the digital intelligence industry.
The JDExplore Dream Team is made up of the University of Sydney, Wuhan University, and Beijing University of Aeronautics and Astronautics, taking parts in tests of the GLUE Benchmark consisting of 9 tasks such as question natural language inference (QNLI), quora question pairs (QQP), and named entity recognition (NER).
(yanyiming1@jd.com)
Attachments
Original Link
Original Document
Permalink
Disclaimer
JD.com Inc. published this content on 14 January 2022 and is solely responsible for the information contained therein. Distributed by Public, unedited and unaltered, on 14 January 2022 07:21:04 UTC.
JD.com, Inc. is the No. 2 Chinese consumer Internet sales platform. In parallel to this activity, the group has developed a marketplace to connect third-party sellers with customers. Net sales break down by activity as follows:
- sale of products (85.7%): consumer electronic goods and electrical household goods (60.4% of net sales; computers and peripherals, digital products, mobile phones, TVs, players, loudspeakers, cameras, digital video cameras, games consoles, etc.) and other (39.6%; clothing and accessories, household goods, luxury products, home accessories, personal beauty products, cosmetics, food, media products, leisure goods, sports equipment, etc.);
- services (14.3%).