"50 dollars" distilled s1 comparable to R1: "AI godmother" Li Feifei's legendary AI road
In today's ever-changing technological world, it's safe to say that humans are living in a world that is constantly being disrupted by artificial intelligence. Recently"Godmother of AI."Li Feifei (1962-), PRC actorThe team trained a cloud for less than $50 to rival theDeepSeek-R1and OpenAI o1 inference models?
This is not Onion News, but the latest masterpiece from the Godmother of AI, Fei-Fei Li, Stanford University, the University of Washington, the Allen Artificial Intelligence Laboratory, and others who have joined forces:s1.
It is understood that the s1 model is inIn math and coding aptitude testsmatching performance ofOpenAI's o1cap (a poem)DeepSeek's R1and other cutting-edge inference models are similar. The researchers from Feifei Li's team say that s1 was developed through thedistillationleave it (to sb)Google Inference ModelGemini 2.0 Flash Thinking ExperimentalDistillation. The team used Qwen2.5- 32B-Instruct of Ali Tongyi team as the base model, and finally obtained the s1 model by distilling the experimental version of Google DeepMind's inference model Gemini 2.0 Flash Thinking.
To train s1, the team created a dataset of 1,000 questions (of the carefully selected variety), each accompanied by an answer, and a thought process for the experimental version of Gemini 2.0 Flash Thinking.
Currently.The project paper "Thes1: Simple test-time scaling" has been hooked up to the arXiv, and model s1 is inOpen source on GitHub, the research team provided the data and code to train it.
The news shocked the US tech community as the DeepSeek team hit OpenAI's training fees in the spring before theone-thirtieth. But just less than a month has passed, and now Team Fei-Fei Li is back with theLess than $50.训练出媲美DeepSeekR1的AI inference model,人工智能领域可以说是越来越卷了!
Let's take a look at the legendary AI path of "AI godmother" Feifei Li:
"Godmother of AI" Fei-Fei Lee
Publicly available information indicates that Feifei Li is a Chinese-American scientist.Known as the "Godmother of AI.", has a strong reputation in the field of artificial intelligence. She was born in1976Birth.16 years oldImmigrated to the U.S. with his parents, and with academic excellence entered thePrinceton Universityand ultimately receiveD. in Artificial Intelligence and Computational Neuroscience from the University of California.
Li Feifei (1962-), PRC actorRare is widely respected in both academia and business as the founder of global artificial intelligence, and the ImageNet image dataset, which she conceived and invented in 2006, has become one of the three cornerstones of next-generation AI technology (the other two being GPU and neural network technology). Without ImageNet, there would be no generative AI, just like humans without eyes.
At the age of 33, she earned the title of tenured Stanford Associate Professor, was the first female director of the Stanford Artificial Intelligence Laboratory, Stanford's first Sequoia Chair Professor, and was elected to the U.S. Triad of Academies, where she created the ImageNet dataset, a key catalyst for modern AI. She is also the Director of the Stanford Human-Centered Artificial Intelligence Institute (HAI) and co-founder and Chair of AI4ALL, an organization focused on the growth of diverse talent in AI.
The media now uses"Godmother of AI."This word to call her, she just skimmed her lips, smiled and said, "Well, that's it then." Since there was the title of "AI Godfather", it would not be a bad idea for her to be the "AI Godmother".
World Labs, the spatial intelligence company she recently founded just three months ago, has closed two rounds of funding and has been valued at $1 billion.
As an outstanding representative of the global artificial intelligence field, Feifei Li has not only made outstanding achievements in the academic world, but also led the technological changes in the industrial world. From her birth in Beijing to her development in Silicon Valley, and now she is the "Light of Chinese" and "Godmother of AI", what drives her along the way, let's go into Feifei Li's story together.
Born in Beijing, studied in the United States
Li Feifei was born in Beijing to an intellectual family. Her father, an engineer, and her mother, a teacher, arrived late on the day of her birth in 1976, not because of traffic jams or other accidents, but because he had lost track of time while bird-watching in a park on a whim. He named his daughter Feifei, which he also thought of while bird-watching. Although the mother was a bit angry, she thought it was a good name.
This curiosity of her father's seems to have infected Feifei Li. When she was a child, her father used to take her to the park to watch birds, to the fields to see the buffaloes or to catch insects, which inspired her strong desire to explore the world.
Such a good home education fostered her keen interest in science and technology. As she grew up, her parents encouraged her from time to time to pursue her dreams, especially in the academic field.
In 1992, at the age of 16, Feifei Li decided to travel to the United States to pursue her studies.
When he first arrived in the United States, Feifei Li's father found a job repairing cameras in a Chinese-owned store, where he worked late every day. His mother also found a job as a cashier in a store, doing repetitive and mechanical work for a meager income. In order to supplement her family's income, Feifei Li worked odd jobs every day she was not in school.
She often works as an odd-job worker at a Chinese restaurant, working from 11 a.m. to 11 p.m. for a total of 12 hours a day for $2 an hour.
While working odd jobs at the restaurant, and taking advantage of afternoon shifts, Feifei Li would take advantage of the rare breaks to read the literary masterpieces her mother had shared with her, which the restaurant manager disdained. "He felt that for people like us, imagination was superfluous in life," Li Feifei recalls.
For these Chinese immigrants, who don't even speak English, the class leap is an unattainable dream.
At that time, Li Feifei could hardly speak English, and every day when she went home to do her homework, she had to prepare two dictionaries, one English to Chinese and one Chinese to English, otherwise she could not write her homework.
Despite having little time to study, Fei-Fei Li scored 1250 on the SAT with a perfect score in math. She applied to three colleges, MIT, Princeton, and Rutgers, the State University of New Jersey.
In the end, all three schools sent offers of admission.Princeton University is even offering almost full scholarships.
The news that Fei-Fei Li was going to Princeton was a sensation throughout the community and at one point made the local newspaper.
At Princeton University, she first studied physics. At that time, she faced the challenges of the language barrier and cultural differences, but with hard work and perseverance, she quickly adapted to the new environment and was awarded a full scholarship. During her time at the university, she developed a strong interest in computer science and decided to turn to this field.
After completing her undergraduate studies, Fei Fei Li moved to the California Institute of Technology (Caltech) to pursue a master's degree and a PhD in electrical engineering. At Caltech, she chose computer vision as her research interest, a field that was not widely recognized at the time.
But Li Feifei realized that although image recognition technology has been around for years, there are very few objects that computers can recognize.
In 2005, she received her Ph.D. in Electrical Engineering and began her research in Artificial Intelligence at Stanford University. Her doctoral dissertation focused on How does human visual perception affect machine learning? which laid the foundation for later research.
Fei-Fei Li actively promoted artificial intelligence research during her tenure as a professor at Stanford University. She founded the Stanford Artificial Intelligence Institute (SAIL) and trained a number of outstanding students, including Andrej Karpathy, who went on to work at OpenAI and Tesla, among others.
Fei-Fei Li has chaired several international conferences and published a large number of high-impact academic papers. She has not only made remarkable achievements in academia, but also actively participated in public affairs and advocated for the ethical and social responsibility of AI technology.
ImageNet is a big success
In 2009, Feifei Li and his team launched ImageNet, a dataset containing 15 million labeled images. This project not only provided a rich data base for deep learning models, but also became an important milestone in computer vision research.
ImageNet's dataset covers thousands of categories, enabling computers to learn how to recognize different objects from a large number of samples.The successful implementation of ImageNet has led to the widespread use of computer vision technology and has driven the development of deep learning.
In 2012, deep learning models trained on the ImageNet dataset achieved remarkable results in image classification competitions, marking a new era in deep learning technology. This achievement triggered a worldwide boom in research on deep learning and computer vision.
In 2017, Fei-Fei Li joined Google Cloud as Chief Scientist, responsible for driving the company's AI strategy.During her time at Google, she worked on several important projects in areas including autonomous driving and medical image analysis.
She utilized her expertise in computer vision to make significant contributions to the development of Google Cloud. During her time at Google, Fei-Fei Li has not only focused on technology development, but also on promoting AI ethics and social responsibility. She believes that as AI technology develops, we must think carefully about its potential impacts to ensure that it brings positive changes to human society.
During her time at Google, she has said:"AI has no borders, and the well-being of AI has no borders."This statement reflects her deep understanding of the globalization of AI.
Space intelligence for the future
In 2024, Fei-Fei Li left Google to start his own company, World Labs (Spatial Intelligence), focused on elevating AI models from 2D pixel planes to full 3D worlds.
The company's goal is to build Large World Models (LWMs) to perceive, generate and interact with the 3D world. This field is considered the next frontier in AI development, and is as important as language processing. In just a few months, World Labs has secured more than $230 million in funding, with a valuation exceeding $1 billion.
This success not only demonstrates the market's expectations of the new company under Fei Fei Li's leadership, but also reflects her enormous influence in the industry.
Feifei Li believes that spatial intelligence will change the way we interact with the world, enabling AI to better understand and generate information in three-dimensional environments. In her opinion, vision is the foundation of intelligence generation, and the cycle between "seeing" and "doing" is accelerating the learning process of robots. Therefore, she hopes to promote the development of this field through World Labs to realize a higher level of spatial intelligence.
She has mentioned, "In the future, we will see AI not only recognizing images, but also understanding the story behind them." This means that AI will be able to process more complex information, thus revolutionizing various industries.
As an important figure in the technology industry, Feifei Li has always been concerned about the impact of AI technology on society. On several occasions, she emphasized that tech companies should take social responsibility to ensure that the development of technology is in the interests of humanity. She called on the tech community to pay more attention to AI ethical issues, including data privacy, algorithmic bias and other issues.
"We have to make sure that our technology is fair and transparent," says Fei-Fei Li, "Only then can we truly realize that technology is in the service of humanity."
Fei-Fei Li has said, "As I also wrote in my book, my whole academic journey is really a passion to find the North Star, and I also believe that these North Stars are crucial to the development of our field. After I graduated from graduate school, my North Star was telling image stories, which is very important for visual intelligence. And visual intelligence is an important part of AI and AGI. So when Andrej and Justin did that, I thought, oh my God, that's my life's dream! What do I do next? It came faster than I expected, I thought it would be another 100 years."
We see.Feifei Li is not only the "godmother of AI" leading the development of science and technology, but also a girl who is brave and persistent in pursuing the "Polaris dream".I believe her life story will inspire countless dreamers to move forward with courage!
Note: Some source references: https://mp.weixin.qq.com/s/UWZEH056Tn84BQ9tGJhU2w
© Copyright notes
The copyright of the article belongs to the author, please do not reprint without permission.
Related posts
No comments...