All OpenAI Responses in the Reddit AMA: What to Expect from Future AI Developments

On Halloween, October 31, 2024, OpenAI held an AMA on Reddit featuring Sam Altman (CEO), Kevin Weil (CPO), Srinivas Narayanan (VP of Engineering), and Mark Chen (SVP of Research). For those unfamiliar, an AMA (Ask Me Anything) is an online discussion, typically on platforms like Reddit, where users can pose questions to experts or notable figures and receive real-time, genuine responses. This format is valued for its transparency and the opportunity to gain insights into the participants’ thoughts and projects.
Specifically, yesterday’s AMA with the OpenAI team covered topics ranging from future plans for artificial general intelligence (AGI) to specific features of current and upcoming OpenAI models.

Here is a detailed summary of the most relevant questions grouped by topic.

Future Developments and Model Improvements

Question: Will OpenAI continue to develop the “o” series models? And what will happen to traditional models like GPT-3, 4, 4o, and future versions?
Kevin Weil’s Response: Both! And we expect that at some point, these paths will converge.

Question: When will the context capacity of GPT-4o, currently limited to 32k tokens, be increased?
Kevin Weil’s Response: We agree it’s limiting, and we are working on improvements in this area.

Question: When will a new text-to-image model be released, given that DALL·E 3 now seems outdated?
Sam Altman’s Response: The next update will be worth the wait, though we don’t have a release date yet.

New Features and Ideas for ChatGPT

Question: What are your thoughts on using ChatGPT for therapy?
Sam Altman’s Response: ChatGPT is not a therapist, but many people find it helpful to talk about their problems. I hope someone develops something specific in this area.

Question: Will ChatGPT ever be able to perform tasks autonomously or initiate conversations?
Kevin Weil’s Response: I think this will be a significant theme in 2025.

Question: What is the most interesting use of ChatGPT you’ve seen?
Sam Altman’s Response: The stories of people discovering the cause of debilitating illnesses and getting treated thanks to AI are incredible. The capability of being a great software engineer is also still underestimated.

Future Projects and Integrations

Question: Do you plan to integrate tools for publishers to check how they appear on ChatGPT?
Sam Altman’s Response: It’s a good idea, and we will discuss it. For now, there are no concrete plans.

Question: Will the memory limits of ChatGPT be increased?
Srinivas Narayanan’s Response: We are working on supporting longer context windows.

Question: Will new capabilities for video input be added to models like Sora?
Kevin Weil’s Response: Yes, Sora is capable of handling video input.

Research and Technological Aspects

Question: Is artificial general intelligence (AGI) achievable with current hardware?
Sam Altman’s Response: We believe it is possible with current hardware.

Question: What are the main challenges in reducing hallucinations in models?
Mark Chen’s Response: We are working on improving the citation of reliable sources and use reinforcement learning to reduce hallucinations. It’s a complex issue because models learn from human-written texts, which sometimes contain uncertain statements.

Question: How can inference costs be reduced to enable more complex chains of thought?
Srinivas Narayanan’s Response: Inference costs are steadily decreasing. Over the past few years, they have dropped by about 10 times.

Personal Opinions and Curiosities

Question: What are your favorite books?
Srinivas Narayanan’s Response: “Life 3.0” by Max Tegmark, though I don’t agree with all of his views on AI.
Sam Altman’s Response: “The Beginning of Infinity” and “Siddhartha”.

Question: What is an important skill for someone who wants to contribute to the AI revolution?
Kevin Weil’s Response: Using AI daily to learn and improve your skills. If you can learn faster than others, you can achieve anything.

Question: What is your bold prediction for 2025?
Sam Altman’s Response: Saturating all benchmarks.

Question: Was there anything that surprised you during the release of ChatGPT?
Sam Altman’s Response: How much people appreciated it, despite the first version being a rough and imprecise prototype. Yet, users kept using it.

Question: If you were 19-year-old developers, what would you do with OpenAI’s APIs next year?
Srinivas Narayanan’s Response: I’d reinvent a favorite app with AI or build something for a future with AI agents.

Originally published at Levysoft.