ChatGPT Plus users say OpenAI has added an “All Tools” feature and capabilities for analyzing docs like PDFs, potentially sidelining third-party ChatGPT plugins
OpenAI to release updated version of ChatGPT that gives users access all GPT-4 tools - including browsing and DALL
That shifts the product's center of gravity from a chatbot with optional integrations toward a single work surface for research, creation and document handling.
First-order effects
Plus subscribers can access GPT-4 capabilities such as browsing, DALL·E and document analysis through a unified “All Tools” option, reducing the need to choose individual modes.
Third-party ChatGPT plugin makers whose functions overlap with native browsing, file analysis or image creation face a more immediate risk of being bypassed by users.
Second-order effects
Plugin developers will have greater incentive to offer specialized workflows or external-system connections that OpenAI's built-in tools do not cover, rather than generic in-chat utilities.
A more integrated Plus experience raises the value of the subscription as the place where users complete multi-step knowledge work, while reducing discovery advantages previously available to plugin listings.
Third-order effects
If OpenAI keeps absorbing high-use extensions into the core product, the ChatGPT ecosystem could tilt from a broad plugin marketplace toward a vertically integrated AI workspace with fewer, more specialized partners.
The durable competitive question becomes whether assistant platforms can combine tools without sacrificing user control and third-party differentiation.
The trend: AI assistants are consolidating formerly separate plugins and modes into unified work surfaces for research, creation and file-based tasks.
OpenAI is testing a new version of ChatGPT and gradually rolling it out to Plus users. This full-model version of GPT: 1. Can directly chat about PDFs. You can also chat with data files and other document types. 2. No longer requires selecting a model. …
OpenAI Developer day is going to be very interesting — how many use cases will its core product commoditize? And what applications will they encourage third parties to invest in? GPT-based Sherlocking intensifies!
ChatGPT4 is ready for a new round of major changes. The “All Tools” feature appears to exclude ChatGPT plugins, reflecting the firm's strategic decision to streamline the user experience. Things are happening so quickly that it is hard to keep up. I need a cheat sheet to keep …
🚨ChatGPT just killed many wrapper apps and businesses. Without switching, you can now: - Chat with PDF or any document types - Chat with data files - Browse Internet - Data Analysis - Create images with DALL •E 3 Multimodal war just entered new phase.
ChatGPT now has an All Tools function. Just saw this image on X of some one showing GPT-4 grabbing current data from browsing and then using Dall-E 3 to render the image. Cool! (📸 @ldjnr )
Here's what I love about this. The initial UX where you had to select general vs browsing vs data analysis vs extension was clearly not great. Lots of companies talk about “launch and iterate” but very few are willing to live with sub-optimal (and arguably poor) …
PDF file chat capability: This is a huge blow for many startups that provide information around PDF file chat. These products have shallow moats and are more suitable as a feature rather than standalone products. Faced with the upgrade of OpenAI, competitiveness needs to be ret…
Many startups just died today. Because OpenAI added PDF chat. You can also chat with data files and other document types. We had a wave of products better suited as features rather than stand-alone companies. Wrappers are being squeezed by OpenAI on one side and incumbents on... …
@OliviaSays_ai @deliprao That's fair. In the case of supporting PDFs as in input, is something we were actually “dinged” on for not having in ChatGPT. Even though Code Interpreter does amazing things, it was only Excel/CSVs. So, I feel like this was quite obviously coming.
Note ChatGPT plugins aren't listed as part of this new world where code interpreter and browse mode can co-exist This makes sense to me: some plugins can access private data that could be at risk of exfiltration attacks (as already seen with WebPilot https://simonwillison.net/...…
Browse mode is a vector for prompt injection because malicious instructions can be hid in pages that browsing mode accesses And now those malicious instructions gain access to Python in a sandbox, and the output from that could include further instructions to trigger browsing?
@thealexker And it is those wrappers that inform & inspire OpenAI. One one hand, it sucks that these are time-limited opportunities. On the other hand, some indie hackers want exactly that: make some money, move to the next idea, and keep tinkering. Which, in turn, inspires OpenA…
@thealexker I wonder if we'll see an Amazon sort of model, where: • vendors try a million products • a few succeed • the best products in every category are then reproduced by Amazon. where the best wrappers become base model Chat GPT
The only moats are execution, distribution, and top-of-mindedness (your brand being ingrained in a customer's habit loop). Nothing else really matters. Similar to the painful lesson I wrote about earlier this summer that Jasper went through: https://twitter.com/... But not...
@thealexker This is an issue that I see with quite a lot of startups and services based on a vendor locked concept using a proprietary service or API. The solutions were often very good, what the providers of the API noticed and then used as blueprint for their own offerings. On …
Those “startups” were never alive. Obviously chatting with PDFs was going to be commoditized quickly. If everyone is doing it, and equally well, with nothing particularly distinctive, it's not a thing. Not a new lesson.
OpenAI: “We have provided a cheap API so you can easily build products for your startup on top of ours ☺️” Also OpenAI: “We can and will destroy your business and your entirely livelihood without warning. The rivers will run red with the blood of our loyal customers”
I don't know why there is any surprise. Here's OpenAI's product strategy for the next 2 years: - you will be able to upload anything to ChatGPT - you will be able to link any external service like Gmail, Slack - ChatGPT will have persistent memory, no more multiple chats unless..…
This OpenAI update might even be good for https://pdf.ai/. The market for “Chat with PDF” just blew up with this change. Many people didn't know chatting with PDFs is possible but now they do. Some will be happy with OpenAIs implementation, but power users will be need...
ChatGPT just went FULLY multimodal 🤯 With one update, OpenAI killed 1000s of AI startups. ChatGPT's strategy: Consolidate, Innovate, & Dominate. ChatGPT becomes the ultimate AI super-app combining Midjourney, PDF Chat, Perplexity AI, and advanced Data analysis all in one app. [im…
A lot of AI startups are in trouble today. OpenAI just added PDF chat (slow rollout). You can also chat with data files and other document types. [image]
I'm really surprised to see browsing and code interpreter made available in the same session - feels like a potent vector for creative prompt injection attacks against the combination of the two
Looks like OpenAI is rolling out an “All-Tools mode” update. Folks are getting the features below. All-in-one browsing, analyzis and text->image, no longer separate sessions. Startups are going to take big hits too. OpenAI added PDF chat. [image]