avatarPaul Pallaghy, PhD

Free AI web copilot to create summaries, insights and extended knowledge, download it at here

10016

Abstract

tely what we were aiming for the last 7 decades but never thought we’d actually see.</p><p id="e314">I’ve actually been predicting human-like NLU since the late 1990s to occur around 2020. I got that right. I always knew it didn’t need quantum computing. Just something ‘search-like’ that could interpret the knowledge embedded in the web text corpus. That was my thinking.</p><p id="f757">But I didn’t think we would go from almost nothing to arguably near super intelligent in 5 years!</p><p id="4aae">GPT-3 way out performed GPT-2, for example in correctly explaining common sense reasoning tests.</p><p id="fc04">Now GPT-4 has leap-frogged GPT-3, probably most impressively in the step-by-step carrying out of instructions.</p><p id="21ed">Yeah, in an accounting, of all things, demo.</p><p id="3bc0">LOL.</p><p id="057f">Now to absorb this . .</p><figure id="ca49"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*tpy5rSZOhCMubFzlKhAznw.png"><figcaption></figcaption></figure><p id="5ee4">Nice touch <i>OpenAI </i>. . LOL.</p><figure id="8524"><img src="https://cdn-images-1.readmedium.com/v2/resize:fit:800/1*Fkr26odK9pdfVFbLq13xsw.png"><figcaption></figcaption></figure><p id="9e4f">PS. My post is entirely me. Sorry. :)</p><h1 id="7009">Here’s today’s OpenAI webinar clip</h1><p id="6da9">I’ve started it at the awesome accounting demo. Feel free to rewind for all of it.</p><div id="4485" class="link-block"> <a href="https://www.youtube.com/live/outcGtbnMuQ?feature=share&amp;t=1136"> <div> <div> <h2>GPT-4 Developer Livestream</h2> <div><h3>Join Greg Brockman, President and Co-Founder of OpenAI, at 1 pm PT for a developer demo showcasing GPT-4 and some of…</h3></div> <div><p>www.youtube.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*wtOv8jN0gYEzHYdU)"></div> </div> </div> </a> </div><h2 id="f735">My recent posts</h2><div id="e460" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/april-2023-did-we-really-need-another-war-of-the-worlds-movie-oh-yeah-378842508d8b"> <div> <div> <h2>April 2023. Did we really need another War of the Worlds movie? Oh yeah.</h2> <div><h3>We sure did. None of the 3 major recent remakes fully did justice to the original book or movie. IMO. Fingers crossed…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*QcD5adPh1E4K6HHSzc-KbQ.png)"></div> </div> </div> </a> </div><div id="2fa3" class="link-block"> <a href="https://readmedium.com/scientists-often-say-our-theories-are-just-models-wrong-2c050e38ad52"> <div> <div> <h2>Scientists often say our theories are ‘just models’. Wrong!</h2> <div><h3>Of course it depends on the discipline of science we are talking about.</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*ACS3MrdLgrYchCQ6Zgvjkw.png)"></div> </div> </div> </a> </div><div id="690e" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/how-exactly-did-chatgpt-learn-to-do-arithmetic-a07d24bab4d4"> <div> <div> <h2>How exactly did ChatGPT learn to do arithmetic?</h2> <div><h3>If you’ve been following the GPT story for a while through its updates — and especially the excitement of ChatGPT and…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*SvatcgbjMS5lzW_b.png)"></div> </div> </div> </a> </div><h2 id="4ebc">Fav posts of mine</h2><div id="bc4f" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/the-ai-neuroscience-of-severance-2022-appletv-s-hit-chill-psychological-thriller-ceff6e9bfd48"> <div> <div> <h2>The AI & neuroscience of Severance (2022), AppleTV+’s hit chill psychological-thriller</h2> <div><h3>In arguably the best new TV show of 2022, Severance, from Ben Stiller (Night At The Museum) as producer and newbie…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*yCizFnquhnKeiA24.jpg)"></div> </div> </div> </a> </div><div id="f768" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/my-top-25-most-fascinating-innovation-science-pop-sci-biography-books-of-all-time-1122ba803c1a"> <div> <div> <h2>My TOP 25 most fascinating Innovation & Science pop sci / biography books OF ALL TIME</h2> <div><h3>These are all incredibly compelling reads, recounting epic personal struggles towards famous — and a few virtually…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*8WwRCaTjNf8CSS5-uXtOeg.png)"></div> </div> </div> </a> </div><div id="674e" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/heres-what-ai-the-world-looks-like-in-2033-989aae37b1db"> <div> <div> <h2>Here’s what AI & the world looks like in 2033</h2> <div><h3>As an AI developer, PhD physicist / systems engineer and moderate futurist . . I think there’s a decent chance we…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*s7F9Q8YC1ZcmgeKa.jpg)"></div> </div> </div> </a> </div><div id="be66" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/consciousness-means-different-things-to-different-people-and-experts-e929c60bbd4c"> <div> <div> <h2>‘Consciousness’ means different things to different people . . and experts</h2> <div><h3>With the appearance of AI like ChatGPT, I’ve been chatting to a lot of folks about what they mean by self-awareness…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*-Kk2QSEA6iwsdzUV)"></div> </div> </div> </a> </div><div id="73c0" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/the-ai-humanity-of-waking-up-to-realise-who-you-are-5b0b834ded3a"> <div> <div> <h2>The AI & humanity of waking up to realise who you are</h2> <div><h3>One of the most fascinating realizations I’ve had as an AI researcher, starting perhaps more than 25 years ago, was…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*[email protected])"></div> </div> </div> </a> </div><div id="b722" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/unprecedented-impact-of-emerging-ai-green-energy-agtech-biotech-aerospace-think-gdp-x10-b410ce1e41fd"> <div> <div> <h2>GDP x10 via concerted breakthroughs in AI, autonomy, green energy, agtech & aerospace</h2> <div><h3>We’ve all heard it before. Over-promised 21st century technologies that will ‘lead to vast prosperity’, the truly…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*HhQ8hzWFeEGnnbh1.jpg)"></div> </div> </div> </a> </div><div id="2018" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/i-didnt-get-excited-about-evs-until-i-learned-this-simple-fact-about-fuel-use-in-cars-vs-power-938040e328ae"> <div> <div> <h2>I didn’t get truly excited about EVs until I learned this simple fact about fuel use in cars vs…</h2> <div><h3>EVs sounded cool in the 2010s but the lack of renewable energy back then made them seem of little point.</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*JyHVnyNZYI_c_r8T.jpg)"></div> </div> </div> </a> </div><div id="1684" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/chatgpt-the-stunningly-simple-key-to-the-emergence-of-understanding-41fcf7f67ba7"> <div> <div> <h2>ChatGPT: the stunningly simple key to the emergence of understanding</h2> <div><h3>We all are wondering how ChatGPT can understand us so well — and generate reams of text — given that it is only trained…</h3></div> <div><p>me

Options

dium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*Y59j46BtOIylbC-V4mSNIQ.png)"></div> </div> </div> </a> </div><div id="606d" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/chatgpt-the-hard-part-of-agi-is-now-done-3179d31a7277"> <div> <div> <h2>ChatGPT: AGI by 2024, the hard part is now done</h2> <div><h3>ChatGPT is not yet AGI, so-called, artificial general intelligence. And it may have some fundamental limitations. But…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*bhZFNNjKSz35U3laULHGEA.png)"></div> </div> </div> </a> </div><div id="590e" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/the-entire-field-of-ai-is-being-professionally-gaslighted-by-gary-marcus-and-noam-chomsky-c08aa1e4c6f0"> <div> <div> <h2>The entire field of AI is being professionally gaslighted by Noam Chomsky and Gary Marcus</h2> <div><h3>I’m normally a calm, congenial and open-minded AI engineer, startup guy & PhD researcher.</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*GMsQw8DsMro4hIYT9GqXFQ.jpeg)"></div> </div> </div> </a> </div><h2 id="f52c">Here’s my other articles on AI, ChatGPT & androids</h2><div id="4e9f" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/the-crucial-chatgpt-capability-nobody-is-talking-about-24066f18b815"> <div> <div> <h2>The ChatGPT capability that’s bigger than content authoring</h2> <div><h3>The new generative AI tool ChatGPT is rightly exciting the world as a near supernatural generator of text. But there’s…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*mlU6xkEQNYtmWxi9)"></div> </div> </div> </a> </div><div id="3345" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/tesla-investor-day-the-jaw-dropping-plan-to-fix-earth-thru-to-2030-deba05e5b6b4"> <div> <div> <h2>Tesla Investor Day: the jaw-dropping plan to fix earth thru to 2030</h2> <div><h3>We were treated to a fascinating — and realistic — plan for how to roll out enough gigafactories, renewable energy…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*uEwpYzNTyeFXGUd9eMQscQ.png)"></div> </div> </div> </a> </div><div id="a0fc" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/heres-what-ai-the-world-looks-like-in-2033-989aae37b1db"> <div> <div> <h2>Here’s what AI & the world looks like in 2033</h2> <div><h3>As an AI developer, PhD physicist / systems engineer and moderate futurist . . I think there’s a decent chance we…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*s7F9Q8YC1ZcmgeKa.jpg)"></div> </div> </div> </a> </div><div id="c043" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/chatgpt-the-hard-part-of-agi-is-now-done-3179d31a7277"> <div> <div> <h2>ChatGPT: AGI by 2024, the hard part is now done</h2> <div><h3>ChatGPT is not yet AGI, so-called, artificial general intelligence. And it may have some fundamental limitations. But…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/1*bhZFNNjKSz35U3laULHGEA.png)"></div> </div> </div> </a> </div><div id="f457" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/what-the-naysayers-got-ludicrously-wrong-about-teslas-humanoid-android-bot-and-ai-121d11f45bbb"> <div> <div> <h2>DEBUNKING the naysayers on Tesla’s humanoid android bot & AI</h2> <div><h3>I make the case here, as a PhD AI guy, that the naysayers made two giant mistakes last fall concerning AI Day II and…</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*fi0HdotVC7gm9Y9a)"></div> </div> </div> </a> </div><div id="c52f" class="link-block"> <a href="https://medium.com/@paul.k.pallaghy/there-is-no-ai-winter-3-0-fsd-androids-agi-543d583698a5"> <div> <div> <h2>There is no AI winter 3.0: FSD, androids & AGI.</h2> <div><h3>There will be no Electricity Winter, will there?</h3></div> <div><p>medium.com</p></div> </div> <div> <div style="background-image: url(https://miro.readmedium.com/v2/resize:fit:320/0*nvcooHItJaup3u25.jpg)"></div> </div> </div> </a> </div><p id="041a"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-enables-smart-apps-but-the-bar-is-now-sky-high-for-ai-b32a8df2d446?sk=ae47e9c6f6eb51c9f0b2efc78e8240ba">ChatGPT enables smart apps but the bar is now sky-high for AI</a></p><p id="0bb7"><a href="https://medium.com/@paul.k.pallaghy/5-reasons-chatgpt-ai-is-not-wasteful-of-energy-6c2a6d0619c8?sk=6708c396ae8a72b0c4e2fc61760c0a37">ChatGPT is not wasteful of energy: 5 reasons</a></p><p id="409d"><a href="https://medium.com/@paul.k.pallaghy/the-crucial-chatgpt-capability-nobody-is-talking-about-24066f18b815?sk=07a850ade1877d3ad3be67f8c8322893">The crucial ChatGPT capability nobody is talking about</a></p><p id="9670"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-gary-marcus-noam-chomsky-are-still-in-full-delusion-mode-97278bc4642f?sk=8795ad17051688e5806c586351a86a5f">ChatGPT: Gary Marcus & Noam Chomsky are STILL in full delusion-mode</a></p><p id="3c5f"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-writes-pretty-good-stand-up-comedy-lol-91ca03837fd1?sk=28f775dda753cac2ec0f6aa72805bca0">ChatGPT writes some pretty good stand-up comedy. LOL.</a></p><p id="1c04"><a href="https://medium.com/@paul.k.pallaghy/the-entire-field-of-ai-is-being-professionally-gaslighted-by-gary-marcus-and-noam-chomsky-c08aa1e4c6f0?sk=7eacbb941e8bbe1a24a6d89cd7df42a9">The entire field of AI is being professionally gaslighted by Noam Chomsky and Gary Marcus</a></p><p id="607a"><a href="https://medium.com/@paul.k.pallaghy/the-brain-is-way-more-like-chatgpt-than-symbolic-ai-gary-marcus-noam-chomsky-8a7a0d17f8c1?sk=10313e0ad44dcd36653eed7388923f68">The brain is WAY more like ChatGPT than symbolic AI: Gary Marcus? Noam Chomsky?</a></p><p id="b36d"><a href="https://medium.com/@paul.k.pallaghy/consciousness-means-different-things-to-different-people-and-experts-e929c60bbd4c?sk=eb2f6919bf38f74acbb6956821d2108a">‘Consciousness’ means different things to different people . . and experts</a></p><p id="f95a"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-the-stunningly-simple-key-to-the-emergence-of-understanding-41fcf7f67ba7?sk=ba34eab56b223d2a9b5a047f82d58fd0">ChatGPT: the stunningly simple key to the emergence of understanding</a></p><p id="3354"><a href="https://medium.com/@paul.k.pallaghy/enough-already-heres-a-balanced-view-on-agi-via-llms-like-gpt-3-20cb950b23a2?sk=316f22dd4783e2eaf2865ec18723dab5">Enough already! Here’s a balanced view on human-like AGI via LLMs like GPT-3</a></p><p id="9538"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-the-hard-part-of-agi-is-now-done-3179d31a7277?sk=a5dd5bef3073dff4b8e508175116cc92">ChatGPT: AGI by 2024, the hard part is now done</a></p><p id="29fa"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-is-awesome-but-dont-trust-it-on-quotes-lol-5f0729390aaf?sk=128d0277de1487e8c0df46706fcb6fd9">ChatGPT is awesome. But here’s a failure mode I discovered. LOL.</a></p><p id="d5f8"><a href="https://medium.com/@paul.k.pallaghy/revisiting-emergence-of-intelligence-in-chatgpt-4a8ac6da4e44?sk=206ddff556ccd455fb7a37b95ba1b2ba">Revisiting emergence of intelligence in ChatGPT</a></p><p id="1434"><a href="https://medium.com/@paul.k.pallaghy/emergence-of-understanding-in-ai-gpt-3-wishful-thinking-or-functional-or-real-and-how-b18f268c042?sk=671cb89610993e76f97e369f175cd61e">Emergence of understanding in GPT-3: Wishful thinking or functional or ‘real’ and how? Centers of understanding.</a></p><p id="041c"><a href="https://medium.com/@paul.k.pallaghy/agi-generative-ai-like-chatgpt-are-almost-everything-now-heres-why-9ea6228d2b2?sk=a1604ee9cdecf0a4ddd4882cd5ff751a">AGI & generative AI like ChatGPT are (almost) everything now: here’s why</a></p><p id="11f3"><a href="https://medium.com/@paul.k.pallaghy/chatgpt-is-an-inflection-moment-in-human-history-that-debates-cant-diminish-a035df1ff6b4?sk=338d2324c8e5d3d95e9ff4086e171e09">ChatGPT is an inflection moment in human history that debates can’t diminish</a></p></article></body>

GPT-4 is here. An AI researcher’s take.

Prepare to be floored. GPT-4 is out now. As of March 14th 2023. We’re talking virtually alien technology.

I’ve been working on NLU (natural language understanding) off-and-on for 25 years. Trying to build parsers that break the famous Turing Test.

The Turing Test is smashed.

I don’t think anyone needs to bother actually running a test.

It’s self-evident that that measuring stick is irrelevant now. GPT-4 might fail the test because it’s too good at being human. It’s more like: is it super intelligence?

Practical updates? Think 50-page prompts. Incredible. That means you can get GPT to query or summarize a decent proportion of an entire book in one call.

Greg Brockman | COO / Co-founder / President OpenAI

Here’s the summary:

  • Yes: 50-page prompts (input text) and 50-page completions (output)
  • ‘Factuality’ is 40% up (less hallucination).
  • Accuracy is way up. Way better than GPT-3 or 3.5. GPT-4 gets an A or B on almost any exam. This is documented. For a dozen real life exams.
  • And GPT . . now accepts images as input, as well as text!
  • Working with programming code jumps another level.
  • Do not miss the tax accounting demo. Yes, tax. It demonstrates we’re in a new age. Virtually AGI.
  • And BTW, Bing is already using GPT-4 as some guessed.

The release notes and white papers that come with GPT-4 are immense and exhilarating.

Here’s my very quick first take as a PhD deep learning engineer . .

Demo of GPT-4 | OpenAI

Wow

It’s an impressive update and opens entire new possibilities, particularly with the large prompt size increase and — soon — accepting images.

Think, in addition to generating reports, essays and other content:

  • summarizing entire chapters & books
  • every programmer’s assistant
  • cheap robot machine vision
  • business intelligence via screengrabs
  • your personal decoder of legal gobbledygook of all types
  • the engine of early AGI

It’s kind of mesmerizing.

I think a common research application will be to pass GPT chapter-at-a-time of PDF books and ask it the questions that are needful to you.

It’s available in ChatGPT Plus or via API subscription in the playground (mode = chat, NOT mode = complete, model = gpt4) now, but the API itself is initially pretty pricey (see below).

This will come down, we can count on that, OpenAI have promised that. Remember how GPT-3 came down by a factor of 10 in price around 2 months ago? They want to lock in their market.

Probably the only thing missing — which would require some sort of a major architecture change — is enabling better semantic search with references/links reported. A bibliography. I can imagine that OpenAI might be leaving this to Microsoft perhaps to give their partner an exclusive advantage via an yet-to-come double upgraded Bing that fundamentally uses GPT-4 (??).

In any case, GPT-4 will be hugely beneficial for the world.

Model size?

BTW: What we don’t know yet is the size of the model . . . . ahhhhh, wait . . OK . . EDIT they’re keeping that a proprietary secret. From competitors. A little touch of business nous. And to make it harder for nefarious players to reproduce.

OK. First time they’ve done that. The last vestiges of the ‘Open’ of OpenAI have dropped. At least we get to pay to use the API.

50-page prompts!

That’s the biggest single feature for me.

Yes it means we can give large documents in one call and get GPT to do anything with it.

Summaries. Q&A. Essays. Analysis. Problem solving.

And the output is much larger too, it seems the same 50-page size as input ( = 25,000 words).

Image input

Here’s something we got a hint of a few days ago: GPT-4 will — incredibly — be multi-modal: accept input text and images although the image option will be a few weeks away but it was impressively demoed. There are no current plans to output images.

The example their webcast/blog gives is the ID of the items in the image by GPT-4 and answering ‘what is funny about the image’:

INPUT What is funny about this image? Describe it panel by panel.

OUTPUT The image shows a package for a “Lightning Cable” adapter with three panels.

Panel 1: A smartphone with a VGA connector (a large, blue, 15-pin connector typically used for computer monitors) plugged into its charging port.

Panel 2: The package for the “Lightning Cable” adapter with a picture of a VGA connector on it.

Panel 3: A close-up of the VGA connector with a small Lightning connector (used for charging iPhones and other Apple devices) at the end.

The humor in this image comes from the absurdity of plugging a large, outdated VGA connector into a small, modern smartphone charging port.

Impressive!

Endless possibilities.

Working with code

GPT-4 will re-write code in response to an error message generated by the compiler/interpreter.

Hello! I’m getting giddy. That demo on the webcast is incredible.

The accounting demo is the real winner

This will blow your socks off.

In the OpenAI webcast on YouTube, GPT-4 wades through a dozen pages of horrific tax law to calculate a couple’s tax liability taking 4 or 5 clauses – and the year – into consideration.

And explains why and shows all working, conducting flawless arithmetic (see below).

This is virtually non-conscious AGI. It’s the AI PA we’ve been waiting for.

This company should be worth more than $29B. Every human on earth would be nuts to not use it to speed up their work.

Ironically, the ‘ boring’ tax accounting demo proves we are in a new era.

Separate ‘system’ steering & resource input

Now you can separate what is the instructions — known as ‘system’ steering — from an optional resource text.

In the past you just merged that together. Now it’s clearer to GPT what you are intending.

Scoring highly on everything human-like.

GPT-4 now hugely improves on ChatGPT and GPT3 on AI text metrics and doing human exams at mostly A or B levels.

On average GPT-4 is in the top 10% of human test takers. GPT-3 was in the bottom 10%.

That’s hugely better than GPT-3 and just incredibly impressive.

Less hallucination

GPT-4 demonstrates 40% higher factuality than GPT-3.5.

API Pricing

From the OpenAI email invite I got:

gpt-4 with an 8K context window (about 13 pages of text) will cost $0.03 per 1K prompt tokens, and $0.06 per 1K completion tokens.

gpt-4–32k with a 32K context window (about 52 pages of text) will cost $0.06 per 1K prompt tokens, and $0.12 per 1K completion tokens.

That’s fairly steep but expected to come down over time.

AGI

Non-conscious AGI is now less than a year away IMO, depending on how fussy you are.

Concluding remarks

The world is correctly going nuts over GPT, and soon specifically over GPT-4.

As an NLU researcher it’s definitely what we were aiming for the last 7 decades but never thought we’d actually see.

I’ve actually been predicting human-like NLU since the late 1990s to occur around 2020. I got that right. I always knew it didn’t need quantum computing. Just something ‘search-like’ that could interpret the knowledge embedded in the web text corpus. That was my thinking.

But I didn’t think we would go from almost nothing to arguably near super intelligent in 5 years!

GPT-3 way out performed GPT-2, for example in correctly explaining common sense reasoning tests.

Now GPT-4 has leap-frogged GPT-3, probably most impressively in the step-by-step carrying out of instructions.

Yeah, in an accounting, of all things, demo.

LOL.

Now to absorb this . .

Nice touch OpenAI . . LOL.

PS. My post is entirely me. Sorry. :)

Here’s today’s OpenAI webinar clip

I’ve started it at the awesome accounting demo. Feel free to rewind for all of it.

My recent posts

Fav posts of mine

Here’s my other articles on AI, ChatGPT & androids

ChatGPT enables smart apps but the bar is now sky-high for AI

ChatGPT is not wasteful of energy: 5 reasons

The crucial ChatGPT capability nobody is talking about

ChatGPT: Gary Marcus & Noam Chomsky are STILL in full delusion-mode

ChatGPT writes some pretty good stand-up comedy. LOL.

The entire field of AI is being professionally gaslighted by Noam Chomsky and Gary Marcus

The brain is WAY more like ChatGPT than symbolic AI: Gary Marcus? Noam Chomsky?

‘Consciousness’ means different things to different people . . and experts

ChatGPT: the stunningly simple key to the emergence of understanding

Enough already! Here’s a balanced view on human-like AGI via LLMs like GPT-3

ChatGPT: AGI by 2024, the hard part is now done

ChatGPT is awesome. But here’s a failure mode I discovered. LOL.

Revisiting emergence of intelligence in ChatGPT

Emergence of understanding in GPT-3: Wishful thinking or functional or ‘real’ and how? Centers of understanding.

AGI & generative AI like ChatGPT are (almost) everything now: here’s why

ChatGPT is an inflection moment in human history that debates can’t diminish

Gpt 4
Gpt 3
ChatGPT
AI
Machine Learning
Recommended from ReadMedium