>> GOOD MORNING AND WELCOME TO DEVDAY. THANKS FOR BEING HERE IN SAN FRANCISCO, THE CITY WHERE OPENAI STARTED AND WHERE WE'RE COMMITTED TO BUILDING THE FUTURE OF AI. IT'S BEEN ALMOST TWO YEARS SINCE OUR VERY FIRST DEVDAY. WE AND MOST IMPORTANTLY ALL OF YOU, HAVE COME A LONG WAY SINCE THEN. BACK IN 2023, WE HAD 2 MILLION DEVELOPERS AND 100 MILLION WEEKLY CHATGPT USERS. AND WE WERE PROCESSING ABOUT 300 MILLION TOKENS PER MINUTE ON OUR API. THAT FELT LIKE A LOT AT THE TIME. TODAY, 4 MILLION DEVELOPERS HAVE BUILT WITH OPENAI. AND MORE THAN 800 MILLION PEOPLE NOW USE CHATGPT EVERY WEEK. AND WE PROCESS OVER 6 BILLION TOKENS PER MINUTE ON THE API. AI HAS GONE FROM SOMETHING PEOPLE PLAY WITH TO SOMETHING PEOPLE BUILD WITH EVERY DAY. NOW BEFORE WE GET INTO ALL THE ANNOUNCEMENTS, WE WANT TO DO SOMETHING FUN. ON THE SCREEN BEHIND ME ARE THE NAMES OF DEVELOPERS IN THE ROOM TODAY WHO'VE BUILT APPS ON OUR PLATFORM THAT HAVE CROSSED SOME INCREDIBLE MILESTONES -- 10 BILLION, 100 BILLION, EVEN A TRILLION TOKENS PROCESSED. LET'S GIVE THEM A ROUND OF APPLAUSE. ON BEHALF OF ALL OF US AT OPENAI, THANK YOU. YOU'RE THE ONES PUSHING THE FUTURE FORWARD. AND SEEING THIS MAKES ME SO OPTIMISTIC ABOUT WHAT COMES NEXT. SO WHILE IT'S EXCITING TO CELEBRATE HOW FAR WE'VE COME ALREADY. WE'RE STILL SO EARLY ON THIS JOURNEY. AND TODAY, WE'RE GOING TO FOCUS ON WHAT MATTERS MOST TO YOU: HOW WE'RE MAKING IT EASIER TO BUILD WITH AI. WE'VE BEEN LISTENING TO DEVELOPERS━HEARING WHERE YOU'RE GETTING STUCK, AND WHERE YOU WANT TO BUILD NEXT. WE HAVE FOUR THINGS FOR YOU TODAY. WE'RE GOING TO SHOW YOU HOW WE'RE MAKING IT POSSIBLE TO BUILD APPS INSIDE OF CHATGPT. AND HOW WE CAN HELP YOU GET A LOT OF DISTRIBUTIONS. WE'RE GOING TO SHOW YOU HOW BUILDING AGENTS IS GOING TO BE MUCH FASTER, AND BETTER. YOU'LL SEE HOW WE'RE MAKING IT EASIER TO WRITE SOFTWARE, TAKING ON THE REPETITIVE PARTS OF CODING SO YOU CAN FOCUS ON SYSTEMS AND CREATIVITY. AND UNDERNEATH ALL OF THIS, WE'LL GIVE YOU UPDATES TO MODELS AND APIS TO SUPPORT WHATEVER YOU'RE BUILDING. THIS IS THE BEST TIME IN HISTORY TO BE A BUILDER. IT HAS NEVER BEEN FASTER TO GO FROM IDEA TO PRODUCT. YOU CAN FEEL THE ACCELERATION. TO GET US STARTED, LET'S TAKE A LOOK AT APPS INSIDE CHATGPT. WE'RE BUILDING CHATGPT TO HELP PEOPLE MAKE PROGRESS. TO BE MORE PRODUCTIVE, MORE INVENTIVE, AND TO LEARN FASTER. WE ARE CONTINUOUSLY AMAZED BY THE CREATIVE WAYS PEOPLE ARE USING IT. AND SINCE OUR FIRST DEVDAY, WE'VE BEEN WORKING TO OPEN UP CHATGPT TO DEVELOPERS. WE'VE LAUNCHED CAPABILITIES LIKE GPTS AND ADOPTED STANDARDS LIKE MCP, MAKING IT POSSIBLE FOR DEVELOPERS TO CONNECT CHATGPT TO A WIDE VARIETY OF APPLICATIONS. SOME OF IT WORKED. SOME OF IT DIDN'T. BUT WE'VE LEARNED A LOT. AND TODAY, WE'RE OPENING UP CHATGPT FOR DEVELOPERS TO BUILD APPS INSIDE OF CHATGPT. THIS WILL ENABLE A NEW GENERATION OF APPS THAT ARE INTERACTIVE, ADAPTIVE AND PERSONALIZED THAT YOU CAN CHAT WITH. TO BUILD THEM, WE'RE LAUNCHING A NEW APPS SDK, NOW AVAILABLE IN PREVIEW. START BE TODAY. WITH THE APPS SDK, YOU GET THE FULL STACK, YOU CAN CONNECT YOUR DATA, TRIGGER ACTIONS, AND RENDER A FULLY INTERACTIVE UI. AND MORE. THE APPS SDK IS BUILT ON MCP. YOU HAVE FULL CONTROL OVER YOUR BACKEND LOGIC AND FRONTEND UI. WE'VE PUBLISHED THE STANDARD SO ANYONE CAN INTEGRATE THE APPS SDK. WHEN YOU BUILD WITH THE APPS SDK, YOUR APPS CAN REACH HUNDREDS OF MILLIONS OF CHATGPT USERS. THIS WILL BE A BIG DEAL FOR HOW DEVELOPERS RAPIDLY SCALE PRODUCTS. >> THANK YOU. YOU'RE WELCOME. IF A USER IS ALREADY SUBSCRIBED TO YOUR EXISTING PRODUCT THEY CAN LOG IN, RIGHT FROM THE CONVERSATION. IN THE FUTURE, WE'LL SUPPORT MULTIPLE WAYS TO MONETIZE, INCLUDING THE NEW AGENTIC COMMERCE PROTOCOL THAT OFFERS INSTANT CHECKOUT RIGHT INSIDE CHATGPT. LET'S TAKE A LOOK AT A FEW EXAMPLES. WHEN SOMEONE'S USING CHATGPT, THEY'LL BE ABLE TO FIND AN APP BY ASKING FOR IT BY NAME. FOR EXAMPLE, YOU COULD UPLOAD A SKETCH OF A PRODUCT FLOW TO CHATGPT AND SAY "FIGMA, TURN THIS SKETCH INTO A WORKABLE DIAGRAM." THE FIGMA APP WILL RESPOND AND COMPLETE THE ACTION. AND YOU'LL BE ABLE TO LAUNCH FIGJAM FROM CHATGPT IF YOU WANT TO ITERATE FURTHER. WE'RE ALSO MAKING APPS DISCOVERABLE RIGHT IN THE CONVERSATION. WHEN A USER ASKS FOR SOMETHING WE CAN SURFACE A RELEVANT APP AS A SUGGESTION. SO WHEN A USER SAYS THEY NEED A PLAYLIST FOR THEIR PARTY THIS WEEKEND, CHATGPT CAN RECOMMEND BUILDING IT IN SPOTIFY. IT'S AN EASY WAY TO FIND THE RIGHT APP AT THE RIGHT TIME. AND GIVES DEVELOPERS A WHOLE NEW WAY TO GET DISCOVERED. NOW I WANT TO INVITE ALEXI TO THE STAGE TO SHOW YOU A LIVE DEMO. >> I'M ALEXI, A SOFTWARE ENGINEER ON CHATGPT WHO HELPED BUILD THIS. I'M EXCITED TO SHOWCASE SOME OF THE FIRST APPS USERS WILL BE ABLE TO INTERACT WITH DIRECTLY. THE MAGIC OF THESE APPS IS COMBINING THEIR RICH INTERACTIVE VISUALS WITH THE POWER OF CHATGPT. LET'S START WITH COURSERA. LET'S SAY I WANT TO LEARN ABOUT UX DESIGN. I CAN ASK THE COURSERA APP IN CHATGPT TO HELP ME LEARN ABOUT THIS. COURSERA, TEACH ME SOMETHING ABOUT MACHINE LEARNING. SINCE THIS IS MY FIRST TIME USING COURSERA IN CHATGPT, I'LL NEED TO CONSENT TO CONNECT. THE NEXT TIME I USE IT, I'LL BE ABLE TO DIVE IN IMMEDIATELY. YOU'LL NOTICE I ASKED CHATGPT FOR THE COURSERA APP DIRECTLY, BUT CHATGPT CAN ALSO SUGGEST APPS IF RELEVANT TO THE CONVERSATION. APPS IN CHATGPT ARE DISPLAYED INLINE WITH THE CONVERSATION AND CAN SUPPORT ANYTHING THAT YOU CAN RENDER ON THE WEB, LIKE VIDEO SHOWN HERE. APPS SDK ALSO SUPPORTS PICTURE-IN-PICTURE OR EXPANDING TO A FULLSCREEN VIDEO LAYOUT. NOW THAT I HAVE MY COURSE UP, LET'S PLAY THE VIDEO. PLAYING THE VIDEO IMMEDIATELY PINS IT TO THE TOP OF MY SCREEN WHICH IS REALLY HELPFUL BECAUSE YOU CAN ACCESS YOUR CONVERSATION WHILE WATCHING THE VIDEO. LETS SAY I WANT TO GO A LITTLE DEEPER ON SOMETHING MENTIONED IN THE VIDEO. I CAN ASK CHATGPT CAN YOU EXPLAIN MORE ABOUT WHAT THEY ARE SAYING RIGHT NOW. APPSSDK PROVIDES AN API TO EXPOSE CONTEXT BACK TO CHATGPT FROM YOUR APP, ENSURING THAT THE MODEL ALWAYS KNOWS ABOUT EXACTLY WHAT YOUR USER IS INTERACTING WITH. WE'RE CALLING IT TALKING TO APPS AND IT'S PART OF THE MAGIC HERE. I'M SUPER EXCITED ABOUT HOW LEARNING WITH CHATGPT, ONE OF OUR TOP USE CASES, IS CONTINUING TO GET BETTER. WITH APPS AND THE APPS SDK YOU CAN UNLOCK RICHER EDUCATION EXPERIENCES FOR USERS AROUND THE WORLD. THIS EXPLAINS THE STRUCTURE IS TALKING ABOUT DATA PREPARATION STEPS BEFORE TRAINING AND MACHINE LEARNING MODEL. I DON'T NEED TO EXPLAIN. CHATGPT SEES IT RIGHT AWAY. I'LL BE ABLE TO CONNECT THE COURSERA APP AND DIRECTLY ENGAGE WITH THE VIDEO THROUGH TEXT WITHIN MY CHATGPT CONVERSATION. PRETTY COOL. USERS ALSO LOVE BEING CREATIVE IN CHATGPT. HERE I HAVE A CONVERSATION WHERE I'VE BEEN BRAINSTORMING SOME IDEAS TO HELP MY YOUNGER SIBLING'S DOG WALKING BUSINESS. WE'VE GONE BACK AND FORTH A FEW TIMES. I'M PRETTY HAPPY WITH SOME OF BUT LET'S TAKE THIS NAME. CANVA, MAKE ME A PORTFOLIO WITH THIS NAME. I WANT IT TO BE COLORFUL, WHIMSICAL AND BRIGHT AND ASK COURSERA FOR A TYPING COURSE, PREFER SANS SERIF FONT. CANVA IS GREAT AT CREATING ASSETS LIKE THIS, AND NOW YOU CAN KICK IT OFF DIRECTLY FROM CHATGPT. WHETHER YOU'RE MAKING MARKETING ASSETS FOR OPENAI OR JUST A FUN DEMO FOR DEVDAY. CANVA IS RIGHT THERE WITH YOU IN THE CONVERSATION AS YOU WORK. APPS SDK IS BUILT ON MCP, AN OPEN STANDARD WE'VE LOVED BUILDING ON AT OPENAI. IF YOU HAVE AN EXISTING MCP IT'S REALLY QUICK TO ENHANCE IT WITH THE APPS SDK, ALL YOU HAVE TO DO IS ADD A RESOURCE THAT RETURNS AN HTML TEMPLATE, AND THE APP WOULD BE ABLE TO UP EVERYWHERE CHATGPT IS DISTRIBUTED, LIKE WEB OR MOBILE. AS YOU CAN SEE, THIS IS A LIVE DEMO SO WE'RE EXPERIENCING A LITTLE BIT OF LATENCY. WE SEE THEM IN LINE LIKE THE VIDEO AS WELL AS CHATGPT EXPLAINING WHAT IT'S DONE. WE CAN EXPLORE ANOTHER MODALITY IN APPS SDK, FULL SCREEN. I CAN OPEN A SPECIFIC POSTER TO SEE IT IN MORE DETAIL, AND EVEN FOLLOW UP IN CHATGPT TO REQUEST CHANGES. LIKE WITH OUR IMAGE GENERATION EXPERIENCE. BUT SINCE WE'RE IN SAN FRANCISCO, AND IT'S DEVDAY, LET'S ASK CANVA TO CONVERT THESE INTO A PITCH DECK. I CAN SAY CANVA PLEASE MAKE THIS POSTER INTO A PITCH DECK, WE'RE TRYING TO RAISE A SEED ROUND FOR DOG WALKING. EYE SEND THAT OFF AND NOW CANVA WILL MAKE A SLIDE DECK. WE'LL MOVE ON TO SHOW ONE MORE DEMO WHILE THAT LOADS. SA SAY THE DOG WALKING BUSINESS IS GOING REALLY WELL, AND WE WANT TO EXPAND TO ANOTHER CITY! I CAN -- I CAN ASK CHATGPT WHERE WE SHOULD EXPAND. CHATGPT KNOWS WHAT WE'VE BEEN TALKING ABOUT. SUPER ENTHUSI ENTHU ENTHUSIASTICALLY SAYS PITTSBURGH. I CAN INVOKE ZILLOW TO SAY SHOW ME HOMES FOR SALE THERE. NOW IT'S TALKING TO ZILLOW TO FETCH THE LATEST DATA AND GET AN INTERACTIVE MAP EMBEDDED IN CHATGPT. WE HAVE OUR MAP, WE'RE JUST LOADING -- BOOM, WE HAVE A BACKUP OF HOMES HERE. ALSO LOOKS LIKE OUR SLIDE DECKS ARE DONE SO BACK TO THOSE IN A MOMENT. THIS MAP IS A LITTLE HARD TO SEE IN THE INLINE VIEW SO I CAN CLICK A HOME AND OPEN IT FULL SCREEN. WE HAVE MOST OF THE ZILLOW EXPERIENCE EMBEDDED IN CHATGPT AND REQUEST A TOUR AND THE ACTIONS YOU EXPECT FROM ZILLOW. WE HAVE A LOT OF OPTIONS AND IT'S HARD TO PARSEE SO I ASK CHATGPT FILTER THIS TO JUST THE THREE BEDROOM HOMES WITH A YARD. BECAUSE THE APP IS IN FULL SCREEN IT UPDATES THE DATA THAT'S PROVIDED TO IT WITHOUT NEEDING TO CREATE A NEW INSTANCE. WE SEE CHATGPT CAME BACK, GET THE MESSAGE OVERLAYED, I CAN VIEW MY CONVERSATION OVER THE ZILLOW APP AND OWN IT TO THE FULL HEIGHT. COOL. LET'S ZOOM IN AND FIND A SPECIFIC HOME WE MAY BE INTERESTED IN. NOW BECAUSE THE ZILLOW APP IS EXPOSING CONTEXT BACK TO CHATGPT IT KNOWS WHAT I'M LOOK AT AND I CAN ASK FOR MORE INFORMATION ABOUT THE HOME LIKE HOW CLOSE IS THIS TO A DOG PARK. CHATGPT IS ABLE TO COMPOSE THE CONTEXT FROM ZILLOW WITH OTHER TOOLS AT ITS DISPOSAL LIKE SEARCH. IT'S ABLE TO GIVE MORE INFORMATION ABOUT THE HOME, FROM HERE I CAN INVOKE OTHER TOOLS AND FIND OUT THE AFFORDABILITY BUT IT PROVIDES THE BEST ANSWER EVERY TIME. THIS IS A GREAT EXAMPLE OF HOW DYNAMIC AND EXPERIENCE WITH APPS SDK CAN BE AND STARTED FROM AN INLINE MAP AND WE'RE ABLE TO GO BACK AND FORTH BETWEEN TALKING TO THE APP AND ASKING CHATGPT QUESTIONS OR USING THE ZILLOW EXPERIENCE. LET'S CHECK BACK IN ON THOSE SLIDE DECKS. SO IF I POP OVER TO THIS CONVERSATION, SEE CANVA GAVE US SOME OPTIONS HERE. LIKE THE LOOK OF THIS BLUE SO IF WE OPEN THAT UP, WE SEE THE SLIDES IN FULL SCREEN AND I CAN SEE ALL THE BEAUTIFUL SLIDES THAT CANVA GENERATED FOR ME. WHEN I'M READY I CAN -- >> JUST LIKE THE POSTERS I CAN ASK FOR FOLLOW-UP EDITS AND WHEN A I'M READY I CAN OPEN THIS IN CANVAS AND CLOSE THE SEED ROUND. THE MAGIC OF APPS. WITH YOUR FAVORITE PRODUCTS RESULTING IN TRULY NOVEL EXPERIENCES. I'M SO EXCITED TO KEEP BUILDING THIS WITH ALL OF YOU. CAN'T WAIT TO SEE WHAT YOU DO WITH IT. . >> BACK TO SAM FOR MORE ON APPS. >> THANKS ALEXI. IT'S HARD TO TYPE AND TALKING IN FRONT OF A BUNCH OF PEOPLE AT THE SAME TIME. WE'RE EXCITED FOR YOU TO TRY OUT THE APPS YOU SAW IN THE DEMOS ALONG WITH A FEW MORE FOR THESE LAUNCH PARTNERS. THEY'LL BE AVAILABLE IN CHATGPT TODAY. AND WE'RE JUST GETTING STARTED. WE'LL BE ROLLING OUT EVEN MORE APPS FROM PARTNERS IN THE WEEKS AHEAD. FOR DEVELOPERS, APPS SDK IS AVAILABLE IN PREVIEW TO START BUILDING WITH TODAY. OUR GOAL IS TO GET THIS IN YOUR HANDS EARLY, HEAR YOUR FEEDBACK, AND BUILD IT WITH YOU. LATER THIS YEAR, DEVELOPERS WILL BE ABLE TO SUBMIT APPS FOR REVIEW AND PUBLICATION. WE'LL ALSO RELEASE A DIRECTORY USERS CAN BROWSE. IN ADDITION TO DISCOVERY AND CONVERSATION. ANY APPS THAT MEETS THE STANDARDS PROVIDED IN OUR DEVELOPER GUIDELINES WILL BE ELIGIBLE TO BE LISTED APPS THAT MEET HIGHER STANDARDS FOR DESIGN AND FUNCTIONALITY WILL BE FEATURED MORE PROMINENTLY-INCLUDING IN THE DIRECTORY, AND, AS WE SHOWED, SUGGESTED APPS IN CONVERSATIONS. WE'VE PUBLISHED A DRAFT OF OUR DEVELOPER GUIDELINES TODAY WITH THE PREVIEW APPS SDK SO YOU'LL KNOW WHAT TO EXPECT. AND WE'LL HAVE MORE TO SHARE ON MONETIZATION FOR APPS SOON. AND LOVE YOUR FEEDBACK ABOUT WHAT YOU WANT. THIS IS GOING TO BE AN EXCITING NEW CHAPTER FOR DEVELOPERS AND CHATGPT USERS. SO THAT WAS APPS. WE HOPE EVERYONE LOVES IT. >> OKAY. NEXT UP, LET'S LOOK AT HOW WE'RE MAKING IT MUCH SIMPLER TO BUILD EFFECTIVE AGENTS. AI HAS MOVED FROM SYSTEMS YOU ASK, TO SYSTEMS THAT CAN DO A LOT OF THINGS FOR YOU. WE'RE STARTING TO SEE THIS THROUGH AGENTS, SOFTWARE THAT CAN TAKE ON TASKS WITH CONTEXT, TOOLS, AND TRUST. BUT FOR ALL THE EXCITEMENT AROUND AGENTS, VERY FEW ACTUALLY MAKE IT INTO PRODUCTION. AND MAJOR USE. IT'S HARD TO KNOW WHERE TO START. WHAT FRAMEWORKS TO TRUST. AND IT'S A LOT OF WORK: ORCHESTRATION. EVAL LOOPS. CONNECTING TOOLS. BUILDING A GOOD UI. EACH OF THESE LAYERS ADDS COMPLEXITY BEFORE YOU EVEN KNOW IF THE IDEA IS GOING TO WORK. STILL, THERE'S A TON OF ENERGY, AND THE OPPORTUNITY IS VERY REAL. WE'VE TALKED TO THOUSANDS OF TEAMS WHO ARE BUILDING AGENTS TO REIMAGINE HOW WORK GETS DONE. WHAT WE CAN DO MAKE AGENTS EASIER TO BUILD. SO TODAY, WE'RE LAUNCHING SOMETHING NEW. SOMETHING FOR EVERY BUILDER THAT WANTS TO GO FROM IDEA TO AGENT, MUCH FASTER. WE'RE EXCITED TO INTRODUCE, AGENTKIT. AGENTKIT IS A COMPLETE SET OF BUILDING BLOCKS AVAILABLE IN THE OPENAI PLATFORM DESIGNED TO HELP YOU TAKE AGENTS FROM PROTOTYPE TO PRODUCTION. IT GIVES YOU EVERYTHING YOU NEED TO BUILD, DEPLOY, AND OPTIMIZE AGENTIC WORKFLOWS, FASTER, AND WITH WAY LESS FRICTION. EVERYONE FROM INDIVIDUAL DEVELOPERS TO LARGE ENTERPRISES WILL GET A LOT OF VALUE FROM THIS. WE'LL TALK ABOUT THE CAPABILITIES NOW. AGENT BUILDER IT A FAST VISUAL WAY TO DESIGN THE LOGIC STEPS TEST FLOWS AND SHIP IDEAS. IT'S BUILT ON TOP OF THE RESPONSES API THAT HUNDREDS OF THOUSANDS OF DEVELOPERS ALREADY USE. SO IF YOU'VE USED OUR PLATFORM BEFORE, YOU SHOULD BE FAMILIAR WITH THE FOUNDATION. SECOND IS CHATKIT. WE'RE MAKING IT EASY TO BRING GREAT CHAT EXPERIENCES RIGHT INTO YOUR OWN APPS. YOU GET A SIMPLE, EMBEDDABLE CHAT INTERFACE THAT YOU CAN MAKE YOUR OWN. BRING YOUR BRAND, BUILD YOUR WORKFLOWS, AND FOCUS ON WHAT MAKES YOUR PRODUCT UNIQUE. YOU CAN SEE IN THE VIDEO HERE HOW CHAT CAN WORK ACROSS EACH AGENT NODE, EVEN CALLING ON TOOLS, TO FORM THE BEST RESPONSE. AND FINALLY, EVALS FOR AGENTS. WE'RE SHIPPING NEW FEATURES DEDICATED TO MEASURING THE PERFORMANCE OF AGENTS. YOU GET TRACE GRADING, TO UNDERSTAND AGENT DECISIONS STEP-BY-STEP. YOU GET DATASETS, SO YOU ASSESS INDIVIDUAL AGENT NODES. WE'VE ADDED AUTOMATED PROMPT OPTIMIZATION. AND YOU CAN EVEN RUN EVALS ON EXTERNAL MODELS DIRECTLY WITHIN THE OPENAI EVALS PLATFORM. IT'S EVERYTHING WE WISHED WE HAD WHEN WE WERE FIRST BUILDING AGENTS. AND OF COURSE, AGENTS NEED ACCESS TO DATA. WITH OPENAI'S CONNECTOR REGISTRY, YOU CAN SECURELY CONNECT AGENTS TO YOUR INTERNAL TOOLS AND THIRD-PARTY SYSTEMS THROUGH AN ADMIN CONTROL PANEL WHILE KEEPING EVERYTHING SAFE AND UNDER YOUR CONTROL. LET'S LOOK AT A COUPLE OF EXAMPLES. ALBERTSONS RUNS OVER 2,000 GROCERY STORES ACROSS THE U.S., WITH MORE THAN 37 MILLION PEOPLE SHOPPING THERE EACH WEEK. EACH STORE IS LIKE ITS OWN LITTLE ECONOMY. MANAGERS HAVE TO MAKE CONSTANT DECISIONS. PROMOTIONS, PRODUCT MIX, DISPLAYS, VENDORS. IT'S A LOT. SO ALBERTSONS BUILT AN AGENT USING AGENTKIT. NOW IMAGINE A SITUATION WHERE SALES ARE UNEXPECTEDLY DOWN FOR ICE CREAM. 32%. BEFORE, THIS WOULD'VE KICKED OFF A LONG PROCESS OF REPORTING, SPREADSHEETS, MEETINGS. AN ASSOCIATE CAN JUST ASK THE AGENT WHAT'S GOING ON. THE AGENT LOOKS AT THE FULL CONTEXT -- SEASONALITY, HISTORICAL TRENDS, EXTERNAL FACTORS -- AND GIVES A RECOMMENDATION. MAYBE IT'S TIME TO ADJUST THE DISPLAY OR RUN A LOCAL AD. LET'S LOOK AT ANOTHER AGENT. HUBSPOT IS A CUSTOMER PLATFORM USED BY HUNDREDS OF THOUSANDS OF ORGANIZATIONS AROUND THE WORLD. THEY USED AGENTKIT TO IMPROVE THE RESPONSES OF BREEZE, HUBSPOT'S AI TOOL, USING THE CUSTOM RESPONSE WIDGET. IN THIS EXAMPLE, A HUBSPOT CUSTOMER, LUMA PLANTS, GETS A QUESTION ABOUT WHY A PLANT MIGHT NOT BE THRIVING IN ARIZONA. IT USES THE BREEZE ASSISTANT TO SEARCH ITS OWN KNOWLEDGE BASE, LOOK UP LOCAL TREATMENTS FOR THE STATE'S LOW HUMIDITY, PULLS IN POLICY DETAILS, AND PIECES EVERYTHING TOGETHER. IT THEN OFFERS MULTIPLE SOLUTIONS, INCLUDING A RECOMMENDATION. THIS IS INTELLIGENCE AT WORK ACROSS DIFFERENT SOURCES, ALL OPERATING TOGETHER TO DELIVER SMART, USEFUL ANSWERS. AND IT'S A GREAT EXAMPLE OF THE KIND OF THING YOU CAN BUILD WITH AGENTKIT. WE HAVE A BUNCH OF GREAT LAUNCH PARTNERS WHO HAVE ALREADY SCALED AGENTS USING AGENTKIT. AND IT'S AVAILABLE TO EVERYONE STARTING TODAY. SO LET'S SEE A DEMO OF HOW IT WORKS. I'LL PASS IT OFF TO CHRISTINA. >> THANKS SAM! HI EVERYONE, I'M CHRISTINA, AND I WORK ON THE TEAM BUILDING AGENTKIT. TODAY, I WANT TO SHOW YOU HOW AGENTKIT HELPS DEVELOPERS CREATE AGENTS FASTER THAN EVER BEFORE. YOU MAY HAVE ALREADY SEEN OUR DEVDAY WEBSITE - THE SITE THAT ALL OF YOU HAVE ACCESS TO AND WHICH SHOWS EVERYTHING ABOUT TODAY'S SCHEDULE. BUT RIGHT NOW, IT'S JUST A STATIC PAGE. WHAT IF IT COULD ACTUALLY HELP YOU NAVIGATE THE DAY AND POINT YOU TO THE SESSIONS MOST RELEVANT TO YOU? WE'RE OPENAI, WE NEED TO HAVE AI IN OUR DEVDAY SITE. SO THAT'S WHAT WE'RE GOING TO BUILD TOGETHER ━ AN AGENT, POWERED BY AGENTKIT, DEPLOYED RIGHT INSIDE THIS SITE. TO MAKE THIS INTERESTING, I'M GOING TO GIVE MYSELF 8 MINUTES TO BUILD AND SHIP AN AGENT RIGHT HERE IN FRONT OF YOU. YOU JUST HEARD HOW HARD IT IS TO BUILD AN AGENT, SO THIS WILL BE A CHALLENGE. AND I'M GOING TO START THE CLOCK TO KEEP ME HONEST. WE HAVE A CLOCK GOING. I'M STARTING IN THE WORKFLOW BUILDER IN THE OPENAI PLATFORM. INSTEAD OF STARTING WITH CODE, WE CAN WIRE NODES UP VISUALLY. AGENT BUILDER HELPS YOU MODEL COMPLEX WORKFLOWS IN AN EASY AND VISUAL WAY, USING COMMON PATTERNS THAT WE'VE LEARNED FROM BUILDING AGENTS. HERE ON THE LEFT, WE'VE ALREADY EXTRACTED THE COMMON BUILDING BLOCKS. FOR EXAMPLE TOOLS, HUMAN IN THE LOOP, GUARDRAILS, AND LOGICAL NODES. I'M PLANNING ON BUILDING A WORKFLOW THAT USES A SPECIALIZED SESSION AGENT, AS WELL AS A MORE GENERIC DEVDAY INFORMATION AGENT. I'M STARTING WITH AN AGENT TO CATEGORIZE THE TYPE OF MESSAGE COMING IN, WHETHER IT'S ASKING ABOUT SESSION INFO OR SOMETHING MORE GENERIC ABOUT DEVDAY. I'VE ADDED AN IF/ELSE NODE TO ROUTE BEHAVIOR BASED ON THAT CLASSIFIER. NEXT, I'LL CREATE THE SESSION AGENT. I'LL CALL THIS SESSION AGENT. GIVE IT CONTEXT ABOUT GRABBING INFORMATION ABOUT A SESSION. AND THEN I CAN ADD IN VARIOUS TOOLS, TODAY I ALREADY HAVE A DOC WITH THE INFORMATION ABOUT SESSION SO I'LL DROP THAT IN. CALL THIS SESSION. AND ATTACH IT. THIS HAS ALL THE INFORMATION NEEDED TO ANSWER MY QUESTIONS. SHOWING THE SCHEDULES SHOULD BE FUN AND VISUALLY INTERESTING - NOT JUST PLAIN TEXT - SO I'LL ALSO CREATE A WIDGET FOR THEM! I'LL HEAD OVER TO OUR WIDGET BUILDER, WHERE I'VE ALREADY DESIGNED A SESSIONS WIDGET, IN THIS CASE FOR A FROGE 101 CLASS. I JUST NEED TO DOWNLOAD THE THE WIDGET AND HEAD TO THE AGENT AND ATTACH IT IN AS A -- LET ME GO BACK AND CLICK THE BUTTON. DOWNLOAD. THERE WE GO. HEAD OVER AND ATTACH IT AS AN OUTPUT FORMAT FOR THE SESSION AGENT WE CREATED DROP THAT IN AND PREVIEW TO MAKE SURE WE ADDED THE HIT WIDGET. THIS IS NOW DONE. ONCE AGAIN I'LL DRAG IN AN AGENT NODE CALL THIS THE DEV DAY AGENTS. GIVE IT CONTEXT ABOUT WHAT IT'S DOING AND MAKE IS SPEAK IN THE STYLE OF FROGE TO MAKE IT ON BRAND WITH THE DAY. ADD A FILE, WE HAVE A FILE WITH ALL THE INFORMATION ABOUT THE DAY. CALL THIS DEVDAY. ATTACH IT. THIS AGENT IS READY TO GO. AND WE'LL ATTACH THAT HERE. NOW IT LOOKS LIKE I HAVE A FEW MORE MINUTES, SO LET'S ADD SOME ADDITIONAL SECURITY WITH ONE OF THE PREBUILT GUARDRAILS. ONE OF THE MOST IMPORTANT THINGS WHEN BUILDING AGENTS IS TRUST, AND GUARDRAILS HELP YOU HAVE THAT CONFIDENCE, PROTECTING AGAINST HALLUCINATIONS, ADDING MODERATIONS, AND MASKING PII. WE HAVE A COUPLE PRE-BUILT GUARDRAILS. I'LL TURN ONE ON FOR A PII AND INCLUDE NAME SO I CAN EASILY VERIFY BEHAVIOR AND TAP THIS TO THE BEGINNING OF THE WORKFLOW TO MAKE SURE FROGE IS PROTECTED AGAINST.THE PII AND ADD AN ADDITIONAL AGENT TO CANAL ADD ADDITIONAL CASES. I'LL MAKE IT SPEAK IN THE STYLE OF FROGE. AND REMOVE THE CONTEXT. I THINK THIS WORKFLOW IS READY TO GO AND I CAN CONFIGURE THE OUTPUT TO DETERMINE WHAT SHOWS UP TOP THE END USER. IN THIS CASE I CAN TURN OFF FILE SEARCH SOURCES IF THAT'S MORE INTERNAL. AND I THINK THAT'S T I CAN PREVIEW FROM AGENT BUILDER. OF I CAN ASK WHAT SESSION TO ATTEND TO LEARN MORE ABOUT THE BUILDING AGENTS? IT'S CHECKING GUARDRAILS AND PULLING INFORMATION FROM THE FILE OF SESSIONS I JUST ADDED IN AND FINDING THE RIGHT SESSION USING THE WIDGET I ADDED AND DETERMINING ORCHESTRATING AGENTS AT SCALE AT 11:15 IS THE BEST SESSION FOR ME. I SEE IT THROWING IN SOME RIBBITS. I THINK THIS AGENT LOOKS GOOD. WATCH THE TIME. WE JUST -- SO WE JUST BUILT A FEW SPECIALIZED AGENTS USING TOOLS, ADDED GUARDRAILS, CUSTOMIZED THEM WITH SOME WIDGETS, AND TESTED OUT OUR WORKFLOW IN PREVIEW. NOW, THE ONE THING WE HAVEN'T YET DONE IS A FULL SET OF EVALS, AND I CAN ALSO DO THAT DIRECTLY IN OUR PLATFORM TO MAKE SURE IT BEHAVES AS EXPECTED BEFORE GOING LIVE. BUT RIGHT NOW, I'VE GOT A GIANT CLOCK CHASING ME, AND DEVDAY IS WAITING. SO LET'S PUBLISH THIS AND CALL THIS ASK FROGE AND HIT PUBLISH AND I HAVE A FULLY DEPLOYED PUBLISHED AGENT IN PRODUCTION WITH A WORKFLOW ID I CAN USE TO RUN DIRECTLY. ON THE RIGHT WE HAVE CODEX IN CASE I WANT TO RUN IN MY OWN ENVIRONMENT AND SERVERS BUT YOU CAN SEE THIS IS QUITE A BIT OF CODE TO WRITE AND SO I'M GOING TO STICK WITH USING THE WORKFLOW ID WE CREATED AND HEAD OVER TO MY SITE. HERE IN MY DEVDAY SITE I'M GOING TO CREATE A SESSION USING THE WORKFLOW WE JUST CREATED. DROP THAT IN. THEN I'LL DROP IN THE CHATKIT REACT COMPONENT, HAND IT THE SESSION KEY, AND ADD IN SOME VISUAL CUSTOMIZATION WITH THE FROGE ACCENT COLOR. IT WILL BE CALLED ASK FROGE AND CONTINUE TO RIBBIT IN THE PLACEHOLDER AND HAVE FROGE SPECIFIC COLORS AND STARTUP PROMPTS. I'LL ADD THIS FROGE CHAT AND COME UP FROM THE BOTTOM OF THE PAGE AND THEN FINALLY I'LL ADD IN A LINK TO ASK FROGE AT THE TOP OF THE SITE SO IT'S FRONT AND CENTER CENTER ON THE WEBSITE. LET'S GO BACK TO THE SITE. THERE IT IS. LET'S TRY IT OUT. WHAT SESSION TO ATTEND TO LEARN ABOUT BUILDING AGENTS. THIS IS RUNNING THROUGH THE SAME WORKFLOW WE JUST CREATED CHECKING FOR GUARDRAILS, CATEGORIZING THE MESSAGE, PULLING FROM TOOLS FROM FILE SEARCH, USING THE WIDGET WE DESIGNED AND THEN DECIDING ORCHESTRATING AGENTS AT SCALE IS THE RIGHT SESSION FOR ME TO GO TO AND CONTINUING TO RIBBIT IN THE STYLE OF FROGE. WE'VE DONE IT.! THE AGENT IS READY WITH 49 SECONDS TO SPARE. I CAN KEEP ITERATING DIRECTLY ON THE VISUAL BUILDER AND DEPLOY CHANGES TO MY SITE WITHOUT MAKING ANY CODE CHANGES. THIS INCLUDES ADDING NEW TOOLS, ADDING NEW WIDGETS FOR OTHER USE CASES AND GUARDRAILS AND I CAN EVEN WIRE I CAN EVEN WIRE IT UP TO CLIENT SIDE TOOLS TO TAKE ACTIONS DIRECTLY IN THE SITE. SO IN JUST A FEW MINUTES, WE'VE DESIGNED AN AGENT WORKFLOW VISUALLY, WE ADDED SOME TOOLS AND WIDGETS, WE PREVIEWED IT, DEPLOYED IT, AND NOW YOU ALL CAN USE IT. IT'S ACTUALLY LIVE NOW IN YOUR DEVDAY SITE! YOU CAN SEE IT AND USE IT AND FIND SESSIONS THAT ARE BEST FOR YOU. WE'RE LOOKING FORWARD TO YOU USING IT, AND ALSO SEEING THE NEW EXPERIENCES YOU'LL BUILD WITH AGENTKIT.. THANKS, AND BACK TO SAM. >> THANK YOU, CHRISTINA! THAT'S SO COOL. I CAN'T WAIT TO SEE WHAT YOU'LL BUILD WITH IT. SO WE LOOKED AT AI APPS, AGENTS, BUT NOW LET'S SHIFT TO SOMETHING JUST AS IMPORTANT. HOW WE WRITE SOFTWARE. ONE OF THE MOST EXCITING THINGS HAPPENING WITH AI IS THAT WE'RE ENTERING A NEW ERA CHANGING HOW SOFTWARE GETS WRITTEN. ANYONE WITH AN IDEA CAN BUILD APPS FOR THEMSELVES, THEIR FAMILIES, OR THEIR COMMUNITIES. WE WANT TO SHOW YOU A FEW EXAMPLES. IN JAPAN AN 89-YEAR-OLD RETIREE TAUGHT HIMSELF TO CODE WITH HELP FROM CHATGPT. HE'S NOW BUILT ELEVEN IPHONE APPS FOR ELDERLY USERS. HE'S TURNING A LIFETIME OF WISDOM INTO TOOLS THAT HELP OTHERS LIVE MORE INDEPENDENTLY. IN SPAIN, PAU GARCIA AND MEMBERS OF DOMESTIC DATA STREAMERS HELP PEOPLE RECONNECT WITH MEMORIES, USING CHATGPT, IMAGE GENERATION, AND SORA. AT ASU, MED STUDENTS NEEDED A BETTER WAY TO PRACTICE THE KINDS OF TOUGH, HUMAN CONVERSATIONS THEY'LL HAVE AS DOCTORS. SO THEY BUILT A VIRTUAL PATIENT APP WITH OUR MODELS WHERE THEY CAN TRY, FAIL, AND GET BETTER BEFORE THEY STEP INTO A REAL EXAM ROOM. AND AT VERSAILLE IN FRANCE, VISITORS CAN NOW WALK THE PALACE AND TALK TO IT. THEY BUILT AN EXPERIENCE WHERE YOU HAVE A LIVE DISCUSSION WITH ART AND SCULPTURES WITH OUR REAL-TIME API. HISTORY BECOMES A CONVERSATION. IT'S AWESOME TO SEE WHAT PEOPLE ARE BUILDING. THIS IS WHY WE ARE EXCITED TO GIVE DEVELOPERS MORE TOOLS TO BUILD FASTER. EARLIER THIS YEAR, WE LAUNCHED A RESEARCH PREVIEW OF CODEX, OPENAI'S SOFTWARE ENGINEERING AGENT, BUILT TO WORK ALONGSIDE DEVELOPERS AND SPEED UP HOW SOFTWARE GETS CREATED. SINCE THEN, CODEX HAS GROWN INTO A MUCH MORE CAPABLE COLLABORATOR. IT WORKS EVERYWHERE YOU CODE. YOUR IDE, TERMINAL, GITHUB, AND IN THE CLOUD. YOUR CHATGPT ACCOUNT CONNECTS IT ALL, SO YOU CAN MOVE WORK SEAMLESSLY BETWEEN THESE TOOLS. WE'VE RELEASED A TON OF NEW FEATURES FOR CODEX. AND IT'S NOW RUNNING ON THE NEW GPT5-CODEX MODEL, A VERSION OF GPT5 THAT WE PURPOSELY TRAINED FOR CODEX AND AGENTIC CODING. THIS MODEL IS BETTER AT TASKS LIKE CODE REFACTORING AND CODE REVIEW, AND CAN DYNAMICALLY ADJUST HOW LONG IT THINKS TO THE COMPLEXITY OF THE TASK. DEVELOPERS LOVE THE NEW MODEL. AND CODEX USAGE HAS GONE UP REALLY FAST. ONE OF OUR KEY METRICS FOR THIS IS DAILY MESSAGES, THE NUMBER OF TASKS AND CONVERSATIONS DEVELOPERS HAVE WITH CODEX EACH DAY. SINCE EARLY AUGUST, DAILY MESSAGES ARE UP 10X ACROSS CODEX. THIS RAPID USAGE HAS ALSO HELPED GPT5-CODEX BECOME ONE OF OUR FASTEST GROWING MODELS EVER. SINCE ITS RELEASE, WE'VE SERVED OVER 40 TRILLION TOKENS. INTERNALLY, CODEX IS EVERYWHERE WE BUILD. ALMOST ALL NEW CODE WRITTEN AT OPENAI TODAY IS FROM CODEX USERS. OUR ENGINEERS THAT USE CODEX COMPLETE 70% MORE PULL REQUESTS EACH WEEK. AND NEARLY EVERY OPENAI PR GOES THROUGH A CODEX REVIEW ━WITH MORE DEPTH THAN YOU'D EXPECT EVEN FROM A VERY SENIOR ENGINEER. STARTING TODAY, CODEX IS OUT OF RESEARCH PREVIEW ━ AND OFFICIALLY GA. >> THANK YOU. AND WHILE CODEX ALREADY HAS A LOT OF TRACTION WITH INDIVIDUAL DEVELOPERS, WE'RE INTRODUCING A NEW SET OF FEATURES TO MAKE CODEX EVEN MORE HELPFUL FOR ENGINEERING TEAMS. FIRST, A SLACK INTEGRATION. THIS HAS BEEN VERY MUCH REQUESTED. SO YOU CAN ASK CODEX TO WRITE CODE OR ANSWER QUESTIONS, DIRECTLY FROM TEAM CONVERSATIONS IN SLACK. SECOND, A NEW CODEX SDK TO HELP YOU EXTEND AND AUTOMATE CODEX IN YOUR TEAM'S OWN WORKFLOWS. THIRD, NEW ADMIN TOOLS AND REPORTING, INCLUDING ENVIRONMENT CONTROLS, MONITORING, AND ANALYTICS DASHBOARDS, AND MORE SO ENTERPRISES CAN BETTER MANAGE CODEX. EXPECT TO SEE A LOT MORE CODEX IMPROVEMENTS COMING SOON. ONE OF THE THINGS THAT'S BEEN REALLY INSPIRING TO SEE IS THE BREADTH OF PEOPLE USING CODEX. FROM DEVELOPERS BUILDING SIDE PROJECTS ON WEEKENDS, TO HIGH-GROWTH STARTUPS, ALL THE WAY TO GLOBAL ENTERPRISES. CISCO ROLLED OUT CODEX ACROSS ITS WHOLE ENGINEERING ORG. THEY'RE NOW ABLE TO GET THROUGH CODE REVIEWS 50% FASTER AND HAVE REDUCED THE AVERAGE PROJECT TIMELINE FROM WEEKS TO DAYS. SO FOR OUR NEXT DEMO, WE WANT TO DO SOMETHING FUN. WE WANT TO SHOW YOU HOW YOU CAN USE CODEX AND OUR APIS TO TURN ANYTHING AROUND YOU INTO WORKABLE SOFTWARE. PLEASE WELCOME ROMAIN TO THE STAGE. >> THANK YOU SAM! GOOD MORNING, EVERYONE! LAST YEAR, WE BUILT AN IPHONE APP FROM SCRATCH AND PROGRAMMED THIS MINI DRONE, LIVE ON STAGE, USING O1. OUR FIRST REASONING MODEL. IT WAS KINDA VIBE-CODING BEFORE WE EVEN HAD A NAME FOR IT. THE PROGRESS SINCE THEN HAS BEEN INCREDIBLE. CODEX IS NOW A TEAMMATE THAT UNDERSTANDS YOUR CONTEXT, WORKS ALONGSIDE YOU, AND RELIABLY TAKES ON WORK FOR YOUR TEAM. WE THOUGHT ABOUT HOW BEST TO SHOW YOU ALL THE COOL THINGS CODEX CAN DO. WE HAD A LOT OF IDEAS! BUT ONE WE KEPT COMING BACK TO IS, WHAT ABOUT BUILDING SOMETHING WE COULD ALL SEE AND EXPERIENCE TOGETHER RIGHT HERE, RIGHT NOW, IN THIS ROOM? SO THAT'S OUR CHALLENGE! IF YOU LOOK UP, YOU MIGHT NOTICE THERE'S A CAMERA MOUNTED ABOVE US: I THOUGHT MAYBE WE COULD START THERE SO EARLIER, I ASKED CODEX CLI TO CREATE A SIMPLE CONTROL PANEL INTERFACE WITH A CAMERA FEED AND SOME CONTROLS, BASED ON THIS QUICK SKETCH I MADE. THEN I ADDED FIGMA BRANDING TO RENDER IT PERFECTLY MATCHING OUR DESIGN. THAT'S OUR PLACE TO GET STARTED. LET'S SEE WHAT WE CAN DO ON TOP OF THAT. NOW, SWITCHING OVER TO MY TERMINAL, YOU CAN SEE CODEX CLI, POWERED BY GPT5-CODEX AND LOGGED INTO MY CHATGPT ACCOUNT. LET'S START WITH SOMETHING YOU PROBABLY HAVEN'T ASKED YOUR CODING AGENT BEFORE: CAN YOU QUICKLY LAY OUT A PLAN TO CONTROL A SONY FR7 CAMERA? I HONESTLY DIDN'T KNOW HOW TO GET STARTED. I JUST SAW THERE'S A C++ SDK FOR THE CAMERA AND I THOUGHT, CODEX WILL PROBABLY TRY TO TRANSLATE THAT INTO JAVASCRIPT. AND YOU CAN SEE HOW GPT5-CODEX CAN RESPOND FAST TO QUESTIONS LIKE THIS. OKAY, SO TO SAVE TIME, I ASKED CODEX TO IMPLEMENT THE VISCA PROTOCOL AND WIRE IT UP TO OUR CONTROL PANEL. CODEX IS BECOMING HARDER AND HARDER TO DEMO BY THE WAY, BECAUSE IT CAN TRULY WORK TIRELESSLY ON YOUR TASKS: I'VE SEEN IT WORK FOR MORE THAN 7 HOURS STRAIGHT ON BIG REFACTORINGS. AND GET IT RIGHT. IF I SWITCH OVER, THIS WAS THE FINAL RESULT. IT WORKED FOR OVER 13 MINUTES ON THAT ONE TASK AND EVERYTHING I WANTED IT TO DO. IF I JUMP TO VS CODE WHERE WE ALSO HAVE OUR CODEX INTEGRATION. NIECE ARE THE FILES THE CODEX CLI CAME UP WITH. CODEX BUILT A NODE SERVER IMAGINE THE TIME IT WOULD HAVE TAKEN TO LEARN THIS PROTOCOL OVER 30 YEARS OLD. CODEX FIGURED OUT THERE WAS SOME VERY SPECIFIC HEADERS TO SENSE FOR THIS CAMERA. SO WITH THIS UI COMPONENT WIRED UP BECK TRY THIS. HERE IF I TURN ON THE CAMERA, AND LET'S TRY THE CONTROLS. I CAN CONTROL THE CAMERA NOW FROM THIS INTERFACE. COOL. I THINK WE CAN DO SOMETHING BETTER. I'M GOING TO TRY TO SEND ANOTHER TASK LIVE INSIDE OUR IDE EXTENSION. WIRE UP A WIRELESS CONTROLLER TO CONTROL THE CAMERA. I'M GOING TO SEND THIS NOW. BACK STAGE EARLIER I FOUND THIS XBOX CONTROLLER AND THOUGHT THIS COULD BE SOMETHING TO TRY. AS YOU CAN SEE NOW, CODEX MADE A PLAN, IT'S NOW EXPLORING THE FILE, FIGURING OUT HOW TO WIRE UP THIS GAME PAD AND WHAT'S INTERESTING HERE IS YOU CAN SEE IN THE IDE WE HAVE THIS CONCEPT OF CONTEXT. YOUR PROMPTS CAN BE SHORT BECAUSE CODEX WILL UNDERSTAND YOUR INTENT AND SEE THE RECENTLY FILES YOU'VE USED AND ADJUST ACCORDINGLY. AS YOU CAN SEE IT'S TASK 2 WILL TAKE ANOTHER MINUTE SO WE'LL LEAVE IT IN THE BACKGROUND. WHAT ELSE CAN WE DO? I THOUGHT ONE EXCITING INTERFACE IS VOICE. SO TO SAVE US SOME TIME I ASKED CODEX TO INTEGRATE WITH OUR REALTIME API AND OUR AGENT SDK WHAT WIRE UP INTO THE APP ON THIS DOT AT THE BOTTOM OF THE SCREEN. WHAT'S GREAT IS IT BRINGS NATURAL SPEECH TO SPEECH INTO YOUR APP BUT ALSO CONNECTS TO ANY SERVER IN THE CONTEXT OF THAT CONVERSATION THAT GOT ME THINKING WHAT ELSE CAN WE SHOW YOU AND TURN INTO A MCP SERVER. I THOUGHT WE HAVE A LIGHTING SYSTEM. SO YOU CAN SEE HERE MY PROMPT I ASK CODEX TO WIRE UP THIS MCP SERVER FOR THIS MODEL OF LIGHTING SYSTEM, I GIVE IT THE REFERENCE DOCS AND THE EXACT INTERFACE I WANT IT TO HAVE FOR MY UI TO WORK. THAT'S RIM THE MAGIC OF THE AGENTIC BEHAVIOR OF CODEX, I COULDN'T ASK A TEAMMATE TO DO THAT BUT BECAUSE THE TASK WAS VERY SPECIFIC CODEX IS MY TEAMMATE AND IF YOU LOOK AT HOW IT WENT THROUGH THE PROCESS, IT FIGURED AT SOME POINT IT NEEDED TO FIND NEW INFORMATION ABOUT COMMAND 8 TO MOVE FORWARD AND WENT TO FETCH THE GITHUB DOCS AND REALLY OPERATE AND CODE TOOLS ON THE WAY AND THAT'S THE MAGIC OF GPT FIVE CODEX. AFTER THAT, I DID ONE MORE TURN TO ASK CODEX TO INCLUDE THE INFORMATION SO I CAN UNDERSTAND HOW TO RUN IT AND THERE'S MY MCP SERVER. GOING BACK TO VS CODE, WHAT'S INTERESTING, THE XBOX TASK, WE'LL SEE THAT IN A MOMENT. AND GOING BACK HERE, YOU CAN SEE THAT YOU HAVE ALL YOUR LOW CODE AND CLOUD TASKS HERE INSIDE THE VS CODE EXTENSION SO IF I CLICK ON BUILD MCP SERVER THIS IS THE TASK I JUST SHOWED YOU ON CODEX CLOUD AND HERE I CAN APPLY ALL THE CHANGES LOCALLY IF I WANT TO TEST AND CLICK APPLY AND ALL THE CHANGES WITH THIS MCP SERVER ARE NOW LOCALLY. I STARTED TO INSTALL ALL THE DEPENDENCIES AND LET'S PUT THAT TO THE TEST. BUT FIRST IF WE GO BACK TO OUR APP HERE, LET'S SEE IF WE CAN CONTROL THIS CAMERA WITH THIS XBOX CONTROLLER. IT WORKS! THAT'S PRETTY AWESOME. WHAT'S FUNNY IS I CAN SPECIFY TO CODEX WHICH BUTTONS SHOULD DO WHAT BUT IT FIGURED A JOYSTICK WAS A GOOD IDEA. LET'S DO THE REAL TEST NOW AND ENTER VOICE MODE AND SEE WHAT HAPPENS. WE'LL TRY TO SEE IF CODEX FIGURED THIS OUT TO CONTROL THE LIGHTS. >> HELLO. >> HI, THERE, I CAN HEAR YOU LOUD AND CLEAR LET ME KNOW WHAT YOU NEED. >> WHAT DO YOU SEE ON CAMERA? >> I SEE A LARGE AUDIENCE IN FRONT OF YOU WITH ROWS OF ATTENDEES SEATED AND READY. THE ROOM IS WELL LIT AND THE CROWD FILLS THE SPACE. >> COULD YOU SHINE THE LIGHTS TOWARDS THE AUDIENCE? >> I'VE JUST LIT UP THE AUDIENCE WITH A NICE BRIGHT LIGHT TO BE PERFECTLY HIGHLIGHTED NOW. >> CAN YOU GREET EVERYONE HERE IN THE ROOM NOW? >> ABSOLUTELY. THE AUDIENCE LIGHTS ARE UP. LET'S WELCOME THIS FANTASTIC CROWD. HELLO, AMAZING DEVELOPERS AT FORT MASON, WE'RE SO EXCITED TO HAVE YOU HERE FOR AN INCREDIBLE DAY. >> AWESOME. COULD YOU NOW DO SOMETHING FUN WITH THE LIGHTS AND SAY HI TO PEOPLE TUNING IN ON THE LIVESTREAM. >> WE'VE GOT THE FUN LIGHTS ROLLING. SOME DYNAMIC COLORFUL EFFECTS IN MOTION. AND TO EVERYONE WATCHING OF THE LIVESTREAM, THANKS FOR JOINING US. THIS IS GOING TO BE AN AMAZING EXPERIENCE. >> COOL. ALL RIGHT. LET'S GO BACK TO NORMAL NOW. AWESOME. I STILL HAVE NOT WRITTEN ANY CODE TO MAKE THIS HAPPEN. BUT THERE'S ONE MORE THING I WANT TO SHOW YOU. LAST BUT NOT LEAST SAM MENTIONED WE'RE LAUNCHING THE CODEX SDK AND I WANTED TO FINISH WITH A GLIMPSE OF WHAT MIGHT BE THE FUTURE OF SOFTWARE ENGINEERING. LET'S GO BACK TO VOICE MODE. COULD YOU ASK CODEX TO SHOW A CREDITS OVERLAY LIKE AT THE END OF A MOVIE BUT THE CAST IS THE ATTENDEES? >> I'M RUNNING THAT WITH CODEX NOW. I'LL LET YOU KNOW WHEN IT'S READY. >> GREAT. IN THE MEANTIME, COULD YOU START A COUNT DOWN AND TAKE A PHOTO OF ALL OF US? THERE WE GO! . >> WHEN I SENT A TASK TO THE VOICE AGENT IT ALSO ADDED CODEX SDK AS A TOOL AND WHAT THAT MEANS IS NOW ON THE FLY I CAN REPROGRAM THIS APP IN REALTIME AND ADAPT IT TO USER NEEDS OR ANY FEEDBACK THEY HAVE SO IN THIS CASE WHEN I ASKED TO CREATE A CREDITS OVERLAY IT ENTERED THE CODE INSIDE THIS REACT AND FIND WHAT IT NEEDED TO COMPLETE AND THE CREDITS ARE ROLLING. WE TOOK VOICE, WE TOOK DEVICES WE TOOK VOICE, A SKETCH, DEVICES AROUND US AND TURNED ALL OF THIS INTO WORKABLE SOFTWARE. ALL THAT, WITHOUT HAVING TO WRITE ANY CODE BY HAND. GIVE CODEX YOUR MOST AMBITIOUS IDEAS, YOUR MOST COMPLEX CODING PROBLEMS. SEE WHAT HAPPENS. I THINK YOU'LL BE AS AMAZED AS WE ARE. EVERY DAY. THE ONLY LIMIT IS YOUR IMAGINATION. THANK YOU! BACK TO YOU, SAM. >> THANKS, ROMAIN. THIS IS THE BIGGEST CHANGE HOW SOFTWARE LET'S CREATED WE'VE SEEN. SO WE'VE COVERED A LOT TODAY, BUT OBVIOUSLY MODELS MATTER A LOT TOO, SO I WANT TO SHARE A FEW MODEL UPDATES. BACK IN AUGUST, WE LAUNCHED GPT5. WE TRAINED IT TO BE REALLY GOOD AT STEERING AGENTS AND END-TO-END CODING. AND GPT5 HAS DELIVERED. LEADING CODING STARTUPS LIKE CURSOR, WINDSURF, AND VERCEL ARE USING GPT5 TO CHANGE HOW SOFTWARE GETS WRITTEN AND SHIPPED IN THEIR APPS. WE RECENTLY RELEASED GPT5 PRO, THE MOST INTELLIGENT MODEL WE'VE EVER SHIPPED. TODAY WE'RE LAUNCHING GPT5 PRO IN THE API. IT'S NOW AVAILABLE TO ALL DEVELOPERS. WE HOPE YOU ENJOY. GPT5 PRO WILL BE GREAT FOR ASSISTING DEVELOPERS WITH REALLY HARD TASKS IN DOMAINS LIKE FINANCE, LEGAL, OR HEALTHCARE, WHERE YOU NEED HIGH ACCURACY AND DEPTH OF REASONING. WE'RE ALSO RELEASING A SMALLER VOICE MODEL IN THE API WITH GPT-REALTIME-MINI. IT'S A SMALLER, CHEAPER VERSION OF THE ADVANCED VOICE MODEL WE SHIPPED TWO MONTHS AGO━WITH THE SAME VOICE QUALITY AND EXPRESSIVENESS, 70% CHEAPER. PERSONALLY, I THINK VOICE IS GOING TO BECOME ONE OF THE PRIMARY WAYS PEOPLE INTERACT WITH AI, AND GPT-REALTIME IS A BIG LEAP TOWARDS THAT REALITY. NOW I WANT TO SHIFT GEARS, AND TALK ABOUT WHAT'S NEW FOR CREATORS. THIS HAS BEEN HOTLY REQUESTED. WE'RE SEEING INCREDIBLE WORK FROM FILMMAKERS, DESIGNERS, GAME DEVELOPERS, EDUCATORS USING AI AS PART OF THE CREATIVE PROCESS. TODAY, WE'RE RELEASING A PREVIEW OF SORA 2 IN THE API. YOU NOW HAVE ACCESS TO THE SAME MODEL THAT POWERS SORA 2'S STUNNING VIDEO OUTPUTS, RIGHT IN YOUR OWN APP. ONE OF THE BIGGEST JUMPS WE'VE MADE WITH THE MODEL IS IN HOW CONTROLLABLE IT IS. YOU CAN GIVE IT DETAILED INSTRUCTIONS AND IT HOLDS ON TO THE STATE WHILE DELIVERING RESULTS THAT FEEL STYLIZED, ACCURATE, COMPOSED. AND YOU CAN TAKE THE IPHONE VIEW AND PROMPT SORA TO EXPAND IT INTO A SWEEPING, CINEMATIC WIDE SHOT. ONE OF THE MOST EXCITING THINGS WE'VE BEEN WORKING ON IS HOW WELL THE MODEL CAN PAIR SOUND WITH VISUALS. NOT JUST SPEECH, BUT RICH SOUNDSCAPES, AMBIENT AUDIO, AND SYNCHRONIZED EFFECTS THAT FEEL GROUNDED IN WHAT YOU'RE SEEING. YOU CAN HEAR IT IN THIS KAYAK VIDEO. YOU CAN ALSO BRING PIECES OF THE REAL WORLD INTO SORA 2. FOR EXAMPLE, YOU CAN TAKE A STILL IMAGE OF YOUR DOG, AND GIVE YOUR FAVORITE PUP SOME NEW FRIENDS.. >> LOOK WHO'S COMING, BUDDY. HERE THEY ARE. COME ON! EVERYBODY TO GO. HAPPY DOGS! SORA 2 IS ALSO GREAT FOR CONCEPT DEVELOPMENT. YOU CAN JUST DESCRIBE A VIBE OR PRODUCT, AND SORA GIVES YOU A VISUAL STARTING POINT. WE'RE USING IT HERE TO GENERATE CONCEPTS FOR AN E-COMMERCE AD. . >> WHEN PLACE FEELS LIKE A BLANK CANVAS, BROWSE, CUSTOMIZE AND CHECK OUT IN MINUTES DELIVERED FAST TO YOUR DOOR. PEOPLE SEEM TO REALLY LOVE SORA 2. IT HAS BEEN ON TOP OF THE APP STORE SINCE WE LAUNCHED. NOW WITH THE SORA 2 PREVIEW IN THE API, YOU CAN NOW GENERATE THE SAME HIGH-QUALITY VIDEOS DIRECTLY INSIDE YOUR PRODUCTS, COMPLETE WITH SYNCHRONIZED, REALISTIC SOUND. AND JUST LIKE OUR OTHER MODALITIES, IT'S BUILT FOR FLEXIBILITY. YOU CAN CONTROL: VIDEO LENGTH, ASPECT RATIO AND RESOLUTION AND EASILY REMIX VIDEOS. MATTEL HAS BEEN A GREAT PARTNER, WORKING WITH US TO TEST SORA 2 IN THE API TO BRING PRODUCT IDEAS TO LIFE MORE QUICKLY. ONE OF THEIR DESIGNERS CAN START WITH A SKETCH AND TURN EARLY CONCEPTS INTO SOMETHING YOU CAN ACTUALLY SEE AND SHARE. LET'S TAKE A LOOK AT THE VIDEO. THAT IS A VERY COOL WAY TO BUILD TOYS. IT'S INCREDIBLE TO WATCH HOW FAST IDEAS CAN TURN INTO SHAREABLE, WORKING DESIGNS. WE'RE EXCITED TO SEE HOW YOU'LL USE SORA 2 IN YOUR OWN PRODUCTS. >> WE HOPE TODAY GAVE YOU A FEW IDEAS OF NEW THINGS TO GO BUILD. WE WANT OPENAI TO BE A GREAT PLATFORM FOR THIS NEW ERA OF BUILDING. THINGS ARE GOING TO TO GET PRETTY INCREDIBLE PRETTY SOON. AND ALL OUR ANNOUNCEMENTS TODAY AIMED TO SUPPORT THAT: THE APPS SDK FOR BUILDING NATIVE APPS IN CHATGPT. AGENTKIT, SO YOU CAN DEPLOY AGENTS WITH CONFIDENCE. A MORE POWERFUL CODEX, HELPING YOU AND YOUR TEAM SHIP FASTER. AND NEW MODELS IN THE API, LIKE GPT5 PRO, SORA 2, AND REALTIME MINI, THAT MASSIVELY EXPAND WHAT'S POSSIBLE. WE'RE WATCHING SOMETHING SIGNIFICANT HAPPEN. SOFTWARE USED TO TAKE MONTHS OR YEARS TO BUILD. YOU SAW TODAY. IT TAKES MINUTES NOW. AND TO BUILD WITH AI YOU DON'T NEED A HUGE TEAM. YOU DON'T NEED A BUNCH OF INFRASTRUCTURE. YOU JUST NEED A GOOD IDEA. THANK YOU ALL FOR BEING HERE. THANK YOU FOR BUILDING. I'M ALMOST DONE. ONE SECOND. OUR GOAL IS TO MAKE AI USEFUL FOR EVERYONE, AND WE COULDN'T DO IT WITHOUT YOU. WE'RE GRATEFUL YOU'RE BUILDING WITH US. ALSO AND A HUGE THANKS TO THE TEAM THAT MADE TODAY POSSIBLE. THERE'S A LOT MORE HAPPENING THROUGHOUT THE DAY, SO ENJOY THE SESSIONS, AND WE'LL SEE YOU LATER. THANK YOU VERY MUCH.