Category
🤖
TechTranscript
00:00So we just got done with possibly one of the biggest Apple WWDC keynotes of all time, maybe
00:10just because of the state of the world and what everyone expects from tech companies
00:14in 2024, which is AI at the front of what you do.
00:18Interestingly, with Apple this time, Apple had AI at the back half of what they did.
00:24Literally the entire first half of the keynote, they didn't say AI once, zero times.
00:28Then the second hour, they basically just went, all right, yeah, we actually do have
00:31a lot of AI stuff to share with you.
00:33And then they just spit it all out.
00:34And of course they did manage to brand it because of course they did.
00:38AI for them is now Apple intelligence, but look, I watched and live tweeted the entire
00:44two hour long keynote.
00:45So you don't have to.
00:46And I've gathered all my thoughts and all the most important announcements.
00:49So this is everything you need to know that's new.
00:52And some of my takes on it.
00:53So I'm going to go in the same order that Apple went.
00:54I'm going to start with Vision OS, and we're already on somehow Vision OS 2.0, less than
00:59half a year after the Vision Pro first got announced.
01:02And there are some solid new features, but I don't know if I would call this 2.0 worthy.
01:06It feels more like a 1.2 update, but okay, whatever, we'll go with it.
01:11So there's a new wrist turn gesture to quickly see the time and your battery percentage.
01:15And then you can jump right from there into the control center, instead of having to like
01:18look way up at the ceiling, like you had to before every time.
01:22Kind of reminds me of the Oculus Quest.
01:23That is easy.
01:25There's a bunch of immersive media features, like they let you go through your old photos
01:29and use advanced machine learning to turn them into spatial photos, which is really
01:35interesting if it works.
01:37And there are also new tools to help people create spatial videos and immersive videos
01:41on cameras other than the iPhone.
01:43But then of course you can only view them on a Vision Pro.
01:46So who knows how valuable this will actually turn out to be.
01:49But then this year, Mac mirroring will get way more resolution thanks to it now doing
01:54the foveated rendering on the Mac.
01:57So basically it frees up a ton of resources and it lets you do up to double the resolution.
02:01So you could do a gigantic ultra wide if you want it to be.
02:04That is way more room for windows and activities.
02:07Love that.
02:08And that's pretty much it.
02:10Again, it's not the biggest 2.0 update we've ever seen, but it does feel like there's some
02:13nice updates in there, including some new environments and the ability to rearrange
02:19your home screen.
02:20Believe it or not, you couldn't do that before.
02:22Now you can.
02:24Speaking of rearranging your home screen, iOS just got one of the biggest or at least
02:29most interesting updates in a long time.
02:33And I'm just going to, if you're an Android user, I'd say for the next like two minutes,
02:37three minutes, just go ahead and unplug your keyboard for a second and just relax.
02:41Because yes, we've had these features for a long time, but now it's the iPhone's time
02:46to shine.
02:47All right.
02:48You can finally be able to put icons wherever you want on the iOS 18 home screen grid.
02:55And it was hilarious that this got a whole applause moment from the audience during the
02:58keynote as if they just invented a new feature.
03:02But fine, you've been waiting for a long time for this.
03:04Have your fun.
03:05But they didn't stop there.
03:06They added a whole bunch of other customization features to the iPhone home screen too.
03:10And it started to get a little more interesting.
03:13See there's this new theme engine now that lets you go in and change the color of every
03:18icon and widget on your home screen to the same color.
03:23So you can really, you can match your wallpaper with your icons to frame it nicely and have
03:27matching colors everywhere.
03:29It's a simple thing and we've been doing it on Android with launchers for years.
03:33But the thing about these is before this moment, basically every iPhone home screen looked
03:38the same.
03:39We've been saying that.
03:41They've just given you the ability to go crazy and kind of ruin your home screen if you want
03:46to.
03:47And people seem to absolutely want to.
03:49I have seen some rough home screens people are making on Twitter.
03:54A lot of them just look terrible.
03:55And I think the main thing I noticed is it seems like there are apps that support this
03:59whole colored thing well.
04:02And then there are apps that don't.
04:05It just looks like it tints the entire, it just literally applies a color cast to the
04:09entire icon on your home screen, which causes all kinds of legibility problems, doesn't
04:13look good.
04:14There are widgets that look horrible, that it's just unreadable.
04:18So yeah, you can make some pretty looking home screens if you want, but you can also
04:23make some really ugly looking home screens.
04:25And I was trying to decide if I like this more or less than what Google did on the pixels
04:28with Material You.
04:29I think technically it's better because it works on all of the icons.
04:34I don't know how many setups I've tried where I wanted to do the monochrome icons, but there
04:37are just a few of my apps that aren't supported.
04:40So they end up looking kind of like they stick out like a sore thumb.
04:43So at least Apple's is letting you change all of the icons at once.
04:46But anyway, Apple's also redesigned the control center to be fully customizable across multiple
04:51pages.
04:52So again, there's a lot more going on here and there are many more customizable shortcuts
04:57in more places, including finally replacing the flashlight and camera on the home screen
05:02without jailbreaking.
05:03Finally.
05:04And the list keeps going.
05:05I don't know if you've heard these before, but there are, you can do hidden apps now
05:09inside your app drawer.
05:10So you can lock apps into a hidden folder that makes it easier than ever to hide Tinder
05:17from your wife.
05:19There's also scheduled text messages and iMessage.
05:21Great.
05:22Finally, they're having some fun over there.
05:24There's also text formatting.
05:26There's messages via satellite.
05:27RCS support was very casually, but briefly mentioned.
05:31The photos app is redesigned.
05:32There's also a game mode that now minimizes background activity and minimizes Bluetooth
05:36latency for peripherals.
05:37Great.
05:38And a new automatic categorization in the new mail app.
05:41So you can tell there's been a whole bunch of stuff.
05:43I will definitely be doing a larger, more focused, just iOS 18 video.
05:47So you can see everything that's new.
05:49There's plenty of little stuff that didn't make it into the keynote.
05:52So I'll do a whole deep dive just for that.
05:54Make sure you subscribe to be among the first to see that.
05:57I believe we are catching up to Apple in subscribers.
06:02It'd be kind of nice if we pass them.
06:03That'd be sick.
06:04So then AirPods got minor updates like voice isolation during phone calls, spatial audio
06:09during games, and the ability to respond to a prompt just by nodding or shaking your head.
06:15Taken right from the Sony headphones.
06:17I kind of like it though.
06:18Controlling it without using your voice is nice.
06:20Then Apple TV gets this new feature where you swipe down on the remote at any point
06:24during a show and it just shows you all the actors and character names of the people on
06:27the screen and any song that's playing in that moment in real time.
06:31And there's also a feature that boosts people's voices so you can always hear them over the
06:34music and then watchOS.
06:36They got this little training mode that sort of balances the trends in your training over
06:40time and evaluates how hard a workout was versus how hard it could have been.
06:44And then iPadOS.
06:46So this was supposed to be Apple's big chance to really convince us that the iPad is, it's
06:51something special that's got a little something to it that would make us convinced that we'd
06:56want to get the newest one, the M4 one that just came out over just your phone or over
07:01a Mac.
07:03And I'll say it did get one incredible feature, but it didn't really do much more than that.
07:10So the iPad, it gets all the stuff I talked about with the iPhone, right?
07:13Full home screen customization, customizable control center, the new Photos app, et cetera.
07:18It's all great.
07:19There's also a feature in SharePlay that lets you go in and actually remotely control someone's
07:25iPad when they allow it, which seems like a small thing, but I promise you that is massive
07:30for family tech support.
07:32You know who you are.
07:33But the one massive, actually impressive new feature on the iPad in iPadOS 18, and you
07:40think I'm joking, but I'm dead serious when I say this, it's the calculator app.
07:45It's the new calculator.
07:46I promise you, I was so ready to dunk on this.
07:48Like I had a how to tweet like drafted up as they were talking about it.
07:52We finally brought the calculator to the iPad and there were screenshots of it.
07:55And it looked just like the iPhone app.
07:56And I was like, really, this is, this is what you were so hyped about.
07:59I had that clip queued up ready of Craig Federighi being like, yes, we had to do something super
08:03special to finally bring the calculator to the iPad.
08:07But then, then they pulled the Apple pencil off the side and they pulled up what's called
08:12math notes and it was pretty sick.
08:15So now on the iPad, you can actually write down equations in handwriting and it will
08:21understand what you wrote and it'll answer the question in your handwriting.
08:26And then if you adjust the equation or add new information or something, it automatically
08:30updates the answer, which was so sick.
08:34I don't know why I'm so impressed with this, but it was really cool to play with and look
08:37at.
08:38So if that wasn't impressive enough, it also supports variables so you can have variables
08:42written all over the page.
08:43So look at this.
08:44It has G and X and A and H, and then it's a labeled Y as the height here.
08:51So you can ask for an equation using these variables and it can give you an answer.
08:56And if you want, you can do a Y equals equation and it'll give you a graph with real time
09:02adjustment of any of the variables in your equation.
09:04I mean, I, I wish I was in sixth grade again, so this could be my full time calculator.
09:09This is sick.
09:10At this point in the keynote, they haven't even actually said the word like AI a single
09:15time yet.
09:16I think this is pretty clearly AI.
09:17This is like handwriting recognition.
09:19This is like semantic understanding of all the things happening on the page.
09:22It's good AI.
09:24Well played, Craig.
09:25You did it.
09:26Okay.
09:27But this is before the actual AI section, but also this wasn't mentioned on stage, but
09:31this is also coming to the iPhone's calculator app as well.
09:35But then macOS.
09:36MacOS has its newest version.
09:38It's called Sequoia, and it does also get a nice little grab bag of new features.
09:43There's a automatic window snapping now, finally built in.
09:46You don't need a third party app to do it anymore, Sherlocked.
09:49There's built in backgrounds for any app that uses the webcam feed.
09:53There's also a new password app that basically just takes what was buried in the settings
09:56before and just makes it its own standalone app.
09:58So it's actually on Mac, iPad, and iPhone.
10:02But probably the biggest thing is iPhone mirroring.
10:06So this is another continuity feature that basically just lets you wirelessly always
10:10see your iPhone on your Mac.
10:13It merges your notifications and audio with your Macs, and lets you drag and drop things
10:18back and forth between your phone that's sitting next to you and your Mac.
10:21I kind of wonder if this hits your phone battery harder than normal.
10:23They didn't really say, obviously, so I'm going to have to test this, but I imagine
10:26if you're just sitting on a wireless charger, then it won't matter, but I'll be checking
10:30that out.
10:31But then we arrived.
10:32They did all the sections with all the other operating systems, and now we got to the part
10:35where Apple's going to talk about AI stuff.
10:39Kind of.
10:40Now I don't know if you remember this, but a couple months ago, not that long ago, I
10:43did an entire video on all of these phrases that it seems like Apple refused to say on
10:49stage.
10:50They just would not say them.
10:51And AI is one of them.
10:53They just didn't say it.
10:54They'd say anything else, neural nets, machine learning, all sorts of other things like that.
11:00But the times are the times.
11:01People want to hear Apple talk about AI.
11:03So they finally did.
11:05And they also, like I said, they rebranded it just for themselves, just to commandeer
11:10the AI name.
11:13And so now it's called Apple Intelligence in Apple land.
11:16So here's basically what you need to know about Apple Intelligence, right?
11:18So Apple has already had AI features on their devices before.
11:23They've had the neural engine inside of their chips, and they've done things like smartly
11:27cutting subjects out of photos.
11:29They've done things like autocomplete on the keyboard.
11:32That's already existed.
11:33But this new Apple Intelligence is basically a bucket of these new generative models and
11:39what they do on your devices.
11:41So there's these new diffusion models, generative models, and large language models that are
11:47all built by Apple that bring new functionality to the supported devices.
11:52And actually, I'll just get that out the way right off the bat.
11:55These are only supported on the highest end versions of currently available Apple Silicon.
11:59So that just means iPhone 15 Pro and any iPad with M1 or later, and any Mac with M1
12:09or later.
12:10So what does that look like?
12:11Well, basically, starting with these new OSes, there's a small suite of tools that's kind
12:16of sprinkled across everything.
12:18It's not like there's one Apple Intelligence app or something like that.
12:21They're just kind of sprinkled throughout.
12:23So here's an example.
12:24Writing tools.
12:25You know, we all know how powerful these large language models can be.
12:30So anytime you're writing in, you know, Pages or Keynote or basically anywhere where there's
12:33a cursor, you can use the writing tools to summarize or rewrite something that you've
12:39already written.
12:40It can change the writing style or just proofread.
12:43Just basic useful stuff.
12:44Here's another one.
12:45Remember the magic eraser tool in Google Photos and these Android phones that use it?
12:50Apple's finally doing that too.
12:51Built into their own Photos app is a cleanup tool.
12:54And it's basically the same idea.
12:55This will identify background items.
12:58It'll let you circle items you don't like in your photos and just get rid of them.
13:02Fill in the background with generative fill super quick.
13:04And there's also Genmojis.
13:08Generative emojis.
13:09And this may feel really old because I would never use this, but apparently there's a whole
13:13group of people who go through searching for emojis and then they find that there's one
13:17that doesn't exist and they're like, dang, I wish I could just make an emoji for this
13:22moment right now.
13:24And for those people, yeah.
13:26Now you can.
13:27You can generate a new emoji.
13:28You can literally type it in like a prompt and the diffusion model will create that new
13:32emoji from scratch in the style of all the other emojis.
13:36And they had an entire thing called the image playground that's built into a bunch of Apple's
13:41apps, but also has its own separate app that lets you create these nice little square images
13:45with prompts in three different styles, sketch, illustration, and animation.
13:52And yes, there are also Siri improvements that's using the large language models to
13:55generally understand context better and just generally be better and more natural at being
14:02an assistant that isn't garbage.
14:04And later in the year, it will also be able to pull info from inside of apps and take
14:08actions inside of apps for you too.
14:11I remember when this was like a huge Bixby feature on Samsung phones.
14:16That's cool to see.
14:17Plus there's also this like big, pretty new full screen animation when you're triggering
14:20Siri to tie it all together.
14:22Its voice is apparently slightly updated.
14:25And you can now also type to Siri instead of talking to it out loud every time, which
14:29is long overdue, but also nice.
14:31There's notes app summaries, there's phone call summaries, just all kinds of features
14:36sprinkled around.
14:37Like I said, definitely I want to, I think I'll end up making a video just summarizing
14:41or testing or reviewing all of the Apple intelligence stuff because it's kind of all over the place,
14:48but now you know what it is.
14:49But one question that's been floating around the internet is what stuff is happening on
14:53device versus things that have to go to the cloud.
14:58And this has also come up a lot because you might've also heard about Apple partnering
15:01specifically with open AI to integrate ChatGPT 4.0 into this Apple intelligence stuff.
15:10So it's a big question everyone's wondering.
15:11So I got the official answers from Apple and the answer is basically almost everything
15:16happens on device intentionally, and those are from Apple built models.
15:20So that should be the fastest stuff that happens.
15:24But in the chance that there are things that are too complex or just outside of the area
15:29of expertise of Apple's models, then it can basically go one of two ways.
15:33One is it will go to a larger server-based model that's on servers that Apple has built
15:39with Apple Silicon using what they call private cloud compute.
15:44So basically the info is never stored or sent to Apple.
15:47It's still going to have the downsides of having to go off of the device up to the cloud.
15:51It might take a bit longer if you're in an area with terrible internet, it might not
15:54work at all, but in the chance that this is like a big complex thing that could benefit
15:59from those models, that's what it'll try to do.
16:01But the other is when you specifically ask it for something that ChatGPT would be good
16:05at.
16:06And if that happens, then it will specifically ask you, hey, is it cool if I ask ChatGPT
16:14for an answer to this question?
16:15And then you can give it a yes or no on the spot.
16:18So anytime it wants to do this, whether it's to upload a photo that you're asking something
16:22about or just to the complex prompt in general, then this little dialog box pops up and you
16:26have to say yes every time.
16:28And then you can tap into everything that OpenAI's model is capable of or generate even
16:34more realistic or varied random different styles of images that Apple's diffusion models
16:39would never make.
16:40This is all free without an account.
16:42At no point is OpenAI allowed to ever store any of these requests.
16:46And Apple has also said that they will obscure your IP address.
16:49So you can't even, OpenAI can't even connect multiple requests together to form a profile
16:54of you.
16:55There's just a lot of thought that's gone into ideally making this as secure and private
17:00of a version of going to the cloud for AI features as they possibly can.
17:04So yeah, it's really interesting.
17:05A lot of interesting stuff going on here.
17:07I think my overall take with a lot of this WWDC announcements and with the Apple intelligence
17:13stuff is that, first of all, is that like the HumanePin and the Rabbit R1, they were
17:21so doomed from the start.
17:23Like there's no, even if they were good up to this point, there's just no way they could
17:27be as good as this stuff on your phone with all the personalization, all the info that
17:33they already know about you.
17:34So I guess that's confirmed.
17:36But also it just kind of, it does feel like we've entered a new age with Apple.
17:41I think the AI stuff is so important that it very much is what we're most interested
17:46in and it overshadows, like honestly, what could possibly be your favorite non-AI feature
17:51from the past couple of things?
17:54Moving home screen apps and icons everywhere.
17:56Like that might be the biggest thing, but it's up to this point now all about what this
18:01intelligence stuff can actually do for you and what it can bring you.
18:04So that's what I'm really excited about.
18:06I'll be working on some videos very soon about a lot of this stuff.
18:08So definitely, like I said, get subscribed if you haven't already, but this has been
18:11your overview or what you need to know.
18:14Thanks for watching.
18:15Catch you guys in the next one.
18:17Peace.