Samsung Galaxy S24 Ultra First Look: Circle to Search, Live Translate, More AI

When I recently called a Korean restaurant to make a reservation, I had no issue communicating with the person on the other end even though she wasn’t speaking English. That’s because I was trying out the Galaxy S24 Ultra, one of three new phones Samsung announced on Wednesday, which can translate phone calls in real-time.

Samsung, like the rest of the tech industry, is enthralled with artificial intelligence at the moment. The Galaxy S24 series is rife with features like the translation example mentioned above that leverage generative AI — AI that uses large language models to create content or provide conversational (but not always accurate) answers. It’s another sign that tech giants are increasingly using AI to distinguish their devices from the pack and get consumers excited about upgrading their mobile devices in what has been a struggling smartphone market.

Read more: Everything Samsung Announced at Its 2024 Unpacked Event

The Galaxy S24 Ultra goes on sale for $1,300 (£1,249, AU$2,199) — $100 pricier than last year’s Galaxy S23 Ultra — on Jan. 31 alongside the cheaper Galaxy S24 Plus and Galaxy S24. All three are available for preorder now.

With the Galaxy S24 series, you’ll be able to have the Notes app format or summarize notes for you, circle any image to launch a Google search for that item and rewrite your text messages in a different tone before sending them. Samsung groups all these tools (among others) together under the blanket moniker known as Galaxy AI, and it’s available on the Galaxy S24, S4 Plus and S24 Ultra. These features will also come to the Galaxy S23 lineup through an update.

Some of those functions may sound familiar; they’re very similar to other generative AI-powered tools we’ve seen from companies like Google and Microsoft. In fact, Samsung is partnering with Google on the technology behind some of its new AI features, including the ones for rewriting texts, summarizing notes and moving individual objects in photos. 

Watch this: Samsung Reveals Its New S24 Series Phones and Their AI Chops

06:47

The Galaxy S24 Ultra also gets a sharper new telephoto camera and a titanium build. All three phones also have Qualcomm’s latest processor and brighter screens.

I briefly got to check out the Galaxy S24 series ahead of Samsung’s announcement, and here are my early impressions of the Ultra.

Galaxy AI on the Galaxy S24 Ultra

Galaxy AI is the biggest difference between the S24 series and its predecessors, although that won’t be the case for long considering these features are coming to the Galaxy S23 lineup. Some of Samsung’s Galaxy AI features include:

• Chat Assist for changing the tone, translating or spell-checking your text message before sending it.
• Live Translate for translating calls in 13 languages during a conversation.
• Circle to Search, which lets you launch a Google search for any object in a photo just by circling it.
• Note Assist for summarizing, translating and formatting files in Samsung’s Notes app and generating digital covers for notes.
• Generative Edit, which like Google’s Magic Editor lets you manipulate and move objects in photos.
• Transcript Assist in Samsung’s recording app for providing transcriptions and summarizing conversations.

I tried most of these features on the Galaxy S24 Ultra and they worked easily enough, although I’ve only tested them in Samsung’s controlled demo. Live Translate took a little getting used to, but I was impressed by how easy it was to carry on a conversation with a Korean language speaker once I got the hang of it.

After tapping the number I wanted to call in the S24 Ultra’s contact list, I chose the Live Translate option to start the translation. Samsung translated my words into Korean almost instantly after I finished speaking. Once the recipient on the other end had finished her response, Samsung repeated her speech in English. I could see this being helpful while traveling, although I could also imagine it causing some initial confusion for callers and recipients who are unfamiliar with the feature.

Read more: Best Samsung Phones of 2024

Circle to Search is another standout Galaxy AI tool that I can imagine being useful. It’s kind of like Google Lens, except you can search for objects in existing photos just by circling them rather than snapping a new photo. Just open the picture, hold the home button, and circle the object you’d like to search for. I circled waffles in a brunch photo in the S24 Ultra’s photo gallery, and Google pulled up recommendations for restaurants that serve waffles nearby.

I also snapped a picture of someone’s shoes in the demo area and circled them, and Google quickly summoned options to purchase those same shoes. This is a bit easier with the Galaxy S24 Ultra’s S Pen, but you can also use Circle to Search on the regular S24 and S24 Plus with your finger.

Samsung’s Notes app can organize text into bullet points and even offers different templates to choose from. Generative Edit, which is a lot like Google’s Magic Eraser, makes it possible to move, erase and manipulate individual objects in photos.

During a demo, a Samsung representative traced the area around a skateboarder performing a trick in a photo and moved the skater to make their jump look even higher. Samsung and Google are pitching features like these as being useful for creative purposes by giving anyone the ability to significantly alter photos straight from their phone with no photo editing knowledge. Still, it’s hard to ignore the potential for misuse, as my colleague Sareena Dayaram has previously pointed out.

One photography feature I’m excited about in particular is the ability to remove reflections in the edit suggestions section. As someone who photographs screens quite often, I can attest to how difficult it can be to avoid glare and reflections. I could also see this being useful for avid travelers who snap photos through car, bus or train windows on vacation.

Read more: From AI to Mixed Reality, CES 2024 Products Imagine A World Beyond Mobile Apps

Samsung is clearly focusing on productivity first and foremost with the Galaxy S24’s AI features, although many of these tools feel familiar rather than new. Galaxy AI has the potential to make accomplishing certain tasks on the S24 family feel more convenient, but it also doesn’t bring anything overwhelmingly new to the table. Maybe I’ll feel differently after I’ve spent more time with the Galaxy S24 Ultra.

Galaxy S24 Ultra specs and design

The biggest physical change on the Galaxy S24 Ultra compared to its predecessor is its 50-megapixel telephoto camera, which replaces one of the 10-megapixel zoom cameras on the Galaxy S23 Ultra. That means the S24 Ultra offers a 5x optical zoom compared to the S23 Ultra’s 10x optical zoom, a decision that Samsung made after it found that many users preferred zooming at 5x rather than 10x. This should hopefully enable crisper zoomed shots, but I’ll be able to tell for sure when I’ve had more time with the device.

Otherwise, the Galaxy S24 Ultra’s camera hardware is essentially the same as the Galaxy S23 Ultra’s, consisting of a 200-megapixel main camera, a 10-megapixel telephoto camera with a 3x optical zoom (in addition to the new 50-megapixel, 5x telephoto camera) and a 12-megapixel ultrawide camera.

The Galaxy S24 Ultra also has a titanium body, slightly slimmer bezels, and a lighter design, although the differences here seem very minimal. Samsung also says it’s boosted the screen brightness to 2,600 nits on all three models compared to 1,750 nits on the Galaxy S23 Ultra. Samsung’s screens were already plenty bright, especially when compared to Google’s Pixel phones, so I’m sure they’ll be even easier to see in sunlight. Still, they aren’t the brightest screen found on a phone in 2024. The OnePlus 12, which launches later this month in the US, will have a 4,500-nit display. 

All three phones run on Qualcomm’s new Snapdragon 8 Gen 3 processor, which isn’t a surprise considering Samsung typically puts Qualcomm’s latest chip in its flagship US phones. Qualcomm announced the chip in October 2023 and flaunted its ability to run generative AI algorithms on the device. The S24 Ultra also has a larger vapor chamber compared to last year’s phone, which Samsung says should keep the device cool while playing demanding games. 

Battery size, storage and memory and storage are essentially the same as those in the Galaxy S23 Ultra.

The Galaxy S24 family shows that Samsung, along with other tech giants, is learning about how generative AI can be useful on our phones following ChatGPT’s rapid rise. Galaxy AI seems like a promising start, although Samsung may have to do more to make its offerings stand out, especially as Apple is rumored to bring more generative AI-fueled features to the iPhone later this year.
Read more: How to pre-order the Galaxy S23 Ultra

Editors’ note: CNET is using an AI engine to help create some stories. For more, see this post.