Future Apple Pencil Could Have Sensor to Sample Colors From the Real World

Apple is exploring new Apple Pencil technology that could allow the device to sample colors from the real world to use in digital art, drawings, edits, and more, according to an Apple patent application published by the United States Patent and Trademark Office this week.

Apple Pencil Color Picker
Titled "Computer System With Color Sampling Stylus," the patent describes a computer stylus that "may have a color sensor."

The color sensor would be equipped with several photodetectors able to measure light for different color channels, which would let it detect and sample a color from a real world object, like a flower.

The stylus could also be equipped with a light to make it easier for the photodetectors to accurately determine a color, and the rest of the patent describes an Apple Pencil-like design with an elongated body, a tip, and an opposing end, with the tip able to work with a touch-sensitive display.

Apple says the color sensor functionality could be located at the end of the stylus, at the tip, or coupled to the tip through a light guide.

applepatentcolorsensor
With this kind of technology, ‌Apple Pencil‌ users would be able to do something like hold the ‌Apple Pencil‌ against an object in the real world, with the ‌Apple Pencil‌ reading the color. It could be used for photorealistic paintings or just sampling of unique colors from grass, plants, existing art, and so much more.

According to the patent, the stylus would detect the color and then put it in a color palette in a drawing program, where the color could be assigned to a brush. Apple also suggests that color sensor could perhaps be used for other purposes such as calibrating displays, calibrating printers, making health-related measurements, and identifying paint colors for home projects, which would make the ‌Apple Pencil‌ even more versatile.

Optical color sensors like this already exist and have been used in various ways. In fact, we've tested a simple, rudimentary optical color sensor in the Sphero Specdrums, a product meant to turn color into sound. This product includes a little finger ring that can be tapped against real world objects to make sounds based on the color it senses, but Apple's implementation would presumably be much more precise.

Apple patents all kinds of different technologies, some of which seem plausible to implement and others that are quite fantastical. There's never any guarantee that Apple's patents will be used for real products, and in fact, most patents are for technologies that never get released.

For that reason, there's no word on whether Apple actually plans to add a color sensor to the ‌Apple Pencil‌, or if this is simply an idea that's never going to make it out of the possibilities phase.

Related Forum: iPad Accessories

Top Rated Comments

SamGabbay Avatar
45 months ago
Now that's freaking awesome.
Score: 49 Votes (Like | Disagree)
AngerDanger Avatar
45 months ago

can't wait to try it with a chameleon... ?
I can do you one better, mate…



Attachment Image
Score: 48 Votes (Like | Disagree)
UltimateSyn Avatar
45 months ago

can't wait to try it with a chameleon... ?
Error 404: Color Not Found
Score: 28 Votes (Like | Disagree)
yaxomoxay Avatar
45 months ago
can't wait to try it with a chameleon... ?
Score: 22 Votes (Like | Disagree)
nfl46 Avatar
45 months ago
I gotta admit: that’s pretty cool.
Score: 21 Votes (Like | Disagree)
Doctor Q Avatar
45 months ago
This feature could be especially helpful for color blind users like me. Since I can't identify most colors visually, I do a lot sampling/copying/pasting of colors, or looking them up and specifying them by their RGB values. Being able to grab a color and digitize it physically would be super useful.
Score: 18 Votes (Like | Disagree)

Popular Stories

iPhone 15 General Feature Black

New iOS Features Coming in 2024 for Messages, Apple Music, and More

Thursday December 28, 2023 7:30 am PST by
2024 is just a few days away, and there are many iOS 17 and iOS 18 features that are expected to launch throughout the year. Below, we have recapped new iOS features expected in 2024, including Stolen Device Protection, collaborative Apple Music playlists, AirPlay on hotel room TVs, app sideloading in the EU, next-generation CarPlay, roadside assistance via satellite outside of the U.S., RCS ...
iOS 17

iOS 17.3 Will Add These Two Useful Features to Your iPhone

Sunday December 24, 2023 8:59 am PST by
Apple released the first beta of iOS 17.3 earlier this month, and the upcoming software update includes two new features so far. iOS 17.3 will likely be released in January like iOS 16.3 and iOS 15.3 were, but February is also a possibility if testing is prolonged. Below, we provide additional details about the new features in iOS 17.3 so far. Stolen Device Protection Earlier this...
iPhone 17 Five Features Header

iPhone 17: Five Features Apple Plans to Save for 2025

Thursday December 28, 2023 2:00 am PST by
Apple's iPhone development roadmap runs several years into the future and the company is continually working with suppliers on several successive iPhone models concurrently, which is why we sometimes get rumored feature leaks so far ahead of launch. The iPhone 17 series is no different, and already we have some idea of what to expect from Apple's 2025 smartphone lineup. If you plan to skip...
Mac Gaming

Apple Discusses Push Towards High-End Mac Gaming in New Interview

Thursday December 28, 2023 6:19 am PST by
Inverse's Raymond Wong today published an in-depth overview of Apple's increasing push towards high-end gaming on the Mac. The story includes commentary from Apple marketing managers Gordon Keppel and Leland Martin. One of the biggest reasons that gaming has improved on the Mac in recent years is the switch from Intel processors to Apple silicon, resulting in MacBooks providing...
Apple Watch Series 9

Apple Watch Series 9 and Ultra 2 Available in Apple Stores Starting Today, Online Sales to Resume Tomorrow

Wednesday December 27, 2023 2:28 pm PST by
Apple Watch Series 9 and the Apple Watch Ultra 2 are back in some of Apple's retail stores in the United States today, according to Bloomberg's Mark Gurman. Select stores will have availability today, while all stores will have the Apple Watch models back in stock by December 30. Online sales of the devices are set to resume tomorrow by 12:00 p.m. Pacific Time. Apple is able to begin selling ...
iPhone 15 Blue Three Quarters Perspective Camera Closeup Feature

6 Essential iPhone Camera Tips for Taking Great Photos

Tuesday December 26, 2023 3:00 am PST by
Apple's iPhones include several headline camera features that are worth using, such as Portrait Mode and Photographic Styles. But if all you want to use is the standard photo mode, there are still several tools and settings that can improve the composition of your pictures and help you capture the perfect shot using more traditional techniques. Whether you are the owner of a new iPhone or a...
Apple Watch Series 9

Apple Watch Series 9 and Ultra 2 Sales Ban Paused by US Appeals Court

Wednesday December 27, 2023 8:49 am PST by
The ban on imports of Apple Watch Series 9 and Apple Watch Ultra 2 models has today been temporarily paused, meaning that the devices can now go back on sale for a short while longer in the United States. Apple filed an emergency request to the United States Court of Appeals following President Biden's decision to decline a veto on the sales ban, allowing it to take effect earlier this week. ...