2023-06-09 17:42:38
In one of sessions of WWDC23Apple introduced a new framework from iOS 17 called DockKit. It makes possible the integration of the iPhone with motorized docks for cameras, allowing to follow the movement of people, animals and objects.
The functioning of framework stems from an integration between the device’s camera, software, and dock. The object to be followed is identified and the device’s camera attaches itself to it using an algorithm. Thus, the captured images are processed at a frequency of 30 frames per second and commands are sent to the dock, which moves according to the movements of the subject to be captured, making the camera follow the desired subject — something like the functioning of the Central Stage (Center Stage).
Resource applications are multiple and, according to The Verge, Apple itself seems to have already thought of one: monitoring pets. According to the vehicle, an API was createdApplication programming interfaceor application programming interface.”>1 dedicated to the identification of animals, called Animal Body Posewhich can be used in combination with the DockKit, specifically in relation to kittens.
However, the use of framework will not be restricted to following pets, so the capabilities leave quite wide usage. With the DockKit, such holders can rotate the iPhone up to 360º, as well as turn it vertically up to 90º. You can, for example, start a live transmission and show different points of a room without the need for someone to film.
The part of identifying the object to be tracked was something that Apple has noticeably worked on a lot. There are specific algorithms designed for this purpose, which is essential for the proper functioning of DockKit. In this way, even if the camera’s field of view has other objects and/or is obstructed, the idea is that it will still be possible to follow the chosen subject.
Furthermore, you can select different monitoring options, such as which way the camera should go, or whether this selection will be automatic, as well as a region of interest. By default, the object followed will be kept centered in the frame, although it will be possible to adjust several characteristics, such as the speed of movement of the dock, animations, people to be followed, interactions with movements that the subject makes, among other options.
The interesting thing regarding DockKit is that it works with the native iOS camera. In other words, all applications that already use the iPhone’s camera will be able to take advantage of this novelty, just having one of these supports (certainly many will be released in the near future), which will have software prepared for their use.
1686335753
#framework #iPhone #camera #follow #people #animals #objects