Abstract
In general, a user may interact with a television device such as a smart television by navigating a series of user interfaces to eventually find the user interface and menus available to the user that may help the user modify, configure, and/or adjust the numerous interfaces and controls available on the smart television. The user may become frustrated as the user may need to navigate through many complex user interfaces and menus to adjust the smart television settings and/or to determine and/or diagnose an issue with the smart television. A user may find this process cumbersome, particularly when the user may easily describe verbally (or enter as a text string) the problem or issue (e.g., “the picture is too dark”, “there is no sound”, “enable closed captioning”, etc.) yet may be challenged to know and navigate to the setting(s) to change on the smart television to resolve the issue. The difficulty in knowing and then finding the settings menu(s) on the smart television that the user interacts with to resolve the issue may create a barrier to efficient television device control resulting in a less intuitive user experience.
The disclosed technology describes an agent-based artificial intelligence framework (e.g., an agentic artificial intelligence (AI) framework) included on the smart television that simplifies interactions of the user with the smart television by providing a foundation for more intuitive user interactions with the smart television. The agentic AI framework may use natural language queries from the user to control television functions and/or to perform television diagnostics. An orchestrating agent may receive a natural language request (e.g., verbal or written) from a user that describes the issue. The orchestrating agent may route the request to one or more specialized AI agents. Each specialized AI agent may be trained for a specific domain of the smart television (e.g., picture quality, sound quality, media playback control, High-Definition Multimedia Interface (HDMI) control, etc.). The specialized AI agents may be provided with access to system-level application programming interfaces (APIs) on the smart television. The API access may allow the specialized AI agents to gather information and data related to the smart television and the current state of the smart television. In addition, or in the alternative, the API access may allow the specialized agents to execute commands directly on the smart television that are directed towards achieving a solution to the request from the user.
The disclosed technology may provide a user of a smart television with an intuitive, conversational method for controlling smart television settings and for troubleshooting smart television problems. The disclosed technology may improve the user experience by translating natural language commands into direct system actions on the smart television.
Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 License.
Recommended Citation
Colta, Paul and Fang, Henry, "Agentic Artificial Intelligence System for Natural Language Control and Diagnosis of Television Devices", Technical Disclosure Commons, (October 07, 2025)
https://www.tdcommons.org/dpubs_series/8680