TW202225941A - Virtually viewing devices in a facility - Google Patents

Abstract

Provided herein are methods, systems, apparatuses, and computer programs related to various devices in an enclosure, e.g., using identification capturing device such as in conjunction with a digital twin of the enclosure. The computer program may be utilized for commissioning, maintenance, sales, marketing, and/or customer service. The computer program may receive customer, and/or customer service, input. The computer program may facilitate use of customer and/or customer service, e.g., input for controlling the facility (e.g., various devices of the facility), input for structuring the facility, and/or input for placing assets such as devices of the facility.

Description

Virtual viewing of devices in a facility

priority application

This application claims US Provisional Patent Application Serial No. 63/109,306, filed on November 3, 2020, entitled "ACCOUNTING FOR DEVICES IN A FACILITY," and filed on June 24, 2021, entitled "VIRTUALLY VIEWING DEVICES." IN A FACILITY" of U.S. Provisional Patent Application Serial No. 63/214,741. This application also claims as the International Patent Application Serial No. PCT/US21/27418 filed on April 15, 2021, entitled "INTERACTION BETWEEN AN ENCLOSURE AND ONE OR MORE OCCUPANTS", filed on May 21, 2021 International Patent Application Serial No. PCT/US21/33544 entitled "ENVIRONMENTAL ADJUSTMENT USING ARTIFICIAL INTELLIGENCE" and International Patent Application Serial No. entitled "DEVICE ENSEMBLES AND COEXISTENCE MANAGEMENT OF DEVICES" filed on May 5, 2021 Priority of Continued Partial Application No. PCT/US21/30798. Each of the above-mentioned patent documents is incorporated herein by reference in its entirety.

Some tintable windows may be electronically controlled. Such controls may allow control of the amount of light (eg, heat) that passes through the window, and make it possible for tintable windows to be used for energy savings by adjusting (eg, absorbing, dispersing, and/or reflecting) the amount of light that passes through device. Various types of tintable windows exist, eg, electrochromic windows.

Electrochromism is the phenomenon in which materials exhibit reversible electrochemically mediated changes in optical properties when placed in different electronic states, such as by undergoing a change in voltage. Optical properties can be color, transmittance, absorbance, and/or reflectance. Electrochromic materials can be incorporated into windows for household, commercial and/or other uses, for example. The electrochromic coating can be a (eg, thin) film coating on the pane. The color, transmittance, absorbance, and/or reflectivity of such windows can be altered by inducing changes in the electrochromic material, ie, electrochromic windows are windows that can be electronically darkened or brightened. In some embodiments, an (eg, smaller) voltage applied to the electrochromic device (EC) of the window will darken it; reversing the voltage polarity makes it brighter.

Although electrochromic was discovered in the 1960s, electrochromic devices and especially electrochromic windows still suffer from various problems and have not yet begun to realize their full commercial potential, despite electrochromic technology, equipment, software and manufacturing and/or The same holds true for many recent advances in related methods using electrochromic devices.

Commissioning, maintenance, and/or customer satisfaction with devices (eg, tintable windows) and associated controllers remains problematic, especially in larger facilities with multiple such windows and/or controllers. Errors in positioning windows, placement of controls, and/or connection of controls to designated windows may prove time- and labor-consuming to locate and correct. Similarly, locating a failed window, controller, and/or connection of the controller to a designated window (eg, for maintenance, upgrades, and/or replacement) can be time- and labor-consuming.

Tintable windows (eg, including electrochromic devices), electronic clusters (eg, containing various sensors, actuators, and/or communication interfaces), and/or associated controllers (eg, host controllers, network controls) Controllers and/or other controllers, eg, responsible for shading decisions) may be interconnected in a hierarchical network, eg, for the purpose of coordinated control (eg, monitoring). For example, one or more controllers may need to utilize the network address of a window controller connected to a particular window or set of windows. To this end, the function of commissioning is performed to provide the correct assignment of the window controller address and/or another identifying information and the physical location of the windows and/or window controllers in the building to specific windows and window controllers. In some cases, the goal of commissioning is to correct errors or other problems made when installing windows in the wrong location or connecting cables to the wrong window controller. The commissioning procedure for a particular window (eg, insulating glass unit (IGU)) may involve associating the identification (ID) of the window or other window-related components with the network address of its corresponding window controller. The program may (eg, also) assign building locations and/or absolute locations (eg, latitude, longitude, and/or altitude) to windows or other components.

During commissioning of devices in a facility, one or more devices (eg, target devices) may be misplaced. For example, the same device can be installed, which can be (eg, only) by the installer, such as by looking up serial numbers with inscriptions, barcodes, quick response (QR) codes, radio frequency identification (RF ID), and/or other serial numbers are distinguished from each other by the external marking of the printed information. If the location of each particular device is pre-specified, significant work (eg, labor and cost) may be required to ensure proper placement. Significant work (eg, labor and cost) may also be required if not pre-specified and then recorded manually. Such work increases (i) as the number of devices increases and (ii) as the size and/or complexity of the facility in which the devices are located (eg, housed) increases. Digital models and/or other files may be associated with facilities and devices (eg, Building Information Models (BIM) (eg, Revit files, Microdesk (eg, ModelStream), IMAGINiT, ATG USA, or similar facility-related digital files)). Digital models and/or files may be referred to herein as "digital clones" of the facility. When there are many devices, the task of locating any misplaced device and updating the digital avatar becomes tedious, time-consuming, expensive, and prone to human error (eg, due to manual typing). Automating, at least in part, the process of locating and recording the device during and/or after the commissioning process may provide at least some relief from such tasks. This at least partially automated process will increase the likelihood that the digital avatar of the facility indicating the device (eg, asset) therein is accurate. This process will simplify the formation of a centralized file for all assets of an integrated facility, which will assist tenants and customers in supporting those responsible for the facility and/or the installations therein.

In some cases, marketing team members, sales team members, and/or customer success managers (CSMs) do not have the tools (eg, automated tools) to incorporate various devices into the facilities they handle during their service. In some cases, an initial BIM file (such as an Autodesk Revit file) may be static and have building elements of the facility, but not the devices installed in the facility, let alone the updated state of such devices. A significant amount of manpower may be required to translate building plans into digital avatars. For example, 3D building models can sometimes be manually constructed to correspond to the 3D building models. The device can be inserted into it manually. Ground truth verification (eg, from a field service engineer) may be required for device data in the digital clone.

The (eg, automatic) integration of a facility with a digital avatar of the devices installed therein, which can be updated to reflect real-time or substantially real-time status, may not only assist in the deployment and maintenance of the facility and/or the devices therein, but also Tools for CSM may be provided, for example, when interacting with customers or potential customers. The digital avatar may be a BIM supplemented with device-related information, or may be combined with BIM data. Such digital avatars (eg, visible using applications) facilitate facility management at various levels. At times, input from building occupants can be used as a feedback tool to customize the controls of the facility (eg, to control devices in the facility). Input from the client and/or from the CMS (eg, via an application) may be fed into the control of the facility (eg, the facility's devices), eg, using a digital avatar. The digital clone may provide (eg, visual and/or visual) safeguards prior to commissioning various aspects of the facility. A digital avatar can provide a user of a software application with a virtual reality experience of a facility, including its assets, such as a device.

According to some aspects, a user (eg, a field service engineer or a robot, such as a drone) identifies the target device's identity (eg, in real-time) based on its identification code and its location in the facility, and updates automatically The digital avatar of the closed body (eg, a virtual 3D model of the closed body) and/or this information in the BIM is automatically updated to form an updated BIM (eg, a Revit ^(R) file) to overcome the shortcomings of the prior art. In some embodiments, the updated BIM will be compared to the previous version (eg, the original) BIM for any discrepancies, which may be reported or otherwise resolved.

In some aspects, the ID code can be retrieved by the mobile device. The mobile device may, for example, use a digital avatar to present (eg, in real time) a simulation of the fixtures of the facility surrounding the walker with or without a simulation of the walker (eg, using augmented reality). For example, the mobile device may present at least a portion of the digital avatar of the enclosure.

In some aspects, the device to be located (eg, the target device) may or may not be operatively coupled to a communication and/or power network. Devices to be located may include tintable windows, sensors, transmitters, media display constructs, antennas, routers, transceivers, controllers (eg, microcontrollers), processors, tables, chairs, doors, lighting, heating appliances, ventilators, lighting, air conditioners, alarm clocks, or any other identifiable device associated with the facility. Target devices may include stationary objects (eg, windows or non-movable furniture, such as shelves) and/or non-fixed objects (eg, movable furniture).

In some aspects, the target device may be represented in the digital avatar or may be added to the digital avatar using a mobile device. The digital avatar may include or be operatively (eg, communicatively) coupled to the BIM. The target device can be placed (eg, positioned) at a designated location or at a random location in the facility.

In some aspects, the digital avatar may be used for building automation, analytics, customer service, customer management, sales, marketing, and/or asset lifecycle management. Digital clones may be used to control various devices in a facility and/or the facility's environment (eg, lighting systems, security systems, security systems, heating, air conditioning, and/or ventilation (eg, HVAC systems)). The digital doppelganger may be operatively coupled to a building management system (BMS).

In another aspect, a method of logging into one or more real target devices, the method comprising: (A) identifying a location information of a real target device at least in part by: (i) using a mobile device Select a virtual target device in a virtual representation of an enclosure in which the real target device is housed, the virtual target device being a virtual representation of the real target device included in the enclosure housed in the enclosure one or more real target devices, and/or (ii) use geographic information to locate the real target device; (B) use an identification capture device to capture an identification code of the real target device, the identification code attached to the real target device; and (C) logging into the real target device at least in part by linking (I) the identification code, (II) the location information, and (III) the virtual representation of the enclosure.

In some embodiments, the virtual representation of the enclosure is an augmented reality. In some embodiments, the virtual representation of the enclosure is displayed on the mobile device. In some embodiments, the virtual representation includes virtual representations of at least some of the one or more real target devices. In some embodiments, the method further includes navigating within the virtual representation of the enclosure based on movement of the mobile device within the enclosure. In some embodiments, the mobile device is transported by a traveler within the enclosure, and wherein a zoomed view in the virtual augmented reality representation is presented in real-time on a display of the mobile device based at least in part on The current location of one of the walkers depicts a virtual representation of the real target device. In some embodiments, the traveler is a human. In some embodiments, the traveler is a robot with image recognition capabilities. In some embodiments, the method further includes updating the virtual representation of the enclosure based on the registration of the target device. In some embodiments, the virtual representation of the enclosure is derived from and/or includes an architectural model of the enclosure. In some embodiments, the method further includes updating the building model according to the registration of the real target device. In some embodiments, the method further includes determining the real target device at least in part by utilizing the virtual representation of the enclosure, the virtual representation of the real target device, and associated information obtained by utilizing the capture device one of the states. In some embodiments, the associated information is linked to the real target device and/or to the enclosure. In some embodiments, the associated information is obtained from a source identified by the identifying retrieval device as a result of the retrieval. In some embodiments, the source is at least one server file linked by the identifier. In some embodiments, the method further includes (a) initiating service of the real target device when the determined state indicates a service need, and (b) updating the determined state upon completion of the service. In some embodiments, the geographic information is absolute information. In some embodiments, the absolute information is derived at least in part from a global positioning system (GPS) receiver or from an ultra-wideband (UWB) receiver. In some embodiments, the geographic information is a relative location in the virtual representation of the enclosure. In some embodiments, the relative position is referenced to a fixture of the enclosure. In some embodiments, the identification retrieval device is mobile. In some embodiments, the identification capture device captures the identification code optically and/or electronically. In some embodiments, the identification code includes a barcode and/or a quick response (QR) code. In some embodiments, the identification code includes at least a one-dimensional code or a two-dimensional code. In some embodiments, the identification code includes an electromagnetic code. In some embodiments, the real target device does not have a corresponding virtual target device representation in the virtual representation of the enclosure when the location information is identified. In some embodiments, the method further includes populating (a) the virtual representation of the enclosure and/or (b) with a virtual representation of the real target device and/or associated information of the real target device using the identification code ) at least one associated database of the virtual representation of the enclosure. In some embodiments, the identifier is linked to the virtual representation of the real target device and/or the associated information about the real target device in the at least one association database. In some embodiments, the at least one association database includes a lookup table. In some embodiments, the method further includes selecting the virtual representation of the real target device from a plurality of selections presented by the mobile device. In some embodiments, the method further includes selecting the identification code of the real target device from a plurality of identification codes presented by the mobile device. In some embodiments, the method further includes transmitting the retrieved identification code to at least one database for storing and/or operatively coupled to the virtual representation of the enclosure. In some embodiments, the enclosure includes a network. In some embodiments, the mobile device is communicatively coupled to the at least one database via the network in a wired and/or wireless manner. In some embodiments, the network is communicatively coupled to the real target device. In some embodiments, the network is a hierarchical network including a plurality of controllers. In some embodiments, the network provides power and communications, and the network is configured for at least fourth (4G) generation or at least fifth (5G) generation cellular communications. In some embodiments, the network is configured for media and/or video transmission using coaxial cables, optical wires, and/or twisted pairs. In some embodiments, the mobile device is included in a handheld pointing device. In some embodiments, the mobile device is included in a mobile phone. In some embodiments, the mobile device is included in a tablet computer.

In another aspect, a non-transitory computer-readable medium for logging into one or more real target devices, the non-transitory computer-readable medium configured to execute when read by one or more processors Operation of any of the above methods.

In another aspect, an apparatus for logging into one or more real target devices, the apparatus comprising at least one controller having circuitry, the at least one controller configured to: (A) operatively couple connected to an identification capture device and coupled to a virtual representation of an enclosure in which the one or more real target devices are positioned; (B) receiving or directing reception of the location of a real target device at least in part by Information: (i) selecting a virtual target device in a virtual representation of an enclosure in which the real target device is housed, the virtual target device being a virtual representation of the real target device included in the one or among a plurality of real target devices, and/or (ii) locate the geographic information of the real target device; (c) receive or direct reception from the identification retrieval device configured to retrieve an identification code of the real target device identification information of the real target device to which the identification code is attached; and (D) at least in part by linking or leading to link (I) the identification code, (II) the location information and (III) the closure The virtual representation of the entity is used to log or boot into the real target device.

In some embodiments, the at least one controller is configured to generate or direct the generation of the virtual representation of the enclosure as an augmented reality. In some embodiments, the at least one controller is configured to display or direct display of the virtual representation of the enclosure on the mobile device. In some embodiments, the virtual representation includes virtual representations of at least some of the one or more real target devices. In some embodiments, the at least one controller is further configured to navigate or guide navigation within the virtual representation of the enclosure based on movement of the mobile device within the enclosure. In some embodiments, the mobile device is transported by a traveler within the enclosure, and wherein the at least one controller is configured to present or direct presentation of the virtual augmented reality on a display of the mobile device in real-time A zoomed view of one of the environmental representations to depict a virtual representation of the real target device based at least in part on a current location of a traveler. In some embodiments, the traveler is a human. In some embodiments, the traveler is a robot with image recognition capabilities. In some embodiments, the at least one controller is further configured to update or direct update of the virtual representation of the enclosure based on the registration of the real target device. In some embodiments, the virtual representation of the enclosure is derived from and/or includes an architectural model of the enclosure. In some embodiments, the at least one controller is further configured to update or direct update of the building model based on the registration of the real target device. In some embodiments, the at least one controller is further configured to, at least in part, by utilizing (i) the virtual representation of the enclosure, (ii) the virtual representation of the real target device, and (iii) by utilizing The associated information obtained by the capture device is used to determine or guide the determination of a state of the real target device. In some embodiments, the associated information is linked to the real target device and/or to the enclosure. In some embodiments, the at least one controller is further configured to obtain or direct obtaining the associated information from a source identified by the identifying capturing device as a result of the capturing. In some embodiments, the source is at least one database file linked by the identifier. In some embodiments, the at least one controller is further configured to (a) initiate service of the real target device or direct initiating service of the real target device when the determined state indicates a service need, and (b) the status as determined by the immediate update or boot update upon completion of the service. In some embodiments, the geographic information is absolute information. In some embodiments, the at least one controller is further configured to derive or direct the derivation of the absolute information, at least in part, from a global positioning system (GPS) receiver or from an ultra-wideband (UWB) receiver. In some embodiments, the geographic information is a relative location in the virtual representation of the enclosure. In some embodiments, the at least one controller is further configured to reference or direct reference to the relative position to a fixture of the enclosure. In some embodiments, the identification retrieval device is mobile. In some embodiments, the at least one controller is configured to direct the identification capture device to optically and/or electronically capture the identification code, the controller being operatively coupled to the identification capture device . In some embodiments, the identification code includes a barcode and/or a quick response (QR) code. In some embodiments, the identification code includes at least a one-dimensional code or a two-dimensional code. In some embodiments, the identification code includes an electromagnetic code. In some embodiments, when the location information is identified, the real target device does not have a corresponding virtual target device representation in the virtual representation of the enclosure. In some embodiments, the at least one controller is further configured to use or direct use of the identification code to populate with (i) a virtual representation of the real target device and/or (ii) associated information of the real target device (a) the virtual representation of the enclosure and/or (b) at least one associated database of the virtual representation of the enclosure. In some embodiments, the identification code is linked to the virtual representation of the real target device and/or the associated information about the real target device in the at least one association database. In some embodiments, the at least one association database includes a lookup table. In some embodiments, the at least one controller is further configured to facilitate selection of the virtual representation of the real target device from a plurality of selections presented by the mobile device. In some embodiments, the at least one controller is further configured to facilitate selection of the identification code of the real target device from a plurality of identification codes presented by the mobile device. In some embodiments, the at least one controller is further configured to communicate or direct the communication of the captured identification code to at least one database storing and/or operatively coupled to the virtual representation of the enclosure . In some embodiments, the enclosure includes a network. In some embodiments, the mobile device is communicatively coupled to the at least one database via the network in a wired and/or wireless manner. In some embodiments, the network is communicatively coupled to the real target device. In some embodiments, the network is a hierarchical network including a plurality of controllers. In some embodiments, the network provides power and communications, and the network is configured for at least fourth (4G) generation or at least fifth (5G) generation cellular communications. In some embodiments, the network is configured for media, video, and/or power transmission using coaxial cables, optical wires, and/or twisted pair wires. In some embodiments, the mobile device is included in a handheld pointing device. In some embodiments, the mobile device is included in a mobile phone. In some embodiments, the mobile device is included in a tablet computer.

In another aspect, a method for simulating a real facility, the method comprising: (i) generating a digital avatar of a real facility at least in part by using a virtual building model of a real facility; (ii) ) populate at least one device of the real facility in the digital avatar at a virtual location corresponding to its real location in the real facility, the at least one device being controllable; and (iii) simulate or guide the simulation The effect of at least one environmental attribute on the real facility.

In some embodiments, stuffing into a digital avatar is virtual stuffing (eg, as opposed to a physical connection), such as establishing a virtual representation of one or more devices in the digital avatar. In some embodiments, the environmental attribute includes lighting, radiation, temperature, gas velocity, gas flow, gas content, gas concentration, gas pressure, sound, volatile organic compounds, or particulate matter. In some embodiments, the irradiation is an external radiation impinging on and/or penetrating the real facility. In some embodiments, the gas comprises oxygen, carbon dioxide, carbon monoxide, radon, oxygen, nitrogen, hydrogen sulfide, one or more nitrogen oxide pollutants ( _NOx ), or water vapor. In some embodiments, the method further includes displaying the digital avatar on a user interface to visualize the digital avatar in a facility viewer when the digital avatar is affected by the environmental attribute. In some embodiments, the simulation is a time-varying simulation. In some embodiments, the method further includes saving the time-varying simulation. In some embodiments, the method further includes using the facility viewer to solicit an input from a user that affects one or more aspects of the digital avatar. In some embodiments, the at least one device includes a tintable window, a sensor and transmitter, a controller, a transceiver, an antenna, a media display, or a collection of devices. In some embodiments, the device collectively includes (i) a transceiver, (ii) a sensor, or (iii) a sensor and a transmitter. In some embodiments, the digital avatar is used to control the real facility. In some embodiments, the method further includes adjusting or creating an occupancy area of the real facility. In some embodiments, the at least one device is a plurality of devices, and wherein the method further includes adjusting or creating a partition of the real facility associated with at least a portion of the plurality of devices. In some embodiments, the at least the portion of the plurality of devices is associated with the partition. In some embodiments, the at least one device is a plurality of devices of different types, and wherein the method further includes searching for one of the different types of the plurality of devices. In some embodiments, the method further includes presenting the type of the different types of the plurality of devices in the digital avatar. In some embodiments, the at least one device is a plurality of devices, and wherein the method further includes selecting a device of the plurality of devices. In some embodiments, the method further includes presenting the one of the plurality of devices in the digital avatar along with its status, network identification and/or factory information, wherein the network identification is the one device in the digital avatar A unique identifier on the network of one of the real facilities. In some embodiments, the method further includes a mapping of one of the at least one environmental attribute in the digital avatar. In some embodiments, the simulation is a time-dependent simulation. In some embodiments, the method further includes populating the digital avatar with input from a user. In some embodiments, a user of the user interface includes a commissioning person, a maintenance person, a customer service person, or a customer.

In another aspect, a non-transitory computer-readable medium for visualizing a digital avatar of a real facility, the non-transitory computer-readable medium, when read by one or more processors, is configured to The operations of any of the methods disclosed above are performed.

In another aspect, an apparatus for simulating a real facility includes at least one controller configured to perform or direct the performance of any of the methods disclosed above.

In another aspect, a system for simulating a real facility, the system including a network configured to transmit one or more associated with any of the methods disclosed above a signal.

In another aspect, a system for simulating a real facility, the system comprising: a network configured to: operatively coupled to at least one device of the real facility, in a digital clone populating the at least one device at a virtual location corresponding to its real location in the real facility, the at least one device being controllable via the network; communicating the digital avatar of the real facility, the digital avatar being at least partially generated by using a virtual building model of a real facility; and conveying a simulation including at least one environmental attribute an effect of the real facility.

In some embodiments, the network is a local area network. In some embodiments, the network includes a cable configured to transmit power and communication in a single cable. The communication can be one or more types of communication. The communication may include cellular communication complying with at least second generation (2G), third generation (3G), fourth generation (4G) or fifth generation (5G) cellular communication protocols. In some embodiments, the communication includes media communication that facilitates still images, music or animation streaming (eg, movies or video). In some embodiments, the communication includes data communication (eg, sensor data). In some embodiments, the communication includes control communication, eg, to control operatively coupled to one or more nodes of the networks. In some embodiments, the network includes a first (eg, cabling) network installed in the real facility. In some embodiments, the network includes a (eg, cabling) network installed in an envelope of the real facility (eg, included in an envelope of a building in the real facility).

In another aspect, a non-transitory computer-readable medium for visualizing a digital avatar of a real facility, the non-transitory computer-readable medium, when read by one or more processors, is configured to performing operations comprising: (i) generating or directing the generation of a digital clone of a real facility at least in part by using a virtual building model of a real facility; (ii) in the digital clone the real facility at least one device fills or guides fills at a virtual location corresponding to its actual location in the real facility, the at least one device being controllable; and (iii) simulates or guides simulation of at least one environmental attribute to the real facility Facility impact. In some embodiments, the operations further include displaying or directing display of the digital avatar on a user interface to visualize the digital avatar when the digital avatar is affected by the environmental property.

In another aspect, an apparatus for simulating a real facility, the apparatus including at least one controller configured to: (i) at least partially by using a virtual facility using a real facility building models to generate or guide the generation of a digital avatar of a real facility; (ii) populate or guide filling in the digital avatar at least one device of the real facility with a virtual one corresponding to its real location in the real facility at the location, the at least one device is controllable; and (iii) simulating or leading to simulate the effect of at least one environmental attribute on the real facility. In some embodiments, the simulation is used to control the real facility. In some embodiments, the at least one controller is configured to direct a software application to display the avatar on a user interface to visualize the avatar when the avatar is affected by the environmental property, wherein the at least A controller is operatively coupled to the application, or is associated with the software application.

In another aspect, the present disclosure provides systems, apparatuses (eg, controllers) and/or one or more non-transitory computer-readable media (eg, software) that implement any of the methods disclosed herein .

In another aspect, the present disclosure provides methods of using any of the systems, computer-readable media, and/or devices disclosed herein, eg, for their intended purposes.

In another aspect, an apparatus includes at least one controller programmed to direct a mechanism for implementing (eg, performing) any of the methods disclosed herein, the at least one The controller is configured to be operatively coupled to the mechanism. In some embodiments, at least two operations (eg, of the method) are directed/performed by the same controller. In some embodiments, at least two operations are directed/performed by different controllers.

In another aspect, an apparatus includes at least one controller configured (eg, programmed) to implement (eg, perform) any of the methods disclosed herein. At least one controller can implement any of the methods disclosed herein. In some embodiments, at least two operations (eg, of the method) are directed/performed by the same controller. In some embodiments, at least two operations are directed/performed by different controllers.

In some embodiments, one of the at least one controllers is configured to perform two or more operations. In some embodiments, two different ones of the at least one controller are configured to each perform a different operation.

In another aspect, a system includes at least one controller programmed to direct operation of at least one other device (or component thereof) and the device (or component thereof), wherein the at least one A controller is operatively coupled to the device (or to the component thereof). The apparatus (or components thereof) may include any apparatus (or components thereof) disclosed herein. At least one controller can be configured to direct any of the devices (or components thereof) disclosed herein. At least one controller can be configured to be operatively coupled to any of the devices (or components thereof) disclosed herein. In some embodiments, at least two operations (eg, of the device) are directed by the same controller. In some embodiments, at least two operations are directed by different controllers.

In another aspect, a computer software product storing program instructions (eg, written on one or more non-transitory media) that, when read by at least one processor (eg, a computer), cause At least one processor directs the mechanisms disclosed herein to implement (eg, perform) any of the methods disclosed herein, wherein the at least one processor is configured to be operatively coupled to the mechanism. A mechanism may include any device (or any component thereof) disclosed herein. In some embodiments, at least two operations (eg, of the device) are directed/performed by the same processor. In some embodiments, at least two operations are directed/performed by different processors.

In another aspect, the present invention provides non-transitory computer-readable program instructions (eg, included in a program product comprising one or more non-transitory media) comprising machine-executable code for the machine The executable code, when executed by one or more processors, implements any of the methods disclosed herein. In some embodiments, at least two operations (eg, of the method) are directed/performed by the same processor. In some embodiments, at least two operations are directed/performed by different processors.

In another aspect, the present invention provides one or more non-transitory computer-readable media comprising machine-executable code that, when executed by one or more processors, executes a pair of (eg, Bootstrapping of the controller as disclosed herein). In some embodiments, at least two operations (eg, of the controller) are directed/performed by the same processor. In some embodiments, at least two operations are directed/performed by different processors.

In another aspect, the present invention provides a computer system comprising one or more computer processors and one or more non-transitory computer readable media coupled thereto. The non-transitory computer-readable medium includes machine-executable code that, when executed by one or more processors, implements any of the methods disclosed herein and/or performs any of the methods disclosed herein. Guide to the Revealed Controller.

In another aspect, the present invention provides non-transitory computer-readable program instructions that when read by one or more processors cause the one or more processors to execute Any operation of a method disclosed herein, any operation performed (or configured to perform) by an apparatus disclosed herein, and/or any operation directed (or configured to direct) by an apparatus disclosed herein operate.

In some embodiments, the program instructions are written on one or more non-transitory computer-readable media. In some embodiments, at least two of the operations are performed by one of the one or more processors. In some embodiments, at least two of the operations are each performed by a different one of the one or more processors.

In another aspect, the present disclosure provides a network configured for transporting any communication (eg, signal) and/or (eg, electrical) power that facilitates any of the operations disclosed herein. Communications may include control communications, cellular communications, media communications, and/or data communications. Data communications may include sensor data communications and/or processed data communications. The network can be configured to adhere to one or more protocols that facilitate this communication. For example, the communication protocol used by the network (eg, with BMS) may be the Building Automation and Control Network Protocol (BACnet). For example, a communication protocol may facilitate cellular communications that adhere to at least a 2nd, 3rd, 4th, or 5th generation cellular communication protocol.

The contents of this Summary section are provided as a simplified introduction to the invention, and are not intended to limit the scope of any invention disclosed herein or the scope of the appended claims.

Additional aspects and advantages of the present invention will become apparent to those skilled in the art from the following description, in which only illustrative embodiments of the present invention are shown and described. As will be realized, the invention is capable of other and different embodiments, and its several details are capable of modification in various obvious respects, all without departing from the invention. Accordingly, the drawings and descriptions are to be regarded as illustrative and not restrictive in nature.

These and other features and embodiments will be described in greater detail with reference to the drawings. incorporated by reference

All publications, patents and patent applications mentioned in this specification are incorporated herein by reference to the same extent as if each individual publication, patent or patent application was specifically and individually indicated to be by reference way incorporated into the general.

While various embodiments of the invention have been shown and described herein, it will be apparent to those skilled in the art that such embodiments are provided by way of example only. Numerous variations, changes, and substitutions can occur to those skilled in the art without departing from the invention. It should be understood that various alternatives to the embodiments of the invention described herein may be employed.

Terms such as "a/an" and "the" are not intended to refer to only a single entity, but rather include the general class to which specific examples may be used to illustrate. The terminology herein is used to describe specific embodiments of the invention, but their usage does not delimit the invention.

Unless otherwise specified, when referring to a range, the range is intended to be inclusive. For example, a range between value 1 and value 2 is intended to be inclusive and includes both value 1 and value 2. An inclusive range will span any value from about 1 to about 2. The terms "adjacent" or "adjacent to" as used herein include "adjacent", "adjacent", "contacting" and "proximity."

As used herein, including within the scope of the claims, the conjunction "and/or" in a phrase such as "including X, Y, and/or Z" is intended to include any combination of X, Y, and Z or plural. For example, this phrase means to include X. For example, this phrase is meant to include Y. For example, the phrase is meant to include Z. For example, this phrase is meant to include X and Y. For example, the phrase is meant to include X and Z. For example, this phrase is meant to include Y and Z. For example, the phrase is meant to include a plurality of X's. For example, the phrase is meant to include plural Ys. For example, the phrase is meant to include a plurality of Z's. For example, this phrase is meant to include plural X and plural Y. For example, the phrase is meant to include a plurality of X's and a plurality of Z's. For example, this phrase is meant to include Y's and Z's. For example, the phrase is meant to include a plurality of X and Y. For example, the phrase is meant to include a plurality of X's and Z's. For example, the phrase is meant to include a plurality of Y and Z. For example, this phrase is meant to include X and a plurality of Ys. For example, this phrase is meant to include X and a plurality of Z. For example, this phrase is meant to include Y and a plurality of Z. The conjunction "and/or" is intended to have the same effect as the phrase "X, Y, Z, or any combination or plural thereof." The conjunction "and/or" is intended to have the same effect as the phrase "one or more of X, Y, Z, or any combination thereof."

The terms "operatively coupled" or "operatively connected" refer to a first element (eg, mechanism) that is coupled (eg, connected) to a second element to allow intended operation of the second and/or first element . Coupling may include physical or non-physical coupling (eg, communicative coupling). Non-physical coupling may include signal-induced coupling (eg, wireless coupling). Coupling may include physical coupling (eg, a physical connection) or non-physical coupling (eg, via wireless communication). Operationally coupling may include communicatively coupling.

An element (eg, mechanism) that is "configured to" perform a function includes structural features that enable the element to perform that function. Structural features may include electrical features, such as circuitry or circuit elements. Structural features may include actuators. Structural features may include circuitry (eg, including electrical or optical circuitry). The electrical circuitry may contain one or more wires. Optical circuitry may include at least one optical element (eg, a beam splitter, mirror, lens, and/or optical fiber). Structural features may include mechanical features. Mechanical features may include latches, springs, closures, hinges, chassis, supports, mounts, or cantilevers, among others. Performing functions may include utilizing logic features. Logical features may include programmed instructions. The programmed instructions are executable by at least one processor. Programming instructions can be stored or encoded on a medium that can be accessed by one or more processors. Additionally, in the following description, the phrases "operable with," "adapted with," "configured with," "designed with," "programmed with," or "capable of" may be used interchangeably as appropriate use.

Also, as used herein, the terms pane and lite are used interchangeably. The electrochromic window may be in the form of an insulating glass unit (IGU)\laminated structure or both, eg, where the IGU has one or more laminated panes as its panes, eg, one pane is a single pane of glass and The other pane is a dual pane IGU that is a laminate of two pieces of glass. The laminate may include two, three or more pieces of glass.

Occasionally, installers (eg, field service engineers) install faulty windows at specific locations in an enclosure (eg, a facility's building). Commissioning corrects installation errors. Commissioning may allow certain types of devices (eg, windows) to be installed randomly throughout a building or site. For example, all optically switchable windows of the same size can be randomly placed at locations with openings that can accommodate windows of these sizes. Commissioning may consider identifying a particular device as being located in a particular location within the enclosure.

In some embodiments, commissioning includes associating a physical device within a building with identifying data (eg, a network ID) that allows the physical device to be considered, tracked, and/or electrically reachable when it is coupled when connected to the Internet). A debugged device that is operatively (eg, communicatively) coupled to the network is accessible via the network. A commissioned device at a location known via the commissioning program can be controlled via commands sent to the network address associated with the device via the commissioning. Commissioning ensures that shading commands, sensor readings, etc. provided by or to the control logic are associated with the correct physical devices that have a known location and/or connectivity to the network (e.g., connect gender, hub and/or address).

As buildings become larger, and as the number of devices in the building increases, the commissioning process can consume a lot of time and effort. When devices are of different nature, their commissioning may require personnel with different expertise to install and/or configure. In some cases, commissioning can take weeks or even months to complete. In some cases, debugging techniques require the user to wait for a device action to accurately configure the device action. For example, the installer may have to wait for the window to tint, which can take several minutes.

Certain embodiments described herein may allow for faster commissioning of devices. In some cases, the capture device (eg, a sensor such as an RF reader, camera, or other imaging device) is placed in an area of an enclosure with the device to be commissioned (eg, in the lobby of a building) ). The capture device is operable to capture images and/or identification tags of devices to be commissioned in the region. In some embodiments, each device in the area is captured. Commissioning logic can associate the device image with the location in the two-dimensional or three-dimensional format of the digital avatar of the enclosure, and thereby identify the location of one or more devices in the zone. The captured information (eg, images) may capture some unique characteristic of the device. In some embodiments, the unique characteristic is an indicator of permanent or temporary application, such as an ID tag (eg, with a barcode, QR code, or another type of image-distinguishable identifier; or a emitting tag, such as an RFID).

In some implementations, the debug logic reads or otherwise identifies information contained in an identifier (eg, an ID tag) to uniquely identify one or more devices. In some embodiments, the commissioning logic additionally identifies the location in the region of the enclosure housing the one or more devices identified by their identifiers. When coupling the device ID with its location information, the debug logic can associate a uniquely identified device with its location.

In some embodiments, the commissioning method may include providing a capture device in an enclosed body region having one or more devices to be commissioned. One or more devices may have identifiers that are unique among the devices to be installed in the enclosed body region. Such identifiers may be accessible for imaging by the image capture device. The ID capture device can capture one or more images of one or more devices to be debugged. Using the images captured by the image capture device, the location of one or more devices in the image of the enclosed volume can be determined (eg, using machine image recognition). Any deciphered image identifiers contained in the images captured by the capture device can be determined (eg, using machine image recognition) to be recognizable. For example, individual devices are identified by their unique identifiers. An identified device can be associated with its location. Location and/or identifier pairs for one or more devices may be stored (eg, in one or more databases) and/or transmitted (eg, wired and/or wirelessly, eg, using a network).

In some embodiments, the optically identifiable identification may be, for example, a machine-readable code RFID consisting of a digital photograph. A digital photograph may contain an array or line of two distinctly recognizable tones (eg, colors). A digital photograph may contain an array of black and white squares or lines (eg, a barcode or quick response (QR) code). Travelers may use a mobile device (eg, a cellular smart phone) or an associated peripheral device (eg, a barcode scanner) to record and/or scan the device's identification. In some embodiments, an RFID (eg, UWB ID) tag is attached to the device. Radio Frequency Identification (RFID) utilizes electromagnetic fields to automatically identify and/or track tags attached to devices. RFID tag cameras include (eg, micro) radio transponders, radio receivers, and transmitters. The reader of the RFID tag can send electromagnetic interrogation pulses, and the tag can respond by transmitting digital data (eg, identifying inventory numbers) back to the reader. Tags can be passive (eg, powered by energy from interrogating radio waves from an RFID reader) or active (eg, battery powered). Active RFID tags can have a larger range than passive RFID tags. For example, an active RFID can have a range of at least about 20m, 50m, 100m, or 500m. ID codes (eg, barcodes or QR codes) may need to be within the (eg, human) pedestrian's line of sight. The ID code (eg, RFID) may not be within the line of sight of a (eg, human) traveler, but within the range of a reader (eg, a sensor). The data capture may be automatic identification and data capture (AIDC). ID tags may contain microchips. ID tags and/or codes can be attached to (and/or embedded in) any device to be identified.

In some embodiments, the ID tag is an image-recognizable identifier (eg, a barcode or QR code). The image distinguishable identifier can be any of a variety of identifiers that can be provided in an image obtained by an image capture device. In various embodiments, the image of the image-recognizable identifier may be interpreted by image analysis logic to determine the code or other information encoded or otherwise represented by the identifier.

In some embodiments, the image-distinguishable identifier includes a pattern that contains information in the spatial arrangement of elements in the pattern. A configuration can contain information in one, two, or three dimensions. It can be in the form of dots, strips, polygons and/or other shapes. The identifiers can be detected in any one or more ranges of the electromagnetic spectrum, including the visible range, the ultraviolet range, the infrared range and/or the radio frequency range. Identifiers can be detected by reflection, absorption, refraction, fluorescence, luminescence, and/or other electromagnetic (EM) wave interactions. Examples of image-distinguishable identifiers include barcodes, QR codes, and the like. Image-distinguishable identifiers can occur in a wide range of sizes and/or shapes. In certain embodiments, the identifier has a base length scale (FLS) of at least about 10 cm or 15 cm (eg, the identifier may be about 10 cm x 10 cm or more, or the identifier may be about 15 cm x 15 cm or larger). The basic length scale (FLS) contains the height, length, width, diameter or diameter of the bounding circle.

The application of the image-distinguishable identifier to the device (or any component associated with it) can occur at any point prior to updating the digital avatar. In some embodiments, the application is performed at the manufacturing site. Here, an identifier may be associated with a device. In some embodiments, the identifier is permanently or temporarily affixed to the device. In some cases, the identifiers are provided as stickers, polymeric peel-off stickers, and the like. In some cases, the identifier is embedded within the device (eg, RFID).

An identifier can be applied to any area of a device or device-associated component that can retrieve an ID using a capture device. Examples include transparent or reflective windows, including optically switchable windows, window frames, window controls, sensors or sensors associated with windows, mullions, and/or non-window IGU components such as spacers. Tester collective.

In some embodiments, this can be achieved by placing a camera or other image capture device in the area and moving the image capture device to capture images of windows in the area or some identifiable feature of the windows. Obtain an image of the device in the Enclosed Zone. A mobile image capture device may include a pivoting or rotating device while it remains at a fixed orientation in a room or area. Pivoting or rotating may allow the device to capture images at multiple angles in the zone relative to a fixed orientation. In some embodiments, the image capture device is positioned at or near the geometric center of the room or other area. Moving the image capture device may alternatively or additionally include moving the physical location of the device to a number of different locations within the region.

In some embodiments, the image capture device and/or associated logic are configured to capture a sequence of images and stitch the images together to form a Panoramic view. In some embodiments, the camera scans an arc of the room, eg, at least about a 90° arc, a 180° arc, a 270° arc, or a full 360° circle. In certain embodiments, the time elapsed to capture the sequence of images is at most about 1 hour, 30 minutes, or 15 minutes. At this time, the device can capture images of at least about 4 devices, 7 devices, or 10 devices. In some embodiments, the image capture device is configured to capture multiple images of the device or device component from a distance (eg, as opposed to the need to hold the manual capture device individually adjacent to each window or its logo) . The image capture device and any associated equipment (eg, a tripod or other mount) can be moved from one area of the enclosure to another (eg, from room to room in the building being commissioned).

In some embodiments, the commissioning logic or other suitable logic is configured to compare the panoramic image or sequence of images from the region of the enclosure with the architectural representation of the region so that the devices in the image can be compared with the actual size of the windows in the enclosure location associated. In some implementations, the logic is configured to overlay the imagery on a three-dimensional drawing, such as an architectural drawing. The logic can be configured to determine on a multidimensional (eg, 2D or 3D) graph where a particular imaging device is located. The representation of the physical location of the device in the enclosure may be provided in a digital avatar, interconnection drawing, architectural drawing, or other representation of a building. In some embodiments, the logic employs a floor plan, which can be created from architectural drawings. In some embodiments, the logic employs an interconnection schema that can depict the wiring of electrical wiring at areas of a building (eg, trunks), the location of various devices on a network (eg, controllers, power supplies, control panels, windows, and sensors) and/or identification information (eg, network ID) of network components. In some embodiments, the logic employs wireframe models from CAD software, such as Trimble Navigation's SketchUp™, Autodesk Revit, or the like. "Commissioning logic" may include programs implemented in software, on one or more controllers of a window network, and/or on one or more processors of a computing system (which may be a stand-alone or distributed computing system) .

In some embodiments, the image and its physical location, as captured by the device, are provided to software that recognizes the device as (i) in the image capture information, (ii) by means of a sense in the enclosure A network of detectors and/or transmitters and/or (iii) a unique identifier for a particular device location identified by any other geolocation technique (eg, as disclosed herein).

In some embodiments, individual devices are not associated with a particular network address. This association can be accomplished during or after the device is manufactured and before the device is installed in the enclosure and coupled to the network. Network association of a device may involve creating an association between the device's unique physical identifier (eg, as retrieved by an ID retrieval device) and the device's network identifiable identifier. The network identifiable identifier of the device may be a serial number or other electronic identifier of the device stored in at least one database. The at least one database can be stored in memory. The memory can reside on the chip or in another device (eg, a server) that can be read by the network when the device is installed. In some embodiments, the network recognizable identifier is provided in a readable chip such as a memory chip in a pigtail of a window.

To allow debugging, the ID code can be associated with a device's characteristics and/or components (eg, window ID, serial number, or other data electronically encoded and stored on a network-readable component of the window). The association can be stored in at least one table, database and/or other data construct.

In some cases, multi-dimensional (eg, a two-dimensional or three-dimensional model of a building (eg, included in a digital avatar)) is generated by computer-aided design software with capabilities for the design and inspection of building structures model environment. In some cases, pairing the network ID of each of the shadeable (eg, optically switchable) windows with the at least one network node ID includes storing each pairing in a network configuration file. A node may be a device that is operatively (eg, communicatively) coupled to a network.

In some embodiments, the enclosure includes an area bounded by at least one structure. At least one structure may comprise at least one wall. An enclosure may contain and/or enclose one or more sub-enclosures. At least one wall may comprise metal (eg, steel), clay, stone, plastic, glass, plaster (eg, gypsum), polymer (eg, polyurethane, styrene, or vinyl), asbestos, fibers Glass, concrete (eg reinforced concrete), wood, paper or ceramic. At least one wall may comprise wire, bricks, blocks (eg, cinder blocks), tiles, drywall, or frames (eg, steel frames).

In some embodiments, the closure includes one or more openings. The one or more openings may be reversibly closed. One or more openings may be permanently open. The base length scale of the one or more openings may be relatively small relative to the base length scale of the walls defining the closure. The basic length scale can include the diameter, length, width or height of the bounding circle. The surface of the one or more openings may be relatively small relative to the surface of the wall defining the closure. The open surface may be a percentage of the total surface of the wall. For example, the open surface may measure up to about 30%, 20%, 10%, 5% or 1% of the wall. Walls can include floors, ceilings, or side walls. The closable opening may be closed by at least one window or door. The enclosure may be at least a portion of the facility. Facilities may contain buildings. The enclosure may contain at least a portion of the building. The buildings can be private buildings and/or commercial buildings. A building can contain one or more floors. A building (eg, its floors) may include at least one of the following: rooms, halls, foyers, attics, basements, balconies (eg, interior or exterior balconies), stairwells, hallways, elevator shafts, facades, mezzanine levels , attic, garage, porch (eg, enclosed porch), patio (eg, enclosed patio), cafeteria, and/or plumbing. In some embodiments, the enclosure may be stationary and/or movable (eg, a train, airplane, cruise ship, vehicle, or rocket).

In some embodiments, a plurality of target devices may be operatively (eg, communicatively) coupled to a control system. A plurality of devices may be placed in a facility (eg, including buildings and/or rooms). A control system may include a hierarchy of controllers. A target device may include an emitter, a sensor, or a (eg, tintable) window (eg, an IGU). The device can be any device as disclosed herein. At least two of the plurality of devices may be of the same type. For example, two or more IGUs may be coupled to the control system. At least two of the plurality of devices may be of different types. For example, sensors and transmitters can be coupled to a control system. Sometimes, the plurality of devices may include at least 20, 50, 100, 500, 1000, 2500, 5000, 7500, 10000, 50000, 100000, or 500000 devices. The plurality of devices can be any number between the foregoing numbers (eg, 20 devices to 500,000 devices, 20 devices to 50 devices, 50 devices to 500 devices, 500 devices to 2500 devices, 1000 devices to 5,000 devices, 5,000 devices to 10,000 devices, 10,000 devices to 100,000 devices, or 100,000 devices to 500,000 devices). For example, the number of windows in a floor may be at least 5, 10, 15, 20, 25, 30, 40 or 50. The number of windows in a floor can be any number between the foregoing numbers (eg, 5 to 50, 5 to 25, or 25 to 50). In some cases, devices may be in multi-storey buildings. At least a portion of the floors of the multi-story building may have devices controlled by the control system (eg, at least a portion of the floors of the multi-story building may be controlled by the control system). For example, a multi-story building may have at least 2, 8, 10, 25, 50, 80, 100, 120, 140 or 160 floors controlled by the control system. The number of floors (eg, devices therein) controlled by the control system can be any number between the foregoing numbers (eg, 2 to 50, 25 to 100, or 80 to 160). A floor may have an area of at least about 150 m ² , 250 m ² , 500 m ² , 1000 m ² , 1500 m ² or 2000 square meters (m ² ). Floors can have an area between any of the foregoing floor area values (eg, about 150 m ² to about 2000 m ² , about 150 m ² to about 500 m ² , about 250 m ² to about 1000 m ² or about 1000 m ² to about 2000 m ² ).

Certain disclosed embodiments provide network infrastructure in an enclosure (eg, a facility such as a building). Network infrastructure may be used for various purposes, such as for providing communication and/or power services. Communication services may include high bandwidth (eg, wireless and/or wireline) communication services. Communication services may be directed to occupants of the facility and/or users outside the facility (eg, a building). The network infrastructure may work in conjunction with or replace part of the infrastructure of one or more cellular operators. The network infrastructure may be provided in a facility that includes electrically switchable windows. Examples of components of network infrastructure include high-speed backhaul. The network infrastructure may include at least one cable, switch, physical antenna, transceiver, sensor, transmitter, receiver, radio, processor and/or controller (which may include a processor). The network infrastructure may be operatively coupled to and/or include a wireless network. Network infrastructure can include cabling. One or more sensors may be deployed (eg, installed) in the environment as part of and/or after the network is installed. The network may be a local area network. A network may include cables configured to transmit power and communications in a single cable. The communication can be one or more types of communication. The communication may include cellular communication complying with at least second generation (2G), third generation (3G), fourth generation (4G) or fifth generation (5G) cellular communication protocols. Communications may include media communications that facilitate streaming of still images, music, or animation (eg, movies or video). Communication may include data communication (eg, sensor data). Communication may include control communication, eg, to control one or more nodes operatively coupled to a network. The network may include the first (eg, cabling) network installed in the facility. A network may include a network (eg, cabling) installed in the envelope of the facility (eg, in the envelope of an enclosure such as the facility. For example, included in the envelope of a building in the facility).

In various embodiments, the network infrastructure supports a control system for one or more windows such as tintable (eg, electrochromic) windows. The control system may include one or more controllers operatively coupled (eg, directly or indirectly) to the one or more windows. Although the disclosed embodiments describe tintable windows (also referred to herein as "optically switchable windows" or "smart windows"), such as electrochromic windows, the concepts disclosed herein may be applicable to other types of tintable windows. Switching optical devices, including liquid crystal devices, electrochromic devices, suspended particle devices (SPD), NanoChromics displays (NCD), organic electroluminescent displays (OELD), suspended particle devices (SPD), NanoChromics displays (NCD) or organic Electroluminescent Display (OELD). The display element may be attached to a portion of the transparent body, such as a window. Tintable windows can be placed in (non-transitory) installations such as buildings, and/or in temporary installations such as automobiles, RVs, buses, trains, airplanes, helicopters, ships, or boats (eg, vehicles) middle.

In some embodiments, a tintable window exhibits a (eg, controllable and/or reversible) change in at least one optical property of the window, eg, upon application of a stimulus. The changes may be continuous changes. Changes may be for discrete shading levels (eg, for at least about 2, 4, 8, 16, or 32 shading levels). Optical properties may include hue or transmittance. Hue can contain color. The transmittance can have one or more wavelengths. The wavelengths may include ultraviolet wavelengths, visible wavelengths, or infrared wavelengths. Stimulation may include optical, electrical and/or magnetic stimulation. For example, stimulation may include applied voltage and/or current. One or more tintable windows can be used to control lighting and/or glare conditions, for example, by modulating the transmission of solar energy propagating therethrough. One or more tintable windows can be used to control temperature within a building, for example, by regulating the transmission of solar energy propagating through the windows. Control of solar energy can control the thermal load imposed on the interior of a facility (eg, a building). The control may be manual and/or automatic. Controls may be used to maintain one or more requested (eg, environmental) conditions, eg, occupant comfort. The control may include reducing energy consumption of heating, ventilation, air conditioning and/or lighting systems. At least two of heating, ventilation and air conditioning can be induced by individual systems. At least two of heating, ventilation and air conditioning can be induced by one system. Heating, ventilation and air conditioning can be induced by a single system (abbreviated herein as "HVAC"). In some cases, the tintable window may be responsive to (eg, and communicatively coupled to) one or more environmental sensors and/or user controls. Tintable windows can include (eg, can be) electrochromic windows. Windows can be positioned from the interior to the exterior of a structure (eg, a facility, such as a building). However, this need not be the case. Tintable windows may be operated using liquid crystal devices, suspended particle devices, microelectromechanical systems (MEMS) devices such as microshutters, or any technology currently known or later developed that is configured to control the transmission of light through the window. Windows (eg, with MEMS devices for coloring) are described in US Patent No. 10,359,681, filed on May 15, 2015, and issued July 23, 2019, entitled "MULTI-PANE WINDOWS INCLUDING ELECTROCHROMIC DEVICES AND ELECTROMECHANICAL SYSTEMS DEVICES" No. , this US patent is incorporated herein by reference in its entirety. In some cases, one or more tintable windows may be located within the building, such as between a conference room and a hallway. In some cases, one or more tinted windows may be used in automobiles, trains, airplanes, and other vehicles, eg, in place of passive and/or non-tinted windows.

Electrochromic windows can be used in various settings, such as in office and residential buildings. The complexity of many conventional electrochromic windows (eg, wiring, installation and programming of controllers, etc.) may hinder their use. For example, a residential customer may have windows installed by a local contractor who may not be familiar with electrochromic windows and their installation requirements. Accordingly, one goal of certain disclosed embodiments is to provide an electrochromic IGU and window assembly that is easily installed as a non-electrochromic window. Some of the disclosed features that facilitate easy installation include wireless and/or self-powered capabilities, wireless control communications, self-meshing networking, onboard controllers, automated commissioning, and commonly available windows (eg, dual pane or triple The appearance size of the pane IGU) matches. Ease of installation may refer to installation that is quick, requires minimally qualified labor, is robust (eg, not prone to errors), and is inexpensive. Other target devices that may be included in various embodiments include cellular or other antennas (eg, provided on windows), cellular repeaters (eg, in controllers), touch panel controls (eg, attached to media) display structure), installable and/or removable controllers, learning functionality, weather tracking, sharing of sensor outputs and other control information (eg, between devices coupled to a network such as windows), This includes sub-frames of certain controller components, wireless busses, optical (eg, built-in light) sensors, other sensors, and the like. Any two or more of these target devices may be combined as required for a particular application.

The challenge presented by deploying a target device (eg, a target device of nascent electrochromic window technology) in an enclosure is the network address and/or another identifying information to a specific target device (eg, a window) and its electrical control correct assignment of the location of target devices (eg, windows and/or window controllers) in a facility (eg, a building).

In some embodiments, control of the target device by the control system necessitates the coupling of the control to the target device that is (i) correctly identified by the control system and/or network, (ii) at a particular position, and (iii) are of a specific type. For example, to control the shading control of a tintable window (eg, to allow a control system to change the shading state of a particular window or IGU or a set of particular windows or IGUs), the (eg, master) controller (responsible for shading decisions) may Have the network address of the window controller connected to that particular window or set of windows. For example, in order to control the temperature of the atmosphere in a room of a building (eg, to allow the control system to change the tint state of an HVAC component or a collection of HVAC components), the controller (responsible for ambient temperature) may have a device coupled to that specific The network address of the room's HVAC components (eg, vents and blower units).

In some embodiments, manual (eg, user) control of target devices affecting one or more specific locations in the enclosure depends on a combination of unique information about each target device's identification, installation location, and/or capabilities gather. Unique information about each target device can be incorporated into the digital avatar of the enclosure. The control interface to the avatar can be configured to allow authorized users to initiate changes in the operation of the target device in a direct manner, for example, because the avatar links each represented target element with (eg, all) required information to select and/or control the target device.

For example, a challenge presented by tintable (eg, electrochromic) window technology is the manual control of the tinting state in particular windows (eg, electrochromic devices) in buildings with many such tintable windows. Related to this is accessing information about individual tintable (eg, electrochromic) windows or partitions in buildings with many tintable windows. Building managers and/or occupants may require at least some control over some (or all) tintable (eg, electrochromic) windows in a facility (eg, building).

In some embodiments, an IGU or other window assembly is provided as a simple, self-contained, ready unit that requires at most minimal physical connections (eg, wires) prior to use. This unit may look like a non-tintable (eg, electrochromic) IGU or window assembly (with a controller somewhere in or on it). Colorable (eg, electrochromic) IGUs can be installed in substantially the same manner as non-colorable IGUs. These embodiments may be beneficial to residential customers who require fast installation without significant additional work associated with wiring electrical power, communication lines, and the like.

In some embodiments of the electrochromic device, the first and second electrochromic layers include a cathodic coloring layer and an anodic coloring layer. In such embodiments, the first and second electrochromic layers will be colored when exposed to opposite polarities. For example, a first electrochromic layer can be colored at an applied cathodic potential (and clear at an applied anodic potential), while a second electrochromic layer can be colored at an applied anodic potential (and clear at an applied anodic potential) clear at the applied cathodic potential). Of course, for some applications, the configuration can be reversed. Regardless, the first and second electrochromic layers can work together to color and clear.

In some embodiments, one of the first and second electrochromic layers may be replaced by a non-electrochromic ion storage layer. In such cases, (eg, only) one of the two layers exhibits electrochromism, such that it is colored and clear under application of a suitable potential. The other layer, sometimes referred to as the counter electrode layer, simply acts as an ion reservoir when the other layer is exposed to the cathode potential.

In some embodiments, the device stack has different layers, while in other embodiments, the electrochromic stack may be a hierarchical structure or may include additional components such as antenna structures. Although some of the discussion in this disclosure focuses on windows having electrochromic devices, this disclosure may more generally relate to windows having any type of optically switchable device, such as liquid crystal devices and suspended particle devices, and pertains to target devices other than tintable windows, including any electrically controllable device such as sensors, transmitters, collections of sensors and/or transmitters, media display constructs, antennas, routers, transceivers, controllers ( For example, microcontrollers), processors, tables, chairs, doors, lighting devices, heaters, ventilators, air conditioners, alarm clocks, or any other identifiable device associated with the facility.

FIG. 1 depicts an electrochromic device 100 disposed on a substrate 102 . The device 100 includes a first conductive layer 104, a first electrochromic layer (EC1) 106, an ionic conductor layer (IC) 108, a second electrochromic layer (EC2) 110, and a second conductive layer 112 in the following order starting from the substrate . Components 104 , 106 , 108 , 110 and 112 are collectively referred to as electrochromic stack 114 . In some embodiments, the transparent conductor layer is made of a transparent material such as transparent conductive oxide (which may be referred to as "TCO"). Since the TCO layer is transparent, the coloring behavior of the EC1-IC-EC2 stack can be observed through the TCO layer, for example, allowing the use of such devices on windows for reversible coloring. A voltage source 116 operable to apply a potential across the electrochromic stack 114 effectuates the transition of the electrochromic device from, for example, a clear state (ie, transparent) to a colored state. In some embodiments, the electrochromic device may not include layers of different ionic conductors. See US Patent No. 8,764,950, issued July 1, 2014, and PCT Publication No. WO2015/168626, filed May 1, 2015, which are incorporated herein by reference in their entirety .

In some embodiments, the IGU includes two (or more) substantially transparent substrates, such as two glass panes, wherein at least one of the substrates includes an electrochromic device disposed thereon, and the panes have an electrochromic device disposed thereon dividers in between. The IGU may be hermetically (eg, gas) sealed, having an interior region isolated from the surrounding environment. A "window assembly" may include an IGU or, for example, a separate laminate, and include electrical leads for connecting the IGU or laminate of one or more electrochromic devices to voltage sources, switches, and the like, and A frame to support the IGU or laminate may be included. A window assembly may include, or be operatively (eg, communicatively coupled to) a window controller (eg, as described herein) and/or components of a window controller (eg, adapters) and/or such components.

A window controller can have many sizes, formats, and positions relative to the optically switchable windows it controls. The controller can be attached to the IGU and/or the glass of the laminate. The controller can be placed in a frame that houses the IGU and/or laminate. Tintable (eg, electrochromic) windows can include one, two, three, or more individual electrochromic panes (electrochromic devices on transparent substrates). Individual panes of an electrochromic window can have an electrochromic coating with individually tintable zones. A controller as described herein can control all electrochromic coatings associated with such windows, whether the electrochromic coatings are monomeric or zoned.

The controller can typically be placed in close proximity to the tintable (eg, electrochromic) window, typically adjacent to, on the glass, or within the IGU (eg, within the frame of a self-contained assembly). In some embodiments, the window controller is an "in-situ" controller; that is, the controller is part of the window assembly, IGU, and/or laminate. The controller may not necessarily have to match the tintable window and be installed in the field, eg the controller travels with the window as part of the assembly from the factory. The controller may be mounted in the sash of the window assembly or be part of the IGU and/or laminate assembly. The controller can be mounted on the panes of the IGU or between the panes of the IGU or on the panes of the laminate. Where the controller is located on a visible portion of the IGU, at least a portion of the controller may be (eg, substantially) transparent. Additional examples of controllers on glass are provided in US Patent Application Serial No. 14/951,410, filed November 24, 2015, entitled "SELF CONTAINED EC IGU," which is incorporated by reference in its entirety in this article. In some embodiments, the local controller is provided as more than one part, wherein at least one part (eg, including a memory component that stores information about the associated tintable window) is provided as part of the window assembly, and at least One other portion is separate and configured to mate with at least one portion that is part of the window assembly, IGU or laminate. In some embodiments, the controller is an assembly of interconnected portions that are not in a single housing but are spaced apart (eg, in a secondary seal of the IGU). In some embodiments, the controller is a compact unit, such as in a single housing or in a combination of two or more components (eg, a connector and housing assembly) proximate the glass, Not in viewable area or mounted on glass in viewable area.

In one embodiment, the controller is incorporated into or on the IGU and/or window frame prior to installation of the tintable window. In one embodiment, the controller is incorporated into or on the IGU and/or sash before leaving the manufacturing facility. In one embodiment, the controller is incorporated into the IGU, substantially within the secondary seal. In another embodiment, the controller is incorporated into or on the IGU, partially, substantially or completely within the perimeter defined by the primary seal between the sealing spacer and the substrate.

Where the controller is made as part of the IGU and/or window assembly, the IGU may possess, for example, the logic and/or features of the controller that travels with the IGU or window unit. For example, when the controller is part of an IGU assembly with an electrochromic window, in the event that the characteristics of the electrochromic device change over time (eg, through degradation), the characterization function can be used, for example, to update the Control parameters to drive shading state transitions. In another embodiment, if installed in a tintable window unit, the logic and/or features of the controller may be used to calibrate one or more of the control parameters, eg, to match the intended installation. If installed, one or more control parameters may be recalibrated to match the performance characteristics of the tintable window.

In some embodiments, the controller is not pre-associated with the windows, but instead is associated with each window at the factory, for example, at the factory with an adapter assembly having a portion common to any tintable window. After the window is installed or otherwise in the field, the second component of the controller can be combined with the adapter component to complete the tintable window controller assembly. The adapter assembly may include a wafer programmed at the factory with the physical properties and/or parameters of the particular window to which the adapter is attached (eg, on a surface that will face the interior of a building after installation, sometimes referred to as for Surface 4 or "S4"). A second component (sometimes referred to as a "carrier," "housing," "housing," or "controller") can mate with the connector, and when powered, the second component can read the chip and store on the chip according to The specific characteristics and parameter configuration of the device itself powers the window. In this way, a shipped window (eg, only) needs to have its associated parameters stored on a wafer integral with the window, while more complex circuitry and components can later be combined (eg, shipped separately and fabricated from the window). The manufacturer installs the window after the glazier has installed the window, and is then commissioned by the window manufacturer). In some embodiments, the wafer is included in a wire or wire connector attached to the window controller. Such wires with connectors are sometimes called pigtails.

As used herein, the term "outside" means closer to the outside environment, and the term "inside" means closer to the interior of the building. For example, in the case of an IGU with two panes, the pane positioned closer to the outside environment is called the outside pane or outer pane, and the pane positioned closer to the interior of the building is called the inside pane or inner pane. The different surfaces of the IGU may be referred to as S1, S2, S3 and S4 (assuming a two pane IGU). S1 refers to the exterior-facing surface of the outer pane (ie, the surface that can be physically touched by someone standing outside). S2 refers to the inward facing surface of the outer pane. S3 refers to the outwardly facing surface of the inner pane. S4 refers to the interior facing surface of the inner pane (ie, the surface that can be physically touched by someone standing inside the building). In other words, starting from the outermost surface of the IGU and counting inwards, the surfaces are labeled S1 through S4. This same trend holds where the IGU includes three panes (where S6 is a surface that can be physically touched by someone standing inside the building). In some embodiments employing two panes, an electrochromic device (or another optically switchable device) is placed on S3.

Examples of Tintable Windows, Window Controllers, Methods of Using the Same, and Features therefor are presented in US Patent Application Serial Nos. 15/334,832 and 2018, filed Oct. 26, 2016, entitled "CONTROLLERS FOR OPTICALLY-SWITCHABLE DEVICES" US Patent Application Serial No. 16/082,793, entitled "METHOD OF COMMISSIONING ELECTROCHROMIC WINDOWS," filed on September 6, 2009, each of which is incorporated herein by reference in its entirety.

2 shows a description of a system 200 for controlling and driving a plurality of shadeable windows. It can be used to control the operation of one or more devices associated with a tintable window, such as a window antenna. System 200 may be adapted for use with facilities including commercial office buildings or residential buildings (eg, building 204). In some embodiments, system 200 is designed to function as a system for the entire building 204 or building 204 in conjunction with a modern heating, ventilation, and air conditioning (HVAC) system 206, interior lighting system 207, security system 208, and power system 209 A single integrated and efficient energy control system for the park. Some embodiments of system 200 are particularly suitable for integration with building management system (BMS) 210 . The BMS 210 is a computer-based control system that can be installed in a building to monitor and control the building's mechanical and electrical equipment, such as HVAC systems, lighting systems, electrical systems, elevators, fire protection systems, and security systems. BMS 210 may include hardware and associated firmware or software for maintaining conditions in building 204 according to preferences set by occupants or by building managers or other administrators. The software may be based on, for example, the Internet Protocol or open standards.

A BMS can be used in larger buildings where the BMS is used to control the environment within the building. For example, BMS 210 may control lighting, temperature, carbon dioxide levels, and/or humidity within building 204 . There may be several (eg, numerous) mechanical and/or electrical devices controlled by the BMS 210, including, for example, furnaces or other heaters, air conditioners, blowers, and/or vents. To control the building environment, the BMS 210 may switch these various devices on and off, eg, according to rules and/or in response to conditions. Such rules and/or conditions may be selected and/or specified by users (eg, building managers and/or administrators). One function of BMS 210 may be, for example, to maintain a comfortable environment for the occupants of building 204 while minimizing heating and cooling energy losses and costs. In some embodiments, the BMS 210 is (eg, not only) configured to monitor and control, but is also configured to optimize synergies between the various systems, eg, to save energy and reduce building operating costs.

Some embodiments are designed to act responsively or reactively based on feedback. Feedback control schemes may include measurements sensed via, for example, thermal sensors, optical sensors, or other sensors. Feedback control schemes may include input from HVAC, interior lighting systems, and/or input from user controls. An example of a control system, method of use thereof, and associated software can be found in US Patent No. 8,705,162, issued April 22, 2014, which is incorporated herein by reference in its entirety. Some embodiments are used in existing structures, including, for example, commercial and/or residential structures with conventional or conventional HVAC and/or interior lighting systems. Some embodiments are tailored for use in older facilities (eg, residential homes).

The system 200 includes a network controller 212 configured to control a plurality of window controllers 214 . For example, one network controller 212 can control at least tens, hundreds or thousands of window controllers 214 . Each window controller 214 in turn can control and drive one or more electrochromic windows 202 . In some embodiments, the network controller 212 may issue high-level instructions, such as the final shaded state of a shadeable window. A window controller may receive these commands and directly control its associated window, eg, by applying electrical stimulation, to appropriately drive shaded state transitions and/or maintain shaded states. The number and size of tintable (eg, electrochromic) windows 202 that each window controller 214 can drive can typically be controlled by the voltage and/or current characteristics of the load on the window controller 214 of the respective electrochromic window 202 limit. In some embodiments, the maximum window size that the window controller 214 can drive is limited by the voltage, current, and/or power requirements to cause the requested optical transition of the electrochromic window 202 within the requested time frame. Such requirements are in turn a function of the surface area of the window. In some embodiments, this relationship is non-linear. For example, the voltage, current, and/or power requirements may increase non-linearly with the surface area of the electrochromic window 202 . Without wishing to be bound by theory, in some cases the relationship is non-linear due, at least in part, to the sheet resistance of the first and second conductive layers as a function of the length and width of the first or second conductive layers The distance increases nonlinearly. In some embodiments, the relationship between the voltage, current, and/or power requirements required to drive multiple electrochromic windows 202 of equal size and shape is proportional to the number of electrochromic windows 202 driven.

FIG. 2 shows an example of a master controller 211 . The master controller 211 communicates and operates in conjunction with a plurality of network controllers 212, each of which is capable of addressing a plurality of window controllers 214. In some embodiments, host controller 211 issues high-level instructions (such as the final shaded state of a shadeable window) to network controller 212 , and network controller 212 then communicates the instructions to corresponding window controllers 214 . 2 shows an example of a hierarchical control system including a main controller, a network controller, and a window controller.

In some implementations, various electrochromic windows 202, antennas, and/or other target devices of a facility (eg, including a building or other structure) (eg, advantageously) are grouped into zones or groups of zones (eg, the various Each of the electrochromic window 202, the antenna, and/or other target device includes a subset of the electrochromic window 202). For example, each partition can correspond, based at least in part on its location, to a set of electrochromic windows 202 in a particular location or region of the facility that should be colored (or otherwise transformed) to the same or similar optical state . As another example, consider a building with four faces or sides: north, south, east, and west. Consider the building has ten floors. In this example, each partition may correspond to a set of electrochromic windows 202 on a particular floor and on a particular one of the four sides. In some such embodiments, each network controller 212 may address one or more partitions or groups of partitions. For example, the master controller 211 may issue final shading state commands for a particular partition or group of partitions to respective one or more of the network controllers 212 . For example, the final shaded state command may include an abstract identification of each of the target partitions. The designated network controller 212 receiving the final shading state command may then map the abstract identification of the partition to the specific network bit of the respective window controller 214 that controls the voltage or current profile to be applied to the electrochromic window 202 in the partition site.

In some embodiments, a distributed network of controllers is used to control the optically switchable windows. For example, according to some implementations, the network system is operable to control a plurality of IGUs. One major function of the network system may be to control the optical state of the electrochromic device (or other optically switchable device) within the IGU.

In some embodiments, another function of the network system is to obtain state information (eg, data) from the IGU. For example, state information for a given IGU may include an identification of, or information about, the current shading state of shadeable devices within the IGU. The network system is operable to obtain data from various sensors, such as temperature sensors, photosensors (referred to herein as light sensors), humidity sensors Sensors, air flow sensors or occupancy sensors, antennas, whether integrated on or within the IGU or located at various other locations in, on or around the building. At least one sensor can be configured (eg, designed) to measure one or more environmental characteristics, such as temperature, humidity, environmental noise, carbon dioxide, VOCs, particulate matter, oxygen, and/or any other state of the environment sample (eg, its ambience). The sensors may include electromagnetic sensors.

Electromagnetic sensors can be configured to sense ultraviolet radiation, visible radiation, infrared radiation, and/or radio wave radiation. The infrared radiation may be passive infrared radiation (eg, black body radiation). Electromagnetic sensors can sense radio waves. Radio waves may include broadband or ultra-broadband radio signals. The radio waves may include pulsed radio waves. Radio waves may include radio waves used in communications. The radio waves can be at an intermediate frequency of at least about 300 kilohertz (KHz), 500 KHz, 800 KHz, 1000 KHz, 1500 KHz, 2000 KHz, or 2500 KHz. Radio waves can be at intermediate frequencies of up to about 500 KHz, 800 KHz, 1000 KHz, 1500 KHz, 2000 KHz, 2500 KHz, or 3000 KHz. The radio waves can be at any frequency between the aforementioned frequency ranges (eg, about 300 KHz to about 3000 KHz). Radio waves can be at high frequencies of at least about 3 megahertz (MHz), 5 MHz, 8 MHz, 10 MHz, 15 MHz, 20 MHz, or 25 MHz. Radio waves can be at high frequencies up to about 5 MHz, 8 MHz, 10 MHz, 15 MHz, 20 MHz, 25 MHz, or 30 MHz. The radio waves can be at any frequency between the aforementioned frequency ranges (eg, about 3 MHz to about 30 MHz). Radio waves can be at very high frequencies of at least about 30 megahertz (MHz), 50 MHz, 80 MHz, 100 MHz, 150 MHz, 200 MHz, or 250 MHz. Radio waves can be at very high frequencies of up to about 50 MHz, 80 MHz, 100 MHz, 150 MHz, 200 MHz, 250 MHz, or 300 MHz. The radio waves can be at any frequency between the aforementioned frequency ranges (eg, about 30 MHz to about 300 MHz). Radio waves can be at ultra-high frequencies of at least about 300 kilohertz (MHz), 500 MHz, 800 MHz, 1000 MHz, 1500 MHz, 2000 MHz, or 2500 MHz. Radio waves can be at ultra-high frequencies of up to about 500 MHz, 800 MHz, 1000 MHz, 1500 MHz, 2000 MHz, 2500 MHz, or 3000 MHz. The radio waves can be at any frequency between the aforementioned frequency ranges (eg, about 300 MHz to about 3000 MHz). Radio waves can be at ultra-high frequencies of at least about 3 gigahertz (GHz), 5 GHz, 8 GHz, 10 GHz, 15 GHz, 20 GHz, or 25 GHz. Radio waves can be at ultra-high frequencies of up to about 5 GHz, 8 GHz, 10 GHz, 15 GHz, 20 GHz, 25 GHz, or 30 GHz. The radio waves can be at any frequency between the aforementioned frequency ranges (eg, about 3 GHz to about 30 GHz).

The network system may include any suitable number of distributed controllers having various capabilities or functions. In some embodiments, the functions and configurations of the various controllers are defined hierarchically. 3 shows an example of a network system 300 that includes a plurality of distributed local (eg, window) controllers (WC) 304, a plurality of floor (eg, network) controllers (NC) 306, and a master controller ( MC) 308. In some embodiments, the MC 308 may communicate with and control at least two, ten, tens, one hundred, or hundreds of floors using a floor controller (eg, a network controller NC) 306 . The floor controller can be configured to control a floor or a portion of a floor. In various embodiments, master controller MC 308 issues high-level instructions to NC 306 via one or more wired and/or wireless communication links. Such instructions may include, for example, shading commands for causing transitions in the optical states of the IGUs controlled by the respective NCs 306 . Each NC 306, in turn, may communicate with and control a number of window controllers (WCs) 304 via one or more wired and/or wireless links. The communication link may be a bidirectional communication link.

The MC 308 may issue communications including shading commands, status request commands, data (eg, sensor data) request commands, or other instructions. In some embodiments, the MC 308 periodically, at certain predefined times of the day (which may vary based on the day of the week or year), or based at least in part on detection of a particular event, condition, or A combination of events or conditions (eg, as determined by acquired sensor data, or based at least in part on receipt of a request initiated by a user and/or by an application or this sensor data and this request combination) to publish such communications. In some embodiments, MC 308 generates or selects a shading value corresponding to the requested shading state when MC 308 determines to cause a change (eg, change) in the shading state in the set of one or more IGUs. In some implementations, the set of IGUs is associated with a first agreement identifier (ID) (eg, a building automation and control (BAC) network identification (BACnet ID)). The MC 308 may then generate and transmit communications including the shading value and the first protocol ID, referred to herein as "primary shading commands," over the link via a first communication protocol (eg, a BACnet compliant protocol). In some embodiments, the MC 308 may address the primary shading commands to a specific NC 306 that controls a specific one or more WCs 304, which in turn control the set of IGUs to transition. NC 306 may receive a primary shading command including a shading value and a first protocol ID, and map the first protocol ID to one or more second protocol IDs. In some embodiments, each of the second protocol IDs identifies a corresponding one of the WCs 304 . The NC 306 may then transmit an auxiliary shading command including the shading value to each of the identified WCs 304 over the link via the second communication protocol. In some embodiments, each of the WCs 304 receiving the auxiliary shading command then selects a voltage and/or current profile from internal memory based on the shading value to drive its respectively connected IGU to a shading state consistent with the shading value. Each of the WCs 304 may then generate voltage and/or current signals and provide these signals via links to their respectively connected IGUs to apply the voltage or current profiles.

In a manner similar to how the function and/or configuration of a controller can be hierarchically configured, tintable windows can be configured in a hierarchical structure. Hierarchical structures can help facilitate control of tintable windows at a particular location by allowing rules or user controls to be applied to various groupings of tintable windows or IGUs. Furthermore, for aesthetic reasons, multiple connected windows in a room and/or other location locations may sometimes need to have their optical states mapped and/or colored at the same rate. Treating groups of connected windows as partitions facilitates these goals.

In some embodiments, IGUs are grouped into partitions of tintable windows, each of the partitions including at least one window controller and its respective IGU. Each partition of the IGU may be controlled by one or more respective NCs and one or more respective WCs controlled by such NCs. For example, each partition can be controlled by a single NC and two or more WCs controlled by the single NC.

In some embodiments, at least one device operates in coordination with at least one other device coupled to a network. Control of at least one device can be via the Ethernet network. For example, the tint levels of tintable windows can be adjusted at the same time. The partitions of the device may have the same at least one characteristic when the device is in use. For example, when a shadeable window is in a partition, a partition of a shadeable window may have its shading level (automatically) changed (eg, darkened or lightened) to the same level. For example, when a sound sensor is in a partition, it may sample sound at the same frequency and/or in the same time window. A partition of devices may include multiple devices (eg, of the same type). A partition may include (i) a device (eg, a tintable window) facing a particular direction of the enclosure (eg, a facility), (ii) a plurality of devices disposed on a particular face (eg, a facade) of the enclosure, ( iii) installations on specific floors of the facility, (iv) installations in specific types of rooms and/or events (for example, open spaces, offices, meeting rooms, lecture halls, corridors, reception halls or cafeterias), ( v) devices placed on the same fixture (eg, inner or outer wall) and/or (vi) user-defined devices (eg, in a room or on stand as a subset of a larger group of tinted windows) group of shadeable windows on the surface). The (automatic) adjustment of the device can be done automatically and/or by the user. Automatic changes to device properties and/or states in partitions may be altered by the user (eg, by manually adjusting the tint level). Users can use mobile circuitry (eg, remote controllers, virtual reality controllers, cellular phones, electronic notepads, laptops, and/or by similar mobile devices) to change the automatic adjustment of devices in the partition .

In some embodiments, when a command related to the control of a device (eg, a command for a window controller or IGU) traverses a network system, it is accompanied by the unique network ID of the device to which it was sent. The network ID can help ensure that the command arrives and proceeds on the intended device. For example, a window controller that controls the rendering state of more than one IGU may determine which IGU to control based on a network ID, such as a controller area network (CAN) ID (in the form of a network ID), passed with the rendering command. . In a window network, such as the window network described herein, the term network ID includes, but is not limited to, CAN ID and BACnet ID. Such net IDs can be applied to window net nodes, such as window controllers, net controllers, and master controllers. The network ID for the device may include the network ID of each device that controls it in the hierarchy. For example, in addition to its own CAN ID, the network ID of the IGU may also include a window controller ID, a network controller ID, and a master controller ID.

FIG. 4 shows various IGUs 422 grouped into partitions 403 of shadeable windows, each of the partitions 403 including at least one window controller 424 and its respective IGU 422 . In some embodiments, each partition of the IGU 422 is controlled by one or more respective NCs and thus controlled by one or more respective WCs 424 . Each partition 403 can be controlled by a single NC and two or more WCs 424 controlled by the single NC. Thus, partitions 403 may represent logical groupings of IGUs 422 . For example, each partition 403 may correspond to a set of IGUs 422 in a particular location or area of a building that are driven together based on their location. As a more specific example, consider location 401 as a building with four faces or sides: north, south, east, and west. Consider the building has ten floors. In this example, each partition 403 may correspond to a set of tintable windows 422 on a particular floor and on a particular one of the four faces. Each partition 403 may correspond to a set of IGUs 422 that share one or more physical characteristics (eg, device parameters such as size or age). In some embodiments, the partitions 403 of the IGUs 422 are grouped based at least in part on one or more disembodied characteristics including a security designation or business class (eg, the IGUs 422 delimiting a manager's office may be grouped in one or more each partition, while the IGUs 422 delimiting non-managerial offices may be grouped in one or more different partitions).

In some such implementations, each NC may address all IGUs 422 in each of one or more respective partitions 403 . For example, the MC may issue a primary shading command to the NC that controls the target partition 403 . The primary shading command may include an abstract identification of the target partition (hereinafter "partition ID"). In some such implementations, the partition ID may be the first agreement ID such as that just described in the examples above. The NC can receive a primary shading command including a shading value and a partition ID, and can map the partition ID to a second agreement ID associated with the WC 424 within the partition. In some embodiments, the partition ID may be a higher level of abstraction than the first agreement ID. In such a case, the NC may first map the partition ID to one or more first agreement IDs, and then map the first agreement ID to the second agreement ID.

In order for the shading control to function (eg, to allow the window control system to change the shading state of a particular window or IGU or a collection of particular windows or IGUs), the main controller, the network controller, and/or another control responsible for shading decisions The server can utilize the network address of the window controller connected to that particular window or set of windows. To this end, the function of commissioning may be used to provide specific windows and window controllers with the correct assignment of the window controller address and/or another identifying information, as well as the physical location of the windows and/or window controllers in the building. In some embodiments, the goal of debugging is to correct errors and/or other problems made when installing windows in the wrong locations or connecting cables to the wrong window controllers. In some embodiments, the goal of commissioning is to provide semi-automatic or fully automatic setup. In other words, installation is permitted with little or no position guidance for the installer.

In some embodiments, the commissioning procedure for a particular window or IGU may involve associating an ID of a device (eg, window and/or other window-related components) with its corresponding home (eg, window) controller. The program may assign building location, relative location, and/or absolute location (eg, latitude, longitude, and altitude) to a device (eg, a window or another component). Examples related to commissioning and/or configuring a network of shadeable windows can be found in US Patent Application Serial No. 14/391,122, filed October 7, 2014, entitled "APPLICATIONS FOR CONTROLLING OPTICALLY SWITCHABLE DEVICES," U.S. Patent Application Serial No. 14/951,410, filed Nov. 24, 2015, entitled "SELF-CONTAINED EC IGU," U.S. Provisional U.S. Patent Application Serial No. 14/951,410, filed March 9, 2016, entitled "METHOD OF COMMISSIONING ELECTROCHROMIC WINDOWS" In Patent Application Serial No. 62/305,892 and U.S. Provisional Patent Application Serial No. 62/370,174 filed on August 2, 2016, entitled "METHOD OF COMMISSIONING ELECTROCHROMIC WINDOWS", each of these applications One is incorporated herein by reference in its entirety.

After the network of devices (eg, optically switchable windows) is physically installed, the network can be tested to correct any incorrect assignment of the wrong window (usually an IGU) or building location by the window controller. In some embodiments, the commissioning map pairs or links individual devices (eg, windows) and their locations with associated location (eg, windows) controllers.

In some embodiments, commissioning is intended to resolve mispairing of the local (eg, window) controller and associated device (eg, window), eg, during installation. For example, prior to installation, a local (eg, window) controller may be assigned to a specific device (eg, a window), which may be assigned to a specific location in a building. During installation, however, local (eg, window) controls and/or devices (eg, windows) may be installed in incorrect locations. For example, a local (eg, window) controller may be paired with the wrong device (eg, window), or a device (eg, window) may be installed in the wrong location. Such mismatches may be difficult to resolve and/or require significant (eg, manual) labor, time, and/or cost to resolve and/or correct. Additionally, physical device (eg, window) installation and wiring installation in the building may be performed by different teams at different times during the construction process. Recognizing this challenge, in some implementations, devices (eg, windows) and/or local controllers are not pre-assigned to each other, but are instead paired during the commissioning procedure. Even if mispairing is not a problem because, for example, the local (eg, window) controller is physically attached to its counterpart device (eg, window), the installer may not know or pay attention to which device (eg, window) ( and therefore where the local controller is installed. For example, the size, shape, and/or optical properties of the devices (eg, windows) can be the same, and thus interchangeable. An installer may install such devices (eg, windows) at any convenient location regardless of the unique local controller associated with each such device (eg, windows). The various commissioning embodiments described herein allow for such flexible installations.

Some examples of problems that may arise during installation are as follows: (I) Errors in placing the window in the correct position: Electrically controllable windows may be prone to mis-installation, eg by technicians not adapted to work with electrically controllable windows. Such technicians may include tradespeople such as glaziers and/or low voltage electrical technicians (LVE); (II) misconnecting cables to window controls: this may occur, for example, when multiple windows are placed in close proximity; (III) Faulty (eg, broken) tintable windows and/or window controls: An installer may install available windows and/or controls to replace failed (eg, broken) windows and/or controls. New windows and/or controllers may not be in the installation and/or building (eg, BIM) plan and therefore may not be considered and/or identified during commissioning; and (IV) many windows are installed in the correct locations The procedure can be complex. A paradigm that makes the installer responsible for installing many unique windows in unique locations, which can be prone to human error, will need to be replaced. Thus, it may be useful to eliminate (eg, many or all) window and/or controller location considerations that can complicate the setup process. Similar discussion applies to any device (instead of a window), and any local controller (instead of a window controller) that controls the device. The device can be, for example, any device as disclosed herein.

In one example, the installation and attendant problems of the debug method requiring improvement may arise from the following operations: a. When making window controllers, assign a unique network address (eg, CANID) to each window controller. b. The window manufacturer (i.e., not necessarily the window controller manufacturer), building designer, or other entity specifies information about the window controller (with a designated network address) and the window (IGU). This is done by assigning a window controller ID (WCID) that is not (eg, is different from) the window controller's network address. The window manufacturer and/or other entity specifies which IGU(s) are associated with the window controller (WCID). For this purpose, the entity specifies the Window ID (WID) used for the window. In some cases, the manufacturer and/or other entity does not specify the correlation between the IGU and the controller, such as which specific IGU or IGUs the controller needs to connect to. For example, a window manufacture need not specify that a WC (with a CANID (eg, 19196997)) needs to be connected to any specific WID (eg, 04349`0524`0071`0017`00). In fact, the manufacturer or other entity specifies that the WC (with a CANID (eg, 19196997)) has a window controller ID such as WC10. The window controller ID can be reflected (eg, presented) as a location label (eg, an arbitrary number assigned to a window in installation) on an interconnection diagram, architectural diagram, or other representation of a building, which can specify the window control The device is connected to a specific IGU identified by window IDs (eg, W31 and W32 (location tags for IG)). c. As indicated, the manufacturer or other entity applies a window controller ID (WCxx tag) on each window controller. The entity enters the WCxx/CAN ID pair information in the configuration file used by the host controller/network controller or other device that contains the logic responsible for issuing individual shading decisions. d. This procedure entails the LVE or other technician responsible for installing and/or connecting electrically controllable windows to select a specific window controller from a box of window controllers and install it in a specific location in the building. e. Any error made in operation (c) or (d) results in difficult troubleshooting in the field to find the erroneous map and correct the erroneous map. f. Even if operations (c) and (d) are performed correctly, the window controller and/or window may be damaged, in which case the window controller and/or window must be replaced during installation. This can again cause problems unless the changes are tracked manually and reflected in the configuration file. Similar discussion applies to any device (instead of a window), and any local controller (instead of a window controller) that controls the device. The device can be, for example, any device as disclosed herein.

As indicated, in various embodiments, a debugger associates an individual device (eg, a tintable window, a group of devices, or any other other device) with the various properties responsible for controlling the device (eg, the optics used to control the tintable window) state) of the individual local (eg, window) controller pairing. In some embodiments, the commissioning procedure compares the device and/or local controller location with the controller used to directly control the device (eg, a hands-free controller) and/or for placement on or near the device The local controller ID and/or controller network identifier (eg CANID) of the controller is paired. For example, the commissioning procedure associates the window and/or window controller location with the window controller ID and/or window controller network identifier (eg, CANID for the controller positioned on or near the window) )pair. Such controllers can be configured to control one or more properties of the device (eg, the optical state of the window). The local controller may directly control the device, may be positioned on or near the device (eg, may be positioned on or near the window or device collective housing). In some embodiments, the commissioning procedure specifies the type of controller in a hierarchical network and/or the logical location of the controller in the topology of that network. Each individual device (eg, sensor, device collective, and/or optically switchable window) can have a physical ID (eg, the window or window ID (WID) mentioned herein) and a unique network ID ( For example, the associated controller of the above CANID). In some embodiments, the home controller includes an entity ID (eg, WCID). In general, the commissioning procedure can be used to connect or pair any two related network components, including (but not limited to) IGU (or windows in an IGU), window controller, network controller, main controller, sensor detectors, transmitters, antennas, receivers, transceivers, processors and/or device collectives. In some embodiments, the commissioning process involves pairing network identifiers associated with devices (eg, IGUs) and/or controllers to fixtures, surfaces, and/or three-dimensional building models (eg, BIM files) any other characteristics. A collective of devices may be referred to herein as a "digital architectural element."

In some embodiments, debugging the connection is performed by comparing the architecturally determined location of the first component with the wirelessly measured location of the second component, which is associated with the first component. For example, the first component can be an optically switchable window and the second component can be a window controller configured to control the optical state of the optically switchable component. In another example, the first component can be a sensor that provides measured radiation data to a local (eg, window or sensor) controller, which is the second component. Sometimes, the position of the first component may be known with greater accuracy than the position of the second component. The location can be determined by wireless measurements (eg, by a traveler such as a field service engineer or a robot such as a drone). While the exact location of the first component can be determined from architectural drawings or similar sources (eg, BIM files), the commissioning process may employ alternative sources, such as post-installation manual measurements of devices (eg, windows or other components) Location. Geo-automatic location technologies (eg, global positioning system (GPS), ultra-wideband radio waves (UWB), infrared radiation, Bluetooth technology, and the like) may be used. In various embodiments, the component whose location is determined by wireless measurements (eg, the local controller) has a network ID. The network ID may be made available during the commissioning procedure, eg, via a configuration (eg, BIM) profile. In such cases, the debugger can pair the exact physical location of the first component with the network ID of the second component. In some embodiments, the first and second components are a single component. For example, a window controller can be such a component; for example, its orientation can be determined from architectural drawings and from wireless measurements. The commissioning process can associate physical locations from architectural drawings (eg, BIM files) with network IDs from configuration files. BIM files can constitute a digital avatar of a facility (eg, a building).

In some embodiments, the links determined during commissioning are stored in files, data structures, databases, or the like (eg, BIM files), which can be accessed by various window nets Access to road components and/or associated systems such as mobile applications, window control smart algorithms, building management systems (BMS), security systems, lighting systems, and the like. In some embodiments, the commissioning link is stored in a network configuration file that may be included in a digital clone of the facility. In some embodiments, the network configuration file is used by the network to send appropriate commands between components on the network; for example, the host controller sends local commands to the local end based on the location of the specified device (eg, a shadeable window) in the structure The (eg, window) controller sends shading commands for the specified device for (eg, configuration and/or shading) changes.

5 depicts an example of an embodiment in which a network configuration file 503 may be used by control logic 504 to facilitate various functions on the network. Although the following description uses the term "network configuration file," it should be understood that any suitable file, data structure, database, etc. can be used for the same purpose. Such files (or other features) may provide physical components of the network (eg, window orientations identified by window IDs) associated with such physical components (eg, window controllers that directly control the state of the window) The link between the network IDs of the associated controllers (which can be or include a network address). Control logic refers to any logic that can be used to make decisions or other purposes in the linkage between entity components and associated controllers. Such logic may include, for example, logic with device network masters, network controllers, and local controllers, as well as associated or interfacing systems, such as for controlling device type and/or configuration (eg, , status) mobile applications, device control smart algorithms, building management systems, security systems, lighting systems and the like. Such logic may include, for example, logic with a window network host controller, network controller, and window controller, as well as associated or interfacing systems, such as mobile applications for controlling window states, window control intelligence Algorithms, building management systems, security systems, lighting systems and the like. In some embodiments, network configuration file 503 is used by control logic 504 to provide network information to a graphical user interface (GUI) 508 for controlling the network, such as an application on a remote wireless device, or Provided to Smart System 509 or Building Management System (BMS). In some embodiments, the user interface 508 of the mobile application is configured to use the information provided by the network configuration file to control the target device, such as a host controller, network controller, local controller or other network road components.

In some embodiments, the digital avatar includes a network configuration file that is created and updated based on the building layout, equipment installation, and unique identifiers of installed devices. In some embodiments, the first operation is to determine the physical layout of the site from a building plan, such as an architectural drawing, so that the layout of the window network can be determined. Architectural drawings (eg, included in the digital clone) may provide building dimensions, location of fixtures, wiring, openings (eg, piers), plumbing, stairs, electrical cabinets, and various other structural and architectural features. In some embodiments, the architectural schema is created by first surveying the site (eg, using a walker such as a human or a robot walker), such as when the architectural schema is unavailable. Using architectural drawings, an individual or group can design the wiring infrastructure and/or power delivery system for a network of devices (eg, including tinted windows). This infrastructure, including power distribution components, can be visually depicted in a modified building diagram, sometimes referred to as an interconnection diagram. Interconnection diagrams may depict wire routing (eg, trunks) at a site, the positioning of various devices on a network (eg, controllers, power supplies, control panels, windows, transmitters, and/or sensors), and Identification information of the network component (eg, network ID). In some embodiments, the interconnect pattern is not completed until the ID (WID or other ID) of the installed device (eg, optically switchable window) matches the location of the installed device. Inherently or explicitly, an interconnection schema may depict a hierarchical communication network including devices and their controllers (eg, windows, window controllers, network controllers, and master controllers) at a particular location. The initially rendered interconnection schema may not include network IDs for devices on the network (eg, windows or other components).

In some embodiments, after the interconnection schema is created, it is used to create a network configuration file that can be a textual representation of the interconnection schema. The network configuration file can then be provided in a medium that can be read by a logic control and/or other interfacing system, which allows the window network to be controlled in its intended manner. As long as the interconnection schema and network configuration file accurately reflect the installed network, the process of creating the preliminary network configuration file is complete. However, commissioning can add other information to the file to link the installed optically switchable window that matches the corresponding window controller network ID. If at any point it is determined that the interconnection diagram and network configuration file do not match the installed network, manual user intervention may be required to update the interconnection diagram with accurate window ID (or other ID) information Mode. The network configuration file is then updated according to the updated interconnection schema to reflect the changes that have been made.

6 shows an example method of creating a network configuration file. The physical layout of the location is determined in operation 601 . In operation 602, an interconnection schema is added that defines the type and location of the various devices to be included in the network. Device (eg, window) IDs 611 (which may be pre-assigned, determined at installation, or collected after installation) may be entered into interconnection schema 602 . A network configuration file is generated in operation 603 . In operation 604, it is checked whether the interconnection schema portion of the network configuration file matches what is installed. If there are any inaccuracies, operation 611 is repeated to update the interconnection schema 602 .

Figure 7 provides one example of an interconnection schema created from an architectural schema (eg, floor plan) of a building. The interconnection schema includes placement of IGU and window controllers 701, control panels 702, trunks 703, wall interface 705, and various other network components such as main controllers, network controllers, sensors. Although not shown, the interconnection diagram may include additional information such as structural information, structural dimensions, and information such as the net IDs of the various net components depicted.

In some embodiments, the interconnection diagram is a set of diagrams depicting many views of the structure. In some embodiments, the interconnect schema set includes similar schemas that provide different information. For example, two drawings can depict the same floor plan, and one drawing can provide dimensional information, while the other drawing provides network IDs for components on the network. 8 provides an example of an interconnection diagram depicting an elevation view of a structure from which the coordinates of the IGU 801 and other network components can be determined. In some embodiments, the interconnection schema provides information related to a power distribution network of electrochromic devices, such as described in US Patent No. 10,253,558, issued April 9, 2019, which is incorporated by reference in its entirety manner is incorporated herein.

Modifications to the interconnection schema may be required in some cases. For example, the installer may determine that the window opening is too small for the window specified by the instructions in the digital avatar (eg, interconnection schema and/or BIM), and decide to install a smaller window. To correct for changes, the digital clone may need to be updated. Other structures of the mapping between network configuration files or storage devices (eg, optically switchable windows) and associated controllers can be created or modified to reflect real-world setups. With the correct mapping in place, the network will function properly. In some cases, if the network configuration file does not represent a physical network, device configuration commands (eg, window shading commands) may be sent to the wrong component, or communications may not be received at all.

When the digital avatar (eg, interconnection schema) of the facility is modified, the corresponding (eg, linked) network configuration file will also be modified. Such corrections may be manual and/or automatic. Such corrections can be made in real-time (eg, during an update of the avatar file, at a predetermined time, or at a whim). In some embodiments, the network configuration file is not created until the physical installation has been completed, eg, to ensure that any changes to the avatar are reflected in the network configuration file. In cases where the interconnection file is modified after the network file is created, care should be taken to ensure that the network configuration file is updated to reflect the change. Failure to update the interconnection schema or to update the network configuration file to reflect changes made to the digital avatar (eg, the interconnection schema) can result in a network that does not respond to commands as expected. In addition, when commissioning occurs (eg, on-the-fly), the digital avatar (eg, the interconnection schema) can be updated. To correct for changes made during installation that deviate from the interconnection pattern, device (eg, optically switchable windows) information may be obtained from a file containing a device ID (eg, window pane ID).

A network configuration file may be created or updated when a digital avatar (eg, an interconnection schema) has been created, or when the digital avatar has been updated to account for changes in installation. The configuration file may be further updated when commissioning occurs (eg, immediately) or at a later (eg, specified) time. Like digital avatars (eg, interconnect schemas), network configuration files when initially rendered do not include controls for coupling to or operatively (eg, communicatively) coupled to a network The network ID of the server or other component (eg, device).

In some embodiments, a network configuration file is a transcript in a computer-readable format of a digital avatar (eg, an interconnection schema) that can be read, interpreted, and in some cases updated by logic control software. At least some (eg, all) of network components (eg, windows, window controllers, network controllers, sensors, transmitters, and sensor groups) may be represented in a network configuration file. A network configuration file may contain information about how various devices on the network relate to each other in a hierarchical structure.

In some embodiments, the network configuration file is a textual description of a digital avatar (eg, an interconnection diagram). A network configuration file may have a flat file format with no structure for indexing and/or no structural relationship between records. Examples of flat file types include plain text files, comma-separated value files, and delimiter-separated value files. JavaScript Object Notation (JSON) or another object notation format that uses human-readable text to transmit data objects consisting of property-value pairs can be used in network configuration files. Information in network configuration files may be stored in other formats and/or locations.

In some embodiments, the network configuration file is in JSON format. Various devices and device groupings can be defined as JSON objects. For example, when defining a partition of a window as an object, comma-separated text can be used to encode which partition group the partition is part of, which network controller or network controllers the partition group is reported to, and is responsible for The main controller of the network. The object may provide which window controllers, windows, and/or any additional network components (eg, light sensors or window antennas) are included in the partition. A net component can be referenced in an object by at least a net ID. When originally generated from a digital avatar (eg, an interconnection schema), the network configuration file may be incomplete in the sense that it does not yet include a network ID for at least one of the controllers.

Network configuration files can be stored at various locations in the window network. For example, network configuration files can be stored on memory attached to the host controller, network controller, remote wireless device, or in the cloud. In some embodiments, the network configuration file is stored in a location from which all other devices on the network can access the network configuration file. In another embodiment, the network configuration file is stored locally on multiple devices on the window controller network; when the network configuration file is updated at one location, as new devices are added to the network The updated network configuration file is used to replace the outdated network file in other locations.

Using information from the network configuration file, the control logic can send commands to windows and/or other components (eg, devices) on the network. The control logic may transmit the instructions to the main controller 405, which in turn may transmit the instructions to the appropriate network controller 406. In some embodiments, the network controller transmits the instructions to the appropriate local controller (eg, window controller 407 ) via, for example, the BACnet communication protocol (Building Automation and Control Network Protocol, ISO 16484-5). The local controller may then apply electrical signals to control the configuration of the device based at least in part on the local controller's CAN ID. For example, the window controller may then apply an electrical signal to control the tint state of the optical switching window based at least in part on the CAN ID of the window controller.

Control logic may be stored and/or used in various locations on the network. For example, the control logic can be stored and used on the main controller. In some embodiments, the software containing the control logic runs locally, on the cloud, or on a remote device that, for example, sends commands to a higher-level (eg, host) controller. In some embodiments, the control logic is implemented at least in part via a facility management application operated from the electronic device.

One purpose of the control logic is to present controllable options to the user in the form of a graphical user interface that enables the user to select and/or control one or more electrochromic windows and/or any other over the network device. For example, a list of window IDs may be presented to the user over the network, from which the user may select and/or modify properties and/or configurations of the device, eg, the tint state of a particular window. The user may send commands to control the grouping of devices (eg, windows) based at least in part on the partition of the device that has been predetermined or selected by the user, for example.

In some embodiments, the control logic communicates with the window control intelligence, the BMS, and/or the security system. For example, the BMS can configure all windows to their shaded state to save cooling costs in the event of a power outage.

One aspect of the present invention allows for automated window position determination after installation. Various devices (eg, sensor collectives, window controllers, windows configured with antennas and/or onboard controllers) can be configured with transmitters to communicate via various forms of wireless electromagnetic transmission; field, magnetic field or electromagnetic field. Various wireless protocols for electromagnetic communication include, but are not limited to, Bluetooth, BLE, Wi-Fi, RF, and/or Ultra Wide Band (UWB). The relative position between two or more devices can be derived from information related to transmissions received at one or more antennas (such as received strength or power, time of arrival or phase of arrival of wireless transmission signals, frequency, and / or angle) judgment. When determining the location of the device from these measurements, a triangulation algorithm may be implemented, which in some cases takes into account the physical layout of the building, eg, fixtures such as walls and non-fixtures such as mobile furniture. Finally, the exact location of individual network components (eg, devices) can be obtained using such techniques. For example, the position of a window controller with a UWB microposition chip can be determined to an accuracy of at least about 2.5 cm, 5 cm, 10 cm, 15 cm, 20 (cm) centimeters or more of its actual position. In some cases, a geolocation method such as the geolocation method described in International Patent Application Serial No. PCT/US17/31106, filed on May 4, 2017, entitled "WINDOW ANTENNAS," can be used to determine a The location of the device or devices (eg, windows), this application is incorporated herein by reference in its entirety. As used herein, geolocation and geographic location may refer to any method of determining the orientation or relative orientation of a window or device, in part by analyzing electromagnetic signals.

Pulse-based ultra-wideband (UWB) technology (ECMA-368 and ECMA-369) is used for low power (eg, up to approx. Wireless technology that transmits large amounts of data at 0.3, 0.5, or 0.8 milliwatts (mW). A UWB signal is characterized by occupying at least about 500 MHz of bandwidth spectrum or at least about 20% of its center frequency. Component UWB broadcast digital signal pulses can be precisely timed across several frequency channels simultaneously on a carrier signal. Information may be transmitted by modulating the timing and/or positioning of the pulses. Information can be transmitted by encoding the polarity of the pulses, their amplitudes, and/or by using quadrature pulses. In addition to being a low power information transfer protocol, UWB technology can offer several advantages over other wireless protocols for indoor location applications. In some embodiments, the broad range of the UWB spectrum includes low frequencies with long wavelengths, which allow UWB signals to penetrate various materials, including fixtures such as walls. A wide range of frequencies including these low penetration frequencies reduces the chance of multipath propagation errors since some wavelengths will have line-of-sight trajectories. Another advantage of pulse-based UWB communications may be that the pulses are shorter (eg, up to about 50 cm, 60 cm, or 70 cm for a 500 MHz wide pulse, and up to about 20 cm, 23 cm, or 25 cm), thereby reducing the chance that the reflected pulse will overlap the original pulse.

The relative position of a window controller with geolocation technology (eg, with a microposition wafer) can be determined using the UWB protocol. For example, using a microposition chip, the relative orientation of each device can be determined with an accuracy of at least about 2.5 cm, 5 cm, 10 cm, 15 cm, 20 cm, or more. In some embodiments, devices (eg, device collectives, window controllers, and, in some cases, antennas disposed on or near the window or window controller) are configured to communicate via the microlocation chip . In some embodiments, the controller is equipped with a tag with a micro-position wafer configured to broadcast (eg, UWB) signals. The signal may be an omnidirectional signal. The receiving stationary micro-location wafers (called anchors) can be located at various locations such as wireless routers, network controllers, or window controllers. Anchors may have known (eg, absolute or relative) positions in the facility. Tags can be stationary or moving. For example, tags can be embedded in sensor clusters. For example, tags can be embedded in furniture or service machines (eg, assets). For example, the tag may be carried by the occupant. By analyzing the time it takes for the broadcast signal to reach the anchor within the transmittable distance of the tag, the position of the tag relative to the anchor, for example, can be determined. In some embodiments, the installer places temporary anchors within the building for commissioning purposes and then removes the temporary anchors after the commissioning procedure is complete. In some embodiments, the plurality of devices (eg, optically switchable windows, window controllers) are equipped with microposition chips configured to send and/or receive UWB signals. By analyzing the received UWB signals at each device (eg, window controller), the relative distance between devices (eg, window controllers) that are within transmission range constraints can be determined. By aggregating this information, the relative positions between (eg, all) devices (eg, window controllers) can be determined. When the position of at least one device (eg, a window controller) is known, or if anchors are used, the relative position of other devices with a microposition chip can be determined. Such techniques can be used in automated commissioning procedures as described herein. It should be understood that the present invention is not limited to UWB technology; any technology for automatically reporting (eg, high resolution) geographic location information may be used. Such techniques may employ one or more antennas associated with the component to be automatically positioned.

A digital avatar of a facility (eg, interconnection diagrams or other sources of building information) may include location information for various network components. For example, a device (eg, a window) may have its physical location coordinates listed in the x, y, and z dimensions to a technically specified accuracy (eg, within at least about 1 cm). A file or document (such as a network configuration file) derived from such a digital avatar (eg, containing a schema) may contain the exact physical location of network components. In some embodiments, the coordinates correspond to a corner of the facility structure (eg, the corner in which the window or IGU is mounted). The selection of particular corners or other features for designation in the coordinates of the digital avatar (eg, interconnect pattern) can be influenced by the placement of antennas or other position-aware components. For example, a window and/or mating window controller may have a micro-position chip placed near the first corner (eg, lower left corner) of the associated IGU; in this case, the interconnect pattern for the window Coordinates may be specified for the first corner. Where the IGU has a window antenna, the coordinates listed on the digital avatar (eg, interconnection diagram) may represent the location of the antenna on the surface of the IGU window or near the corners of the antenna. In some embodiments, the coordinates are obtained from architectural drawings and knowledge of antenna placement on larger window assemblies such as IGUs. In some embodiments, the orientation of the windows is included in the interconnection pattern.

Although this specification often refers to digital avatars (eg, interconnect schemas) as a source of accurate physical location information for windows, the present invention is not limited to digital avatars (eg, interconnect schemas). Any similarly accurate representation of the location of components in a building or other structure with optically switchable windows may be used. This includes files derived from interconnection schemas (eg, network configuration files) as well as files or maps generated independently of interconnection schemas (eg, via manual or automated measurements made during construction of a building) Mode. In some cases where the coordinates cannot be determined from the architectural drawings, such as the vertical orientation of the window control on the wall, unknown coordinates may be determined by the person responsible for installation and/or commissioning. As building and interconnection schemas are widely used in building design and construction, they are used here for convenience, but the invention is not limited to interconnection schemas as a source of physical location information.

In some embodiments, the location and geolocation of components as specified by an interconnection schema, a digital avatar (eg, an interconnection schema) or similar detailed representation of the location of the components by commissioning logic, and the components (eg, device) (or other information not available in the interconnect schema), such as a window controller for an optically switchable window. In some embodiments, this is done by comparing the measured relative distance between the device location and the listed coordinates provided by the geolocation and the interconnection diagram. Since the location of network components can be determined with a high degree of accuracy, such as better than about 10 cm as disclosed herein for UWB, automatic tuning can be done in a way that avoids concurrency that can be introduced by manual tuning windows.

The controller network ID or other information paired with the physical location of a device (eg, a window or other component) can come from a variety of sources. In some embodiments, the network ID of the controller is stored on a memory device. The memory device is operatively coupled to the network. The memory can be attached to the window (eg, a connector or pigtail for a window controller) or can be downloaded from the cloud based on the device serial number. An example of a controller's network ID is the CAN ID (identifier used for communication over the CAN bus). In addition to the controller's network ID, other stored device information may also include the controller's ID (not its network ID), device component ID (eg, window serial number), device type, device (eg, window) Dimensions, date of manufacture, bus bar length, partition membership, current firmware, and various other device details (eg, layer composition of electrochromic devices and their (eg, relative) dimensions). Regardless of which information is stored, at least some (eg, all) of this information can be accessed during device use and/or during a commissioning process. Permissions to access information can include layers of security. Once accessed, any or all portions of this information can be linked to physical location information obtained from digital avatars (eg, interconnect schemas), partially complete network configuration files, or other sources.

9 depicts an example of a process 900 involving commissioning logic 904 (part of a commissioning system) and a network configuration file 905. Process 900 begins by gathering building information from architectural schema 901 . Using the building information provided by the architectural schemas, the designer or design team creates interconnection schemas 902 that include plans for networks at specific locations. Once network components such as the IGU and controller are installed, the relative orientation between the devices can be measured by analyzing electromagnetic transmissions as described herein. Measured location and network ID information 903 is then passed to debug logic 904, which associates the device's network ID (or another unique information) with its hierarchical network as depicted in interconnection diagram 902 Matching places on the road. The location of the associated device, as obtained or derived from the interconnection schema, is paired with a network ID or another unique information. The pairing information is stored in the network configuration file 905 . No changes to the network configuration file are required as long as no changes are made to the network or device setup. However, if a change is made, eg, the IGU is replaced by an IGU with a different window controller, then the debug logic 904 is used to determine the change and update the network configuration file 905 accordingly.

As a teaching example, consider an interconnected schema with window controls located along the wall of a building in three orientations (each associated with the lower left corner of the associated window): the first orientation, which is given a location at (0 ft, The first window controller at 0 ft, 0 ft); the second position, which is intended to have the second window controller at (5 ft, 0 ft, 0 ft); and the third position, which is intended to have at ( 3rd window controller at 5 ft, 4 ft, 0 ft). When the coordinates of the three controllers are measured, one of the controllers can be set as the reference position (for example, the controller person in charge of commissioning sets the controller in the first orientation as the reference point). From this reference point, the coordinates of the other two windows are measured, resulting in window coordinates of (5.1 ft, .2 ft, .1 ft) and (5.0 ft, 3.9 ft, -.1 ft). The commissioning logic then readily senses that the window with coordinates (5.1 ft, .2 ft, .1 ft) is in the second position and the window with coordinates (5.0 ft, 3.9 ft, -.1 ft) is in the third position. Information describing the physical and hierarchical orientation of each component from the interconnection schema can then be paired with net ID information (or another unique piece of information), which can be used when determining the orientation of a net component via The network is passed to the commissioning logic.

The debug logic can be incorporated into the scope of statistical methods to match physical device coordinates with those listed on the interconnection diagram. In one embodiment, matching the various permutations by iteratively assigning devices to each of the possible interconnect locations and then observing the locations of other components (as determined using relative distance measurements) corresponds to as in the interconnect graph The tightness of the location of the location of another network component specified in the formula. In some embodiments, network components and those listed on the interconnect schema are made by selecting an arrangement that minimizes the mean squared error of the distance of each component to the location of the closest component specified by the interconnect schema. Coordinates match.

This method of auto-commissioning can be useful if, for example, new components (eg, devices) are added to the network, old components are removed from the network, or replaced on the network. In the case of a new component, the component can be identified by the network and its location can be determined by one of the methods previously described. The commissioning logic can then update the network configuration file to reflect the addition. Similarly, the commissioning logic can update the network configuration file when a component is removed and is no longer recognized by the network. Where a component is replaced, the debug logic may notice the absence of the component on the network and the presence of the new component reported from the same coordinates of the missing component. The debug logic can infer that the component has been replaced, and thus update the network configuration file with the network ID of the new component.

10 shows a process 1000 in which the debug logic generates the network topology portion of the network configuration file. A window device (or other network connection device) is installed at the site 1001, and the network components self-determine the network hierarchy 1002 by communicating with each other. When each component self-reports to the network component above it to report its network ID (or another ID) information and the network ID (or another ID) information of any device below it in the hierarchy, it can be Determine the hierarchical structure of the network. For example, a device (eg, a sensor or IGU) may report to a home controller (eg, WC), which may report to the NC, which may report to the MC. When this pattern is repeated for each component on the network, the system hierarchy can be self-determined. Thus, the network is free from network topology errors, which can easily be introduced by deviations from the interconnection schema that occurs during installation. This self-determining structure is then passed to commissioning logic 1004, which can use the measured orientation 1003 of the device when creating the network configuration file 1005.

The instructions and logic for carrying out the debug procedures described herein may be deployed on any suitable processing device, including any controller on a network with sufficient memory and processing power. Examples include master controllers, network controllers, and local controllers. In other embodiments, the commissioning system executes on a dedicated management processor that performs (eg, only) commissioning or related management functions, and can communicate with the associated network. In some embodiments, the commissioning system resides outside the building with the device to be commissioned. For example, the commissioning system may reside at a remote monitoring site, console or systems such as building lighting systems, BMS, building thermostat systems (eg, NEST (Nest Labs of Palo Alto, California)) or the like in the network of any auxiliary system. Examples of such systems, methods of their use and associated software are described in International Patent Application Serial Nos. PCT/US15/64555 and March 2015, filed on December 8, 2015, entitled "MULTIPLE INTERACTING SYSTEMS AT A SITE" In International Patent Application Serial No. PCT/US15/19031, filed on March 5, entitled "MONITORING SITES CONTAINING SWITCHABLE OPTICAL DEVICES AND CONTROLLERS," each of which is incorporated herein by reference in its entirety. In some embodiments, the commissioning system is performed in a shared computing resource, such as a leased server farm or cloud.

In some embodiments, the control system and/or control interface includes a "digital clone" of the facility. For example, a digital doppelganger may include structural elements (eg, walls and doors), building fixtures/furnitures, and one or more interactive target devices (eg, optically switchable windows, sensors, transmitters, and/or or media display) of a representative model (eg, a 2D or 3D virtual representation). The avatar can reside on a server that can be accessed via a graphical user interface, or can be accessed using a virtual reality (VR) user interface. The VR interface may include an augmented reality (AR) aspect. For example, a digital clone may be utilized in conjunction with monitoring and servicing of building infrastructure and/or in conjunction with controlling any interactive target device. A new device may be detected (eg, and included in a digital doppelganger) when it is installed in a facility (eg, in its room) and operatively coupled to a network. Detection of new devices and/or inclusion of new devices into the digital clone can be done automatically and/or manually. For example, detection of new devices and/or inclusion of new devices into a digital clone may not require (eg, any) manual intervention. Whether present in the initial design plan of the enclosure or added later, complete details about (eg, each) device (including any unique identifiers) can be stored in digital clones, network configuration files, interconnection diagrams schemas and/or architectural drawings (eg, BIM files such as Revit files) to facilitate monitoring, service and/or control functions.

In some embodiments, the digital avatar includes a digital model of the facility. The digital avatar may consist of a virtual three-dimensional (3D) model of the facility. Facilities may include static and/or dynamic elements. For example, static elements may include representations of structural features of a facility (eg, fixtures), and dynamic elements may include representations of interactive devices with controllable features. The 3D model may include visual elements. Visual elements may represent facility fixtures. Fixtures may include walls, floors, walls, doors, shelves, structural (eg, walk-in) closets, fixed lights, electrical panels, elevator lifts, or windows. Fixtures can be attached to the structure. Visual elements can represent non-fixed objects. Non-fixed objects may include people, chairs, movable lights, tables, sofas, movable closets, or media projections. The non-fixed object may contain mobile elements. Visual elements may represent facility features including floors, walls, doors, windows, furniture, appliances, people, and/or interactive devices. Digital avatars can resemble virtual worlds used in computer games and simulations to represent the environment of a real facility. Creation of the 3D model may include analyzing a Building Information Modeling (BIM) model (eg, Autodesk Revit file), eg, to derive representations of (eg, basic) fixed structures and movable items such as doors, windows, and elevators. In some embodiments, a digital doppelganger (eg, 3D of a facility) is defined at least in part by using one or more sensors (eg, optical, acoustic, pressure, gas velocity, and/or distance measurement sensors) model) to determine the layout of the real facility. The use of sensor data can be used (eg, exclusively) to model the environment of the enclosure. The use of sensor data can be used in conjunction with a 3D model of the facility (eg, a BIM model) to model and/or control the environment of the enclosure. A BIM model of a facility may be obtained before, during (eg, immediately), and/or after the facility has been constructed. The BIM model of the facility may be updated (eg, manually and/or using sensor data) during operation and/or commissioning of the facility (eg, on-the-fly).

In some embodiments, dynamic elements in the digital avatar include device settings. Device settings may include (eg, existing and/or predetermined): tint values, temperature settings, and/or light switching settings. Device settings may include actions available in the media display. Available actions can include menu items or hotspots in the displayed content. Digital avatars may include devices and/or movable objects (eg, chairs or doors) and/or virtual representations of occupants (either from cameras or from actual images of stored avatars). In some embodiments, dynamic elements may be devices that are newly added to and/or disappeared from the network (eg, due to failure or relocation). A digital avatar may reside in any circuitry (eg, a processor) operatively coupled to a network. The circuitry in which the digital circuitry resides may be in the facility, external to the facility, and/or in the cloud. In some embodiments, a two-way (eg, bidirectional) link is maintained between the digital clone and the real circuitry. The actual circuitry may be part of the control system. The actual circuitry may be included in the main controller, the network controller, the floor controller, the local controller, or any other node in the processing system (eg, in the facility or outside the facility). For example, bidirectional links can be used by real circuitry to inform digital avatars of changes to dynamic and/or static elements, so that the 3D representation of the enclosed volume can be updated, eg, immediately or at a later (eg, specified) time. The two-way link may be used by the avatar to inform the real circuitry of manipulation (eg, control) actions entered by the user on the mobile circuitry. The mobile circuitry can be a remote controller (eg, including a hand-held pointer, manual input buttons, or a touch screen).

FIG. 11 depicts a visual representation of a digital avatar 1100 that is based at least in part on a BIM (eg, Revit) file 1101 . In some embodiments, the avatar 1100 includes a 3D virtual construct that can be navigated virtually using an interface device to view and interact with a target device. The interface may be a mobile device such as a smartphone or tablet. In some embodiments, the virtual representation of the enclosure includes a virtual augmented reality representation of a digital avatar displayed on the mobile device, wherein the virtual augmented reality representation includes a virtual representation of at least some of the real target devices. Navigation within the avatar using the mobile device may be independent of the actual location of the mobile device, or may be consistent with the movement of the mobile device within the actual enclosure represented by the avatar. The mobile device may be operatively (eg, communicatively coupled to a network). The mobile device may log its current location in the real facility and its respective location in the digital clone, eg, using any geolocation technique. For example, geographic location anchors are coupled to the network.

In some embodiments, a mobile device (eg, a smartphone, tablet, or handheld controller) is used to detect the commissioning data of the respective target device and transmit the commissioning data to the digital avatar and/or the BIM system. The mobile device may include geo-tracking capabilities (eg, GPS, UWB, Bluetooth, and/or dead reckoning) so that the location of the mobile device can be co-ordinated using any suitable network connection established by the user between the mobile device and the digital doppelganger. transfer to the digital clone. For example, network connections may include, at least in part, transport links used by a hierarchical network of controllers within a facility. The network connection may be separate from the facility's controller network (eg, using a wireless network such as a cellular network). The target device may be equipped with an optically identifiable ID tag (eg, a sticker with a barcode or Quick Response (QR) code). The interaction of the mobile device with the target device may be used to populate a virtual representation of the target device in the digital avatar with a unique identifier associated with the target device and/or another information associated with an ID code (eg, contained in an ID tag) of the target device.

12 shows an example embodiment of a control system in which a real physical enclosure (eg, a room) 1200 includes controls for managing interactive network devices under the control of a controller 1201 (eg, a host controller including a processor) device network. The structure and contents of the building 1200 are represented in the 3-D model avatar 1202 as part of a modeling and/or simulation system implemented in a computing asset. Computing assets may be co-located with enclosure 1200 and/or host controller 1201 or remote therefrom. Network links 1203 in enclosure 1200 connect controller 1201 to a plurality of network nodes including interactive target device 1205 . Interactive target device 1205 is represented as virtual object 1206 within avatar 1202 . The network link 1204 connects the controller 1201 and the digital clone 1202 .

In the example of FIG. 12 , a traveler 1207 in enclosure 1200 carries a mobile device (eg, a handheld control unit) 1208 . The mobile device 1208 may include integrated scanning capabilities (eg, a camera for capturing images of barcodes or QR codes), or a separate identification capture device 1209 coupled to the mobile device 1208 (eg, via a Bluetooth link and mobile handheld barcode scanner connected to device 1208).

ID tags may be constructed of RFID, UWB, radiation-generating, reflective, or absorbing materials to enable the use of various scanning tools (eg, identification capture devices). The code or print on the ID tag may include device type, electronic and/or material properties of the target device, serial number, type, component part identifier, manufacturer, date of manufacture and/or any other relevant information.

13 depicts an ID tag 1300 of the kind to be attached to an accessible surface of a target device (eg, an IGU). The printed data on label 1300 may include window ID 1301. Some or all of the printed (eg, human-readable) data can be encoded into a QR code 1302 that can be scanned, transmitted, decoded, and/or stored in conjunction with the virtual representation of the enclosure and the virtual target device.

In some embodiments, target devices in the enclosure space and behind fixtures (eg, walls) of the enclosure can be identified and tuned. The mobile device (eg, possibly aided by remote computing resources on a cloud server and/or in the avatar) can use image recognition and/or location tracking (eg, geolocation techniques) to identify the real target device and associate it with the avatar The virtual representation within the model matches. A walker (eg, a human user with a mobile device and/or identification capture device carried, or a robot such as a drone with its corresponding mobile device and scanner) can use the fixtures and target devices in the delineation enclosure augmented reality (eg, a digital clone), for example, to isolate and select specific target devices to debug. Based at least in part on the details provided by the Building Information Model (BIM) and the corresponding avatar, the traveler may select a virtual representation of the target device, for example, to tell the avatar which one to scan for identification codes, location information, or other details target device. The target device may or may not be operatively cooled to the network. For example, the target device may be a non-stationary object such as a table.

In some embodiments, the mobile device includes circuitry (eg, a smartphone or tablet) coupled to (eg, having) a sensor (eg, a camera), a display screen, and a software application, which are configured To log one or more real target devices to a digital avatar and/or supporting files (eg, network configuration files, interconnect files, and/or BIM (Revit) files). The display screen may display images corresponding to views within the digital clone. The display screen can display at least a portion of the digital avatar that corresponds to (eg, and is centered in) the location of the mobile circuitry. For example, the display screen may show the orientation in the virtual avatar that corresponds to the real orientation of the mobile circuitry, as well as its immediate vicinity. In some embodiments, as the mobile circuitry travels in the enclosure (eg, when the mobile circuitry is carried by a traveler traveling in the enclosure), the virtual screen changes (eg, instantaneously) one of the digital avatars The corresponding virtual orientation of the circuitry (eg, by changing the center of the avatar image displayed on the display screen). As the mobile circuitry travels in the real enclosure, the display screen may depict at least an immediate area of the mobile circuitry in the altered (eg, in real-time) avatar that corresponds to the virtual immediate area relative to the real enclosure in the real enclosure. The positive change in the orientation of the mobile circuitry is in the real immediate vicinity. An image showing at least a portion of the virtual avatar depicted on the screen may be used for navigation and/or orientation purposes. For example, displaying an image of at least a portion of the virtual avatar depicted on the screen can aid in navigating to a previously placed representation of the target device, or to a location corresponding to a avatar (and/or any The virtual location of the real location of the real target device (support file). In some embodiments, the user may assign the center orientation of the depicted image of the virtual avatar to be different from the orientation of the real mobile device. For example, it may be a (eg, lateral) distance from the real mobile device. The user may be able to select the distance, eg, using a drop-down menu, using a cursor, and/or using the touch screen functionality of the mobile device. The camera (or other integrated sensor in or coupled to the mobile device) can capture (eg, scan) the identification code of the real target device. The retrieved (eg, scanned) code can be either (i) linked within the avatar to the selected target device (eg, linked to the selected target device by the avatar) or (ii) linked to a device associated with the target device. Inventory of codes and populates the digital avatar with target devices identified by its codes in the inventory (eg, file).

In some embodiments, a separate identification capture device, such as a handheld scanner, can be linked to the mobile device and operated by the traveler to capture the code. A sensor (eg, a camera) may include a charge coupled device (CCD) camera. The sensor may comprise an array of sensors. The system can be configured to perform (or direct to perform) image processing on the captured code (eg, an image of the code), eg, to identify and/or decrypt the code.

14 shows an example of a login and/or commissioning system in which a digital avatar 1400 is used to present a 2D or 3D virtual model of an enclosed volume to a user (eg, a traveler) based at least in part on building information from a BIM system 1401 . In some embodiments, the presented virtual model is created in server 1402 as a virtual reality (VR) model. The VR model can be augmented with additional virtual representations (eg, combined with sensor (eg, camera) views and/or graphical overlays) and then rendered by server 1402 as a VR-based perspective view. The model can be navigated interactively in conjunction with the display 1404 of the mobile device 1403 . The mobile device 1403 includes a sensor (eg, a camera) 1405 for capturing data (eg, an image) that can (i) be used as at least part of the basis for generating an augmented VR representation of the facility containing the target device, ( ii) as a locator for establishing the current location of a traveler within the facility and/or the location of a target device, and/or (iii) as a sensor for reading an ID tag or other indicia to establish an identification code. At least one application 1409 is configured to cooperate with the VR server 1402 and the avatar 1400 for rendering, navigation and recognition functions. The target device 1407 uses the identification code and optionally other information that can be read by the sensor 1405 and/or by using a peripheral device (such as another capture device (eg, a QR scanner) linked to the mobile device 1403 ) 1408) to mark. Another capture device may be operatively coupled to the mobile circuitry (eg, wired and/or wireless). Another capture device can be configured for handheld operation. Another capture device may be easier to maneuver and reach various locations. Another capture device may have a sensor dedicated to ID capture operations (eg, barcode scanning, QR code scanning, or RFID reader).

In some embodiments, using a mobile device, a virtual representation of the target device within the enclosure space can be identified, eg, even when the target device is behind a fixture (eg, a wall) of the enclosure. Pairing can be achieved using image recognition of the target device (eg, when the traveler is autonomous) or by manual instructions using the user interface (eg, tapping a touch screen (eg, when the traveler is a human)) A selection of devices included in the digital clone. In some embodiments, a traveler (eg, a person) initiates an augmented virtual reality (eg, a digital avatar) depicting a fixture of an enclosure on a mobile device (eg, a tablet). For ease of use, the traveler's movement can be tracked (eg, using relative and/or absolute position data sent to the VR server from the mobile device) so that the VR scene presented to the traveler on the mobile device follows the movement (eg, as disclosed herein). To initiate the tracked navigation, the mobile device may become anchored to the digital avatar at the origin. For example, by pairing with a network of enclosures having image sensors (eg, cameras) and/or geographic location sensors (eg, RF sensors such as UWB sensors). For example, by being paired with a fixed sensor (eg, of the device collective) that has a fixed (eg, and known) orientation relative to (eg, and within) the enclosure. For example, by manually identifying the location of the virtual representation of the real mobile circuitry in the enclosure of the digital clone. Based at least in part on changes in the orientation and/or spatial orientation of the mobile device, the displayed augmented reality may be updated to track the movement of the mobile device, eg, thereby allowing a traveler to manipulate the mobile device until the display shows the requested target device and/or Or a virtual representation of the location of the target device being added. The user may select the virtual representation of the target device on the mobile device to proceed to capture (eg, scan) the identifier of the real target device corresponding to the selected virtual device. The user can retrieve the identification code of the real target device which can be identified and then populated as a virtual representation in the digital avatar. The identification of the scanned device can be accomplished using at least one database in which the ID code and the device (eg, and optionally its related information) can reside (eg, in memory). The repository can be in the enclosure or outside the enclosure (eg, in another facility or in the cloud). The one or more databases may include the Internet. At least one database may include virtual representations of devices configured to populate the virtual avatar.

In some embodiments, an application in a mobile device may be configured to retrieve a generic code (eg, of the device), such as by connecting to the Internet. In some embodiments, the traveler uses the portable circuitry of the mobile device (eg, cellular phone or tablet) to retrieve information from the ID tag and associate the ID tag information (eg, ID code) with the selected target device and/or or their locations, and then communicate the associated information to the digital doppelganger (and/or centralized BIM). The traveler may capture (eg, scan and/or sense) the code by a separate capture device (eg, a Bluetooth scanner such as an electron gun scanner) coupled to the mobile device. The portable electron gun capture device allows capture of hard-to-reach and/or remote areas. In some embodiments, the identification capture device (eg, a scanner) includes a low-resolution sensor (eg, a camera). Low-resolution sensors may include single-pixel sensors, eg, single-pixel sensor arrays. At least two of the sensors in the array can be of the same type (eg, sensitive to the same wavelength of radiation). At least two of the sensors in the array can be of different types (eg, sensitive to different wavelengths of radiation). Identification capture devices may include IR, UV, or visible radiation sensors, RFID readers, and/or radio transceivers (eg, UWB transceivers). The captured ID (eg, scanned text or pattern) can be presented in an easily detectable format, eg, so that the capturing device (eg, scanner) and/or mobile device do not require complex image processing. For example, a barcode may be placed on the target device at least during the setup and/or commissioning phase. After determining that the identification and/or location information is associated with the target device, the ID tag (eg, including a barcode) can be (i) removed (eg, when the barcode marking is attached to a device surface, such as a glass surface or display construction surface) Or (ii) can remain on the object (eg, when attached to the controller unit, or when it is an RFID embedded in the target device).

15 depicts an example of a mobile device 1500 carried by a human walker 1501 while commissioning a target device in a real facility 1502. The mobile device 1500 may execute an application (abbreviated as "app") for performing functions including a display of a virtual augmented reality model that may be displayed, at least in part, including a virtual object A visual display portion 1503 of a virtual representation 1505 of a digital avatar of a device 1515 (eg, a sensor) constitutes. In some embodiments, the virtual representation is selected by interacting with the display 1503. Interactions may include application control icons, such as 1504 displayed on the display 1503 of the mobile device. The application can provide information about the displayed image. For example, enclosure properties (eg, facilities, buildings, floors, facility sections, and/or rooms). For example, display 1503 shows room #2 in digital clone display layer #1. The application may include a drop-down menu 1510 with various options from which the user can select, such as relative magnification of the virtual display displayed on the mobile device display, settings for the virtual avatar displayed (eg, color scheme and/or font), various options related to the target device (eg, device type), and security settings (eg, login settings). The application may allow the user to select different parts of the virtual avatar, such as different floors in the facility, different floors, different rooms or different buildings. Different parts may be further away from the mobile circuitry location. The application may allow the user to select a virtual image of the target device in the avatar, and retrieve information (eg, 1512) about its real counterpart. Information may include the ID number of the target device, its location, whether it is installed, whether it is coupled to a network, its status (functional/non-functional), any maintenance history, any scheduled maintenance, any last maintenance data ( in the details of maintenance), any risk of failure and/or any other characteristics of the target device (eg color, manufacturer, installation data, date of manufacture, associated controller and/or any other associated technical data).

16 shows an example of a mobile device 1600 that approximates real target devices 1601, 1602, 1603, and 1604. A traveler (eg, a human user or robot) can hold the mobile device 1600 so that its camera captures a view 1610 displayed towards the traveler. To detect the ID code (eg, QR code 1612 ) attached to the target device 1601 , the mobile device 1600 may be positioned to capture the ID code 1612 (eg, the image of) that matches the capture frame 1611 . The mobile device 1601 can use known methods to decode the textual information embedded in the ID code 1612 for populating the digital avatar and/or other BIM database with the identification code and/or another identification information corresponding to the target device 1601 and and/or models, and any associated controller-related files (eg, configuration files).

Figure 17 shows an example of a user interface screen 1700 in which a virtual augmented reality representation combines live video images from a mobile device with data stored in a digital avatar based on BIM information. The image on the interface screen 1700 may depict structures such as walls 1701 and target devices such as IGU 1702. The VR system that generates the image can recognize that the current view includes one or more target devices (eg, IGU 1702) and can provide corresponding prompts, drop-down menus, or selection buttons to assist the user in selecting the requested target device. For example, display identifier 1703 can be activated to provide the name of a potential target device based at least in part on generic data already available in the digital clone. By tapping on the identifier 1703, the user can proceed to scan the corresponding ID tag (eg, tag), which can then be automatically associated with a matching representation of the device in the digital avatar. Automated (or semi-automated) collection of the identification code can reduce the time/effort required to populate the ID code, associated device and any linked information (eg, as disclosed herein) into the digital avatar. The time required for such (eg, semi) automated procedures may range from an average of about 4 minutes per device (eg, IGU) to an average of about 15 seconds per device. In comparison, a fully manual procedure may require at least about 80%, 90%, 93%, 94%, or 95% more time to log the device into the digital avatar (eg, including associated information about the device, such as described herein revealed in). This (eg, semi-)automated process can reduce labor, cost, time, error, and/or difficulty in setting up, maintaining, and/or servicing teams. A reduction in manpower includes a reduction in the number of personnel required and/or a reduction in the qualification level of the personnel required to perform the task. The reduction in errors can improve device functionality and the accuracy of controls in the facility. For example, the current manual verification of window IDs and locations takes about an entire 8-hour working day for 100 IGUs.

In some embodiments, target devices present in the real facility may have corresponding virtual graphical representations in the digital avatar. A digital clone may include a corresponding data record for a target device with unique identifying information (eg, ID code or serial number, MAC address, and/or location), and general information (type of device, manufacturer, and any other device characteristics, features and/or attributes, eg, as disclosed herein). Functions such as building management, maintenance, service and/or repair can be greatly improved (eg, in terms of efficiency) by linking the identifier, the location of the target device, and the digital avatar. Over time, the data records may compile service history and/or (eg, current) device state, which may be updated into at least one database (eg, accessible via a digital avatar) that includes target devices. The service performed may be updated (eg, immediately or after the service) into a database (eg, containing status information related to the device (eg, status information accessible via a digital avatar)). The state of the device can be automatically coupled to the avatar and/or BIM file. At least one database can be automatically coupled to the digital avatar and/or the BIM file. At least one database can be configured to update the BIM file. In addition, BIM files can be automatically updated at specified times (eg, not in real time) and/or in real time. The designated time may be a time when activity in the facility is low (eg, at night, weekends, activity breaks, and/or holidays). In some embodiments, identifying data (eg, as commissioning the avatar) is compared to a previous version of the avatar (eg, prior to updating), eg, to look for any changes and/or discrepancies. The updated digital avatar can be used for analysis, maintenance, site management (eg, control), planning and/or revision of the base BIM (Revit file). Planning may include interior design and/or architectural planning.

18 shows an example of a virtual room 1800 containing or modified to contain a virtual control panel device 1801 (eg, presented to a user as part of a digital avatar). During commissioning, target device 1801 can be selected and its ID tag retrieved (eg, scanned or otherwise sensed) to obtain data about the real target device, which is linked to the ID code of target device 1801 . Data may be stored in data records 1802 linked to virtual target device 1801 . Data records 1802 may include a number of data fields applicable to device function, control, network coupling, management, maintenance, service, and/or repair. In the example shown in Figure 18, the data field includes an identification code 1803, which has been retrieved by an identification retrieval device operated by the traveler, as explained above. Data may include location information (eg, room CR121), timing of record generation and/or device setup (eg, stage acquisition), identification data (eg, including ID codes, part numbers, associated images, any special markings and including ability to comment). Data may include classifying equipment (eg, as fixed or non-fixed, eg, as furniture, glass, sensors, walls, or electrical equipment).

In some cases, the target device may be installed in the facility and not yet configured in the BIM data and/or digital avatar. Whenever a target device is not yet defined in the existing BIM and/or digital avatar, a user (eg, a traveler) can add the target device, eg, during commissioning of a new system or any time thereafter. The user can delete or modify the virtual target device that has been represented when needed (eg, when the device is removed or relocated). For the target device to be added, the mobile device can be used to navigate to a location (eg, the geographic location information where the target device resides) and select the location. The location can be derived from the ID tag (eg, if it includes geolocation technology, such as UWB technology). The location can be exported by the ID tag of the entrant. Locations can be derived from manually inserting location information (eg, by travelers). In some embodiments, the user adds an unrepresented target device by selecting a device type from an inventory available in the application. For example, the target device may belong to a 3rd party, and the code of the device may be a universal ID code. With the location information and device type determined, the user can use the identification capture device to capture (eg, scan) the identification code of the real target device into the database and/or the digital avatar. The digital avatar can then be updated with the target device information and a virtual representation of the target device can be created in the virtual model at the identified location. In some embodiments, at least some of the updated information in the digital avatar is fed back to the BIM file for similar updates. Digital avatars may be incorporated into or otherwise linked to BIM. A database containing ID codes and any associated device information is stored and can be linked to BIM.

The digital avatar may or may not be populated with a virtual representation and/or selection of the target device. The application may allow the user to select the target device from the select target device. The application may search for the target device based at least in part on the retrieved ID code. 19 shows a flowchart that provides (i) an example method for logging into one or more target devices. The program may begin at operation 1901 by providing a digital avatar of a facility with a real target device with an identification code (eg, on a tag or another ID tag affixed to the target device), and (ii) in 1902, Having an identification capture device (eg, a sensor integrated into a mobile device and/or a peripheral capture device) linked to the digital clone. In some embodiments, the avatar can be scaled and adjusted in real-time to simulate the traveler's position in the avatar, and the mobile device can (eg, instantaneously) project the surroundings of the traveler as simulated by the avatar. The location information of the mobile device and/or the target device may be tracked (eg, using geolocation techniques). For example, the location information can be provided using the traveler's UWB ID tag, or the location information can be driven by the mobile device via geographic location (eg, GPS). Using the location information, a virtual representation of the target device (and/or its location) is presented as part of the virtual augmented reality display of the digital avatar. In operation 1903, a determination is made whether the target device of interest exists in the digital avatar (eg, target device type and/or a specific target device with a manufacturer serial number). If not, in operation 1904, the identification retrieval device is used to capture (eg, scan) the identification code of the real target device of interest. In operation 1905, a list of virtual target device IDs and/or device types is searched (eg, the device ID may be entered into the virtual clone's data record before the individual installation location is known, or a known type may be accessed device general data as part of the target device's settings). In operation 1906, a virtual target device is associated with an identification code and with a virtual representation of a corresponding type of target device. In operation 1907, the location of the target device is selected in a digital avatar (eg, a virtual reality representation), eg, by a user or automatically via geolocation techniques. In operation 1908, the virtual target device representation is inserted into the digital avatar at the identified location. A digital avatar can be linked to a database with ID codes linked to various devices. An application on a mobile device may direct a search of a database (eg, the Internet) for associations between ID codes and information about the target device. Once the target device's ID code is identified as being linked to the target device (eg, target device type and/or a specific target device with a manufacturer serial number), the avatar and/or application selection options can be found in the avatar in the avatar The location corresponding to the real location of the target device in the real enclosure is populated with information related to the target device and/or the virtual representation of the target device.

When the virtual representation of the target device of interest at operation 1903 exists in the avatar, the user then selects the corresponding virtual representation and/or device ID depicted in the avatar on the user interface in operation 1910 to indicate that the For which real target device was retrieved (eg, scanned) for its ID. In operation 1911, the identification code on/in the real target device is captured using the identification capturing device. In operation 1912, the virtual representation of the target device is associated with an identification code (eg, the identification code is transmitted to a database containing the digital avatar, and the corresponding data record (eg, associated information such as its characteristics and/or status information) is populated There is an identification code, which links the two together).

The tag providing the identification code or another ID tag may contain additional data related to the target device (eg, device characteristics and/or status information). After linking the identifier and/or location to the virtual target device representation in operations 1908 and/or 1912, any additional data is accessed in operation 1913. When additional data is found, it is linked to the virtual target device in operation 1914. In operation 1915, the BIM may be updated with the identification code and any other data or link.

In some embodiments, a software tool (which may be referred to as a "facility management application") is provided for interfacing with features such as optically switchable (eg, shading) in a facility (eg, including a building or group of buildings) A two-dimensional and/or three-dimensional user-identifiable graphical user interface for device interaction of windows. In some implementations, tools include a user mode that allows a user to control or receive information about a device (eg, a window) and a configuration that allows the user to design, set up, and/or configure how software operates in the user mode of operation model. The facility management application is described using these two modes, however, it should be understood that features described as being in user mode may exist in configuration mode, and vice versa. Additionally, individual tools or modules rather than a single application can be used to implement both modes. The graphical user interface of the facility management application can be displayed on various electronic devices including circuitry (mobile or stationary), such as computers, phones or tablets. In some embodiments, the graphical user interface is displayed on an administrator console, and in some cases, the graphical user interface is displayed on a transparent display (eg, on a display structure) on the surface of the optically switchable window. Examples of transparent display technology (eg, which can incorporate optically switchable windows), its operation and its control can be found in International Patent Application Serial No. PCT, filed on April 25, 2018 and entitled "TINTABLE WINDOW SYSTEM COMPUTING PLATFORM" /US18/29406, International Patent Application Serial No. PCT/US18/29460 filed on April 25, 2018 and entitled "TINTABLE WINDOW SYSTEM FOR BUILDING SERVICES" and filed on September 30, 2020 with the title " TANDEM VISION WINDOW AND MEDIA DISPLAY" International Patent Application Serial No. PCT/US20/53641, each of which is incorporated herein by reference in its entirety.

The tool may have a graphical user interface that uses a 2D and/or 3D building model that may have been created for another purpose, thereby reducing (eg, eliminating) the cost of creating a building model solely for the purpose of a software tool. Accurate and detailed 3D building models already exist for many modern buildings on which window networks are installed. Such models are used by architects and engineers when designing new buildings and can be updated in detail as buildings are refurbished. By using this 2D and/or 3D building model, tools can generate powerful and intuitive graphical user interfaces that allow users to view details about devices operatively coupled to the network (eg, tintable windows) information, and may allow the user to control and/or select devices (eg, switching and/or coloring of such windows).

In some embodiments, the 2D and/or 3D building models use mathematical representations that reflect the geometry of the building. A model can be implemented as a file containing parameters that, when interpreted by appropriate software, can provide details about the features of the building and its geometric properties (eg, dimensions, surfaces, and volumes defined by one or more surfaces). A feature of a building (eg, any structural component or any component placed within the building, such as furniture) may be represented by one or more surfaces. For example, a window may be represented by a single surface representing one or more panes. In a more detailed or accurate model, a window may be represented as a plurality of surfaces defining all or most of the exterior surface of the window including the sash. In some embodiments, a feature is an accurate computer-aided design model of a portion or specific feature used in the design or manufacture of that feature. Details of a feature in a building model may include details such as the exact location of one or more of its defining surfaces, the dimensions of the defining surfaces, manufacturing information for the feature/component, historical information for the feature/component, etc., as explained below.

The viewer module can read building model files (eg, BIM such as Revit files) to generate 2D and/or 3D visualizations (digital clones) of the building, which can be drawn on the screen of an electronic device. Multidimensional visualizations can be rendered from multiple surfaces of various building features, each of the surfaces being defined by one or more polygonal shapes. Surfaces may correspond to features or solid aspects that make up a building. For example, beam or frame structures may each be represented by one or more surfaces within the building model. The resolution of the surface can be extremely high; sometimes the dimensions reflected in the model can be within a few centimeters of the actual building structure. In some embodiments, the surfaces are colored and/or textured when rendered to more accurately reflect the visual appearance of the building. Within the building model, surfaces can be identified by identifiers such as node IDs, but such IDs need not be displayed by the viewer. In some cases, wireframe or shell models described elsewhere herein may be compatible with software tools or applications. Rendering can be at least every about 5 minutes (min), 10 minutes, 20 minutes, 30 minutes, or 60 minutes. The rendering frequency of the digital avatars of the facility may be between any of the foregoing values (eg, 5 min to 60 min, 5 min to 20 min, or 20 min to 60 min).

Building models may be generated during the design phase of the building and may be provided by the building owner or the owner's supplier responsible for the design and construction of the building. 2D and/or 3D building models may be generated using computer-aided design (CAD) software, such as Autodesk Revit or another similar software design suite. In some cases, a building model is created (eg, only) after construction of the building, in which case it may utilize a positioning detection system such as light detection and ranging (LiDAR). For example, a lidar camera, such as a Matterport 3D camera, can be used to generate a building model. In some embodiments, a 3D model of the building space is generated using omnidirectional beacons that transmit, for example, RF waves, and then receive from RF waves that are received (reflected or directly) to one or more receivers The input of energy reflected or transmitted back by one or more devices. One such system with this capability is the Ossia ^™ wireless power system, as described in US patent application entitled "TECHNIQUES FOR IMAGING WIRELESS POWER DELIVERY ENVIRONMENTS AND TRACKING OBJECTS THEREIN" filed on November 19, 2015 and published as US20160299210A1 In Serial No. 14/945,741, this application is incorporated herein by reference in its entirety. In certain embodiments, a device (eg, an EC window) is configured to receive and/or transmit wireless power. When used in conjunction with such wireless power capabilities, an EC system can be automatically commissioned as described herein, where a building or spatial map is generated by the EC window system/window network using its wireless power transfer subsystem.

In some embodiments, the multi-dimensional model may contain various building information that may be relevant to engineers, architects, or facility managers. A building model file may contain metadata corresponding to building features and how those features interact with each other. As an illustrative example, consider a pipeline for conveying natural gas within a building. Subsequent data within the file may include information linked to the representation of the pipe (which may be displayed using one or more surfaces), including information such as model, manufacturer, date of installation, installation contractor, materials, dimensions, and information about the pipe. Match type information. As another example, all or a portion of an I-beam in a building may be represented as a surface, and this surface may contain information about the location of the I-beam, its materials of construction, its suppliers, and the like.

In yet another example, the surfaces or features of the building model may be indexed within the model file using data tags or keywords. These data tags may be included in the name associated with the surface/feature or in the corresponding meta data. Surfaces or features may have data tags linking the surface/feature to various properties and/or categories. Categories may be based on, for example, feature type, feature model, size, location, or any other relevant parameter. In some cases, the facility management application may then identify the characteristic corresponding to a data label. Features within the building model can be searched using a facility management application. For example, if the user types in the following search, the user can identify all overhanging features on the 3rd floor, west of the building: [feature type: window overhang], [floor: third], [direction: West]. In some embodiments, these data tags are automatically added to features/surfaces during building design by the software used to generate the building model. In some cases, such as when a feature is added to a building model from a feature library, the feature is imported into the building model that already has the appropriate data tags. As buildings are changed by additions, substitutions, etc., the building model can be updated to reflect the changes. For example, if the building is refurbished, features can be added or removed from the building model. In some embodiments, the representation of the surfaces in the building model remains unchanged, but the data information about the affected surfaces is updated. For example, the data can be set after updating the structural element to indicate the date when the safety of the element was last checked.

In some embodiments, a building model is generated targeting a network of devices. For example, components of a network (eg, devices (eg, IGUs), network controllers, and local controllers) can be created when the model is first created or at a later time (eg, during or during commissioning) later) to the building model. When such components are added to a model, each of them may be defined as one or more features and/or one or a surface. In some embodiments, components of a net are added from a library of net components, where the components are represented by their size, appearance, and the like. All components are in the form of corresponding meta data that can be included in the building model.

In some embodiments, the building model is provided in the form of a complex file that includes information that may or may not be necessary to generate a graphical user interface for devices such as optically switchable windows. For example, a building model may include information such as the editing history of the building model, and/or metadata information related to components that are not network-interfaced. At least one of the non-essential information may be removed before the model is used to generate or render features of the graphical user interface. In some cases, the file may be of the ".RVT" file type or another proprietary file type generated using a computer-aided design software package such as Autodesk Revit. In some embodiments, the building model undergoes a post-production process that adapts the model for use by a facility management application. In some embodiments, the building model is exported and saved in a simplified format with non-essential information removed from the file. In some embodiments, the building model is saved in an open source format that can be easily accessed via multiple electronic device types and/or across various operating systems. For example, in some cases, building models are saved in a format that can be accessed by a viewer module that is compatible with or integrated within a web browser.

20 provides an example of a block diagram showing the structure of a facility management application 2000, an example of the tools mentioned herein. The application is configured to receive the building model 2002, or at least information, from the model, and use the viewer module 2010 to interpret the building model. The application is configured to receive device (eg, window) information 2024 from an information source about the network (eg, host controller 2020 or another component on the window network). Such information may include network IDs (eg, CAN IDs) and/or other information that uniquely identifies individual devices on the network. The application is configured to receive a network configuration file 2030 containing information linking network entities (eg, devices such as transmitters and/or optically switchable windows) to node IDs on the building model. Applications can be configured to receive smart objects (or at least receive sufficient information to produce intelligence for such devices) for devices handled by the application (eg, sensors and/or optically switchable windows) type object). The application may be configured to receive these various pieces of information through one or more application programming interfaces or other suitable software interfaces.

In some embodiments, the viewer module interprets the building model (or information from the model) in a manner that allows the device to be displayed as intelligent objects (eg, virtual representations of the target device) that are related to the Device information received on a graphical user interface (eg, a computer, phone, tablet, a transparent display associated with an optically switchable window, or another electronic device that includes circuitry) is consistent.

The depicted facility management application is configured to receive user input 2004 that can be used to update a network configuration file 2030 and/or provide control commands 2022 for controlling optically switchable windows on a network of windows. In some embodiments, the application is configured to operate the application via a touch screen, a voice command interface, and/or the device that operates the application may have other features for receiving user commands for any of the purposes described herein Receive user input. An example of a voice command interface that can be used in conjunction with a network of optically switchable windows is described in International Patent Application Serial No. PCT/US17/29476, filed April 25, 2017, entitled "CONTROLLING OPTICALLY-SWITCHABLE DEVICES" , and in U.S. Provisional Patent Application Serial No. 63/080,899, filed September 21, 2020, entitled "INTERACTION BETWEEN AN ENCLOSURE AND ONE OR MORE OCCUPANTS," each of which is herein The full text of Chinese is incorporated. Various features of the software tool will now be described in more detail.

In addition to being accessed by one or more controllers on the network, the network configuration file 2030 may also be accessed by the digital clone and/or by the facility management application. The network configuration file may contain various network information used by the control logic to send information about the window network and/or to operate the device. When accessed by a facility management application, the network configuration file may link or map features and/or surfaces of the building model to the appearance of the network. For example, node IDs from building models can be linked to specific devices (eg, IGUs), partitions, partition groups, device coordinates, device IDs, and network IDs (eg, CAN IDs or BACnet IDs). In some cases, the network configuration file has a database structure that is updated during the commissioning process or when utilizing the application's mapping functions. In some cases, the network configuration file 2030 used by the facility management application is the same file accessed by the host controller, or a duplicate of the same file. In some cases, the network configuration file used by the facility management application may store different information than the network configuration file that provides the information to the host controller. For example, in some cases, the network configuration file used by the application (eg, only) pairs node IDs from building models with window IDs. In such cases, the network configuration file accessed by the host controller contains additional information, such as a mapping between device IDs and network IDs, such as CAN IDs or BACnet IDs, which are used to send communications to the network Controller and/or Local Controller.

In some embodiments, building models and/or network configuration files are stored on the device used to run the facility management application. In some embodiments, multiple instances of the building model and/or network configuration file exist on many devices, each of which is configured to run a facility management application. In some cases, building models and/or network configuration files are stored at a location external to the device running the facility management software; for example, at a controller in the cloud, on a remote server, or within a network.

The viewer module 2010 is included in or accessed by the facility management application. A viewer module is a software module that reads a 3D building model (or parts thereof) and provides visual rendering of the model on the device running or accessing the facility management application (eg, phone, tablet, or laptop). ). Rendering can be at least every about 5 minutes (min), 10 min, 20 min, 30 min, or 60 min. The rendering frequency of the 3D building model of the facility may be between any of the above values (eg, 5 min to 60 min, 5 min to 20 min, or 20 min to 60 min).

In some embodiments, the facility management application has a mapping function that allows users with rights to configure the graphical user interface. The mapping function associates the node IDs of surfaces and/or features in the building model to devices, partitions, partition groups, and other network components. In some cases, the mapping function can pair node IDs with corresponding smart objects. Mapping functions can access network-related information from network configuration files. The mapping function may save relationships made or identified through user input to a network configuration file.

In some embodiments, the viewer module and/or associated user interface (eg, of a digital clone of an application such as mentioned herein) are configured to display smart objects rather than within a graphical user interface surface and/or features. In some embodiments, features can be converted into smart objects by automatically or manually associating features with IDs, data, or scripting codes. The viewer module and/or user interface can be configured to overlay smart objects on top of corresponding surfaces or features displayed in the GUI, for example; smart objects can be provided around indicating surfaces corresponding to selectable smart objects The highlighted boundary of the object's surface. In some embodiments, the smart object modifies the appearance of the multi-dimensional model to indicate network-provided information (eg, device properties and/or status, such as the tint status of an IGU, or enclosure-related environmental properties, such as indoor/ Outdoor temperature).

The facility management application optionally includes control functions through which the user can control one or more devices (eg, optically switchable windows). For example, an application may send commands to the host controller (or other network entity with control functionality) to set the shading state of a particular IGU or IGU partition. In some embodiments, the control function acts as control logic (see eg, 504 in Figure 5). In some embodiments, the control function forwards control instructions to control logic located elsewhere on the network (eg, at the host controller). In some embodiments, the application is used to define or implement scheduling routines or rules based at least in part on user permissions. In some embodiments, the application is used to control other functions provided by the network. For example, if an IGU on a window network is configured with window antennas, a facility management application can be used to configure permissions for wireless networks implemented using window antennas.

The facility management application may receive user input 2004 from various electronic devices such as phones, tablets, and computers. In some cases, the graphical user interface is displayed on a transparent display on the surface of the optically switchable window, and user input is received through user interaction with the transparent display. For example, a transparent display may be located on S1-S4 of the IGU and may extend partially or fully across the available portion of the window. In some embodiments, the window includes a GUI that controls the display and/or a transparent-on-glass window controller that operates the electrochromic window. In some embodiments, the transparent display of the GUI interface is used for other functions, such as displaying date, time or weather. In some embodiments, the application is configured to receive audibly from a voice-controlled speaker device, such as a device using Apple's Siri platform, Amazon's Alexa platform, or Google Assistant platform User input. In some embodiments, the facility management application is a web-based application accessed via an electronic device with Internet connectivity, where the user has the appropriate permissions. For example, if the user has credentials to log into the web-based application and/or if the device is determined to be within close proximity of the network, the user may be granted access to the application. In some embodiments, the facility management application includes a copy of the building model file and/or the network configuration file. For example, building model files and network configuration files and facility management applications can be packaged into programs that can be saved or installed on electronic devices to improve the operating performance of the applications and, in some cases, allow the use of application, even if internet connectivity is lost. In some embodiments, when the executable application is saved on the device, the associated component or file is accessed from a remote location. For example, building models and/or network configuration files may be stored remotely and retrieved in whole or in part (eg, only) to perform the functions of the application when necessary. In some cases, such as where there are multiple instances of a program on various devices, program changes made by operating the application in configuration mode are pushed to programs running on other devices using, for example, the cloud copy.

When operating a facility management application in configuration mode, an authorized user (eg, a facility manager) can set and configure how the application is used for later use in user mode. 21 provides an illustrative example of a graphical user interface that may be displayed when a facility management application is operating in configuration mode. A user (eg, facility manager) may launch an (eg, facility management) application in window 2102, such as a web browser that displays a building model. A greeting with the user's name adjusted to date time is presented in 2103. Applications can also reside on mobile devices. A user (eg, an administrator) can locate features or surfaces of the building model that correspond to components on the network, such as surface 2106 corresponding to an electrochromic IGU. When selecting a surface or feature, the user (eg, an administrator) may then be presented with a pop-up window 2108 or another interface from which the user (eg, an administrator) can The selected surfaces and/or features are identified or mapped to components on the network. For example, in some cases, a user (eg, an administrator) may choose from a list of network components provided by the application (eg, the application may receive a list of network components from a network configuration file) What device does the surface and/or feature correspond to. In some cases, a user (eg, an administrator) can identify the surface and/or characteristics of a component that corresponds to a network, after which logic provided in the application can be used to automatically convert the network ID of the component on the network Link to the corresponding identified surface and/or feature. For example, using the methods previously discussed for automatic commissioning using geographic location, logic can be used to map a building by comparing the determined orientation of network components to the orientation of surfaces and/or features identified within the building model. The node IDs in the object model are mapped to the network IDs of the corresponding IGU or another component. In some cases, the program automatically identifies surfaces and/or features in the building model that correspond to windows or other components of the network. In some cases, the commissioning logic may operate from a facility management application, allowing the network to be commissioned using configuration mode. Although this embodiment provides an example of a device including a window, any other device (eg, as disclosed herein) may be substituted.

Smart objects can be selected or generated after surfaces and/or features in the building model have been manually or automatically paired by node IDs (eg, via network IDs) to components on the network. Finally, these can be made available for display and selection in the user mode of operation. Smart objects can be linked to node IDs of building models and can be displayed in various formats as described elsewhere herein. For example, smart objects can be displayed in place of surfaces in a building model, or smart objects can be configured to activate when one or more surfaces are selected in a building model (eg, to present a list of controllable features) ). In some embodiments, smart objects are generated by an application such that the size, dimensions, and placement of smart objects within the building model match the surfaces and/or features of the building model that have been paired with components of the network correspond. In some embodiments, the application receives information from retrospective data in a building model or a network configuration file used to create smart objects. The features available on the generated smart object may depend on the ID (eg, window ID or network ID) of the component associated with the smart object. For example, if the smart object is paired to a device such as an optically switchable window, the smart object may have features that display the current tint state and or allow the user to adjust the tint state. If the electrochromic window has an associated sensor (eg, internal light sensor, external light sensor, internal temperature sensor, external temperature or occupancy sensor), the smart object can be configured to Displaying the sensed information and/or options to control the tint state of the optically switchable window to help adjust the sensed information. In some embodiments, the smart object is selected from a library of smart objects (eg, stored in an application or downloaded from a remote server), where the library of smart objects includes various components that can be installed on a network . In some embodiments, the smart object is displayed on the building model in a configuration mode in which it can be selected for further editing. Smart objects can be associated with any of the devices disclosed herein. Smart objects can be linked to digital clones.

Referring again to Figure 21, a user (eg, a facility manager) can organize how the network is configured. For example, using a dialog box such as 2108, a user (eg, a facility manager) may configure a particular device, such as an IGU, to belong to a particular partition or group of partitions of the device (eg, IGU). As an example, after selecting surfaces and/or features in the building model, the application may display a list of zones to which the device can be added or present the user with the option to create a new zone. In some embodiments, the operating mode is configured to create custom views that can be displayed in the user mode. For example, using the navigation controls 2104 available in the configuration mode, the user can select the vantage point or viewing angle to be displayed in the user mode.

Using configuration mode, a user (eg, a building manager) can define scheduling for operation (eg, shading) of devices (eg, optically switchable windows) and/or for adjusting the environment within the building (eg, , lighting and/or temperature). A user (eg, an administrator) can set permissions for other users. For example, a tenant of a large building may be given (eg, only) control over devices (eg, optically switchable windows) in his or her leased space. In some embodiments, the first user grants other users and/or devices access to the configuration mode of the application so that they can establish their own rules and/or create their own custom views. In some cases, the rules or other changes that the user can make are restricted so that they do not violate the rules established by the user (eg, a facility manager or user of an administrative account). Users may be facility managers, maintenance personnel, customers, and/or members of the Customer Success Team.

In some cases, when used by a Field Service Engineer (FSE), the application may present a list of components in which failures have been detected and/or in which maintenance is required. In some cases, such features are highlighted and/or marked in some way within the displayed building model, eg, to make it easier for the FSE to know what needs attention. The FSE may have to ask the facility manager where the failing device is located or may look at the interconnection and building diagrams. This can be a cumbersome procedure in larger locations, such as multi-story buildings, airports, and hospitals, where the site personnel may not even notice the failed window, or in the case of self-detection of the malfunctioning device over the network. To assist with FSE, applications can provide directions to the specific components in question. For example, the application may display a route overlaid on a plan view of a building indicating the route the FSE should take. In some cases, such as when the application operates on a tablet or mobile device that is automatically located within a building, the application may provide turn-by-turn directions, similar to those used for (eg, GPS) navigation The progressive direction in the system. Although discussed in terms of directing the FSE to a device requiring service (eg, a failed device), the application may provide maps and/or routes that may be used by any user of the application. In some cases, an antenna (eg, with an antenna window) or any other network of geographic location sensors and receivers (eg, as disclosed herein) may be used to locate the device. Methods of using the Internet for location detection and user guidance are further described in International Patent Application Serial No. PCT/US17/31106, entitled "WINDOW ANTENNAS", filed on May 4, 2017, which application It is hereby incorporated by reference in its entirety.

In some embodiments, a plurality of devices may be operably (eg, communicatively) coupled to a control system. A plurality of devices may be placed in a facility (eg, including buildings and/or rooms). A control system may include a hierarchy of controllers. A device may include a transmitter, a sensor, or a window (eg, an IGU). The device can be any device as disclosed herein. At least two of the plurality of devices may be of the same type. For example, two or more IGUs may be coupled to the control system. At least two of the plurality of devices may be of different types. For example, sensors and transmitters can be coupled to a control system. Sometimes, the plurality of devices may include at least 20, 50, 100, 250, 500, 1000, 2500, 5000, 7500, 10000, 50000, 100000, or 500000 devices. The plurality of devices can be any number between the foregoing numbers (eg, 20 devices to 500,000 devices, 20 devices to 50 devices, 50 devices to 500 devices, 500 devices to 2500 devices, 1000 devices to 5,000 devices, 5,000 devices to 10,000 devices, 10,000 devices to 100,000 devices, or 100,000 devices to 500,000 devices). For example, the number of windows in a floor may be at least 5, 10, 15, 20, 25, 30, 40 or 50. The number of windows in a floor can be any number between the foregoing numbers (eg, 5 to 50, 5 to 25, or 25 to 50). In some cases, devices may be in multi-storey buildings. At least a portion of the floors of the multi-story building may have devices controlled by the control system (eg, at least a portion of the floors of the multi-story building may be controlled by the control system). For example, a multi-story building may have at least 2, 8, 10, 25, 50, 80, 100, 120, 140 or 160 floors controlled by the control system. The number of floors (eg, devices therein) controlled by the control system can be any number between the foregoing numbers (eg, 2 to 50, 25 to 100, or 80 to 160). A floor may have an area of at least about 150 m ² , 250 m ² , 500 m ² , 1000 m ² , 1500 m ² or 2000 square meters (m ² ). Floors can have an area between any of the foregoing floor area values (eg, about 150 m ² to about 2000 m ² , about 150 m ² to about 500 m ² , about 250 m ² to about 1000 m ² or about 1000 m ² to about 2000 m ² ). A building may comprise an area of at least approximately 1,000 square feet (sqft), 2,000 sqft, 5,000 sqft, 10,000 sqft, 100,000 sqft, 150,000 sqft, 200,000 sqft, or 500,000 sqft. A building may comprise an area between any of the foregoing areas (eg, about 1000 sqft to about 5000 sqft, about 5000 sqft to about 500000 sqft, or about 1000 sqft to about 500000 sqft). ^A building may comprise an area of at least about 100m2, ^200m2 , ^500m2 , ^1000m2 , ^5000m2 , ^10000m2 , ^25000m2 or ^50000m2 . A building may comprise an area between any of the foregoing areas (eg, about 100 m ² to about 1000 m ² , about 500 m ² to about 25,000 m ² , about 100 m ² to about 50,000 m ² ). Facilities may contain commercial or residential buildings. Commercial buildings may include tenants and/or owners. Residential facilities may consist of multi-family or single-family buildings. Residential facilities may include residential complexes. Residential facilities may contain single-family homes. A residential facility may contain multiple households (eg, apartments). Residential facilities may include townhouses. Facilities may contain both residential and commercial components. A facility can include at least about 1, 2, 5, 10, 50, 100, 150, 200, 250, 300, 350, 400, 420, 450, 500, or 550 windows (eg, tintable windows). The windows may be divided into zones (eg, based at least in part on the location, facade, floor, ownership, utilization, any other assignment metric, random assignment, or any of the enclosures (eg, rooms) in which the windows are placed) Combination. The assignment of windows to partitions may be static or dynamic (eg, based on heuristics). There may be at least about 2, 5, 10, 12, 15, 30, 40, or 46 windows per partition.

By being able to visualize components on the network, the FSE can be informed of information useful for detection and/or service. For example, after detecting components as shown in a building model (eg, by looking at zooming in on that part of the model), the FSE can be made aware of the need for a ladder to access devices located on the ceiling (eg, controllers ), or specific tools will be required to access devices hidden behind drywall. The application can display technical details of components that can help FSE diagnose problems, such as model number, date of installation, firmware installed, various connection devices and other technical details such as usage patterns, and/or historical data (e.g., specific information about the state of the IGU over time, such as leakage current). By being able to view the building model in detail, the FSE can get to the location ready for service, potentially eliminating additional trips that might otherwise be required to collect the required materials or tools.

In some embodiments, using a facility management application, the FSE may use various filters to sort installed components. For example, when a feature is added to a model, it can have a data tag and/or metadata that includes information such as: date installed, date of manufacture, part model number, IGU size, firmware on the controller body, other device characteristics and/or status information. This information can aid in preventive maintenance, for example, when the FSE is on-site to handle another service request. For example, if it is determined that some controllers manufactured during a certain time frame are prone to premature failure due to manufacturing defects, the FSE may be able to identify the controller in question using ranking criteria provided within the application. The FSE can then replace suspect components before they fail.

In some embodiments, the facility management application has a design module executable in configuration mode that allows the application to design the layout of the network in the building. Designers can design networks without visiting physical buildings for inspection. For example, by inspecting a building model through a design module (eg, through a digital clone), a designer can obtain virtual measurements and use tools within the design module to understand penetration into the building at various times of the year light in things. In conventional design procedures, a design engineer may consider architectural drawings to understand the layout of a building. With an understanding of the structure of the building, the designer can create 2D and/or 3D installation schematics that the installer can use as instructions for physical installation. The design process can be tedious, and errors can be introduced due to drawing inaccuracies, misreading of building drawings, and/or designers forgetting to consider design rules (eg, human error). By using design modules, the timeline for designing the network and completing the installation of the device may be accelerated for the reasons discussed herein. The accelerated schedule may be accelerated by at least 50%, 70%, or 90% relative to time spent without utilizing the digital avatars and/or design modules disclosed herein.

In some embodiments, within the design module, the designer has access to a library of objects or features that can be inserted into the building model. These objects or features represent various network components, including windows, window controllers, network controllers, master controllers, sensors, wiring, circuitry for power and communications, and operatively coupled to the network any other means of the road (eg, as disclosed herein). The object library may include structures and/or components that the network can interface with the network, including structural components that may be required during installation (eg, installing devices for controllers, wiring, etc.). In some embodiments, components of the network added to the building model are imported via smart objects that are later used as part of the GUI for controlling the network of optically switchable windows , as discussed elsewhere in this article. Digital clones and/or design modules may include devices and/or objects (eg, stationary and/or non-stationary) that are not coupled to the network. Devices and/or objects that are not coupled to the network (eg, fixed and/or non-fixed) may have identification codes.

In some embodiments, within the design module, components from the library can be easily selected and imported into the building model. In some cases, the design module may assist the design process by automatically selecting and/or suggesting appropriate components for a particular purpose, such as allowing virtual measurements, enforcing design rules, and/or providing warnings when design rules are violated.

22 depicts an example of a method 2200 that a designer may use to design a network. In operation 2202, the building model is loaded or imported into the design module of the facility management application. In some cases, a design module may be an extension or plug-in to an installed facility management application, or in some cases may operate separately from the rest of the facility management application. In some cases, the aspect of the design module including the network object library can be used as a plug-in for CAD software applications such as Autodesk Revit. In operation 2204, the design rules to be enforced by the design module are determined. In some cases, design rules are associated with objects from a component library accessed by the design module and are not editable. Some design rules, such as rules for triggering warnings, can be edited or adjusted by the designer. In some cases, the designer may impose a set of rules for specific connection points or objects to improve the uniformity of the finalized design or to determine how the design module will automatically populate the building model with the objects of the network components. In operation 2206, the building model is populated with objects representing network components. These objects interface with each other at connection points that limit the placement of objects within the building according to design rules. In some cases, populating a building model with objects can be automated by logic within the design module that determines where appropriate window objects should be placed, and then places additional objects as needed to create a network that corresponds to the functionality The network of objects that the connection points of the road join. In some cases, populating the building model may be partially automated, where, for example, the user can select where the device (eg, optically switchable windows) should be placed, and the design module determines placement of other components. In some cases, populating the building model may be a (eg, largely) manual procedure. In operation 2208, adjustments may be made by the designer to the placement of objects within the building model. For example, if the designer is not satisfied with how the building model has been automatically populated with the objects, the designer may adjust the positions of the objects and/or their associated connection points. Having determined the placement of objects within the building model, in operation 2210, the design module may be used to automatically generate various outputs. In some cases, the design module can automatically generate a bill of materials (BOM) or a setup schematic. In some cases, the design module can create or update a building information model (BIM) that can later be used by the building owner to make maintenance, renovation, and other building-related decisions. In some cases, the design module can be used to automatically generate reports that can determine the various costs and benefits of installing the network. In some cases, a design module can be used to generate a graphical user interface for controlling the designed network.

A controller may monitor and/or direct changes in (eg, physical) operating conditions of the apparatus, software, and/or methods described herein. Control may include regulating, manipulating, limiting, directing, monitoring, adjusting, modulating, changing, altering, constraining, checking, directing or managing. Controlled (eg, by a controller) may include attenuated, modulated, varied, managed, restrained, disciplined, regulated, restrained, supervised, manipulated, and/or directed. Controlling may include controlling a control variable (eg, temperature, power, voltage, and/or profile). Control can include instant or offline control. The calculations utilized by the controller can be performed on-the-fly and/or off-line. The controller can be manual or non-manual. The controller may be an automatic controller. The controller can operate on request. The controller may be a programmable controller. The controller can be programmed. A controller may include a processing unit (eg, a CPU or GPU). The controller can receive input (eg, from at least one sensor). The controller can deliver the output. A controller may contain multiple (eg, sub) controllers. The controller may be part of a control system. The control system may include master controllers, floor controllers, local controllers (eg, enclosure controllers or window controllers). The controller can receive one or more inputs. The controller can generate one or more outputs. The controller may be a single-input single-output controller (SISO) or a multiple-input multiple-output controller (MIMO). The controller can interpret the received input signal. The controller may obtain data from one or more sensors. Acquiring can include receiving or extracting. Data may include measurements, estimates, determinations, generation, or any combination thereof. The controller may contain feedback control. The controller may include feedforward control. Control may include on-off control, proportional control, proportional-integral (PI) control, or proportional-integral-derivative (PID) control. Control may include open loop control or closed loop control. The controller may contain closed loop control. The controller may contain open loop control. The controller may include a user interface. The user interface may include (or be operatively coupled to) a keyboard, keypad, mouse, touch screen, microphone, voice recognition package, camera, imaging system, or any combination thereof. The output may include a display (eg, a screen), speakers, or a printer. The methods, systems and/or apparatus described herein may include a control system. The control system can communicate with any of the devices (eg, sensors) described herein. The sensors may be of the same type or of different types, eg, as described herein. For example, the control system may communicate with the first sensor and/or with the second sensor. The control system can control one or more sensors. The control system may control one or more components of the building management system (eg, lighting, security, and/or air conditioning systems). The controller can adjust at least one (eg, environmental) characteristic of the enclosure. The control system may use any component of the building management system to regulate the enclosure environment. For example, the control system may regulate the energy supplied by the heating element and/or by the cooling element. For example, the control system may regulate the velocity of air flowing through the vent to and/or from the enclosure through the vent. The control system may include a processor. The processor may be a processing unit. The controller may include a processing unit. The processing unit may be central. The processing unit may include a central processing unit (abbreviated herein as "CPU"). The processing unit may be a graphics processing unit (abbreviated herein as "GPU"). A controller or control mechanism (eg, including a computer system) can be programmed to implement one or more of the methods of the present invention. A processor can be programmed to implement the methods of the present invention. A controller may control at least one component of the formation systems and/or apparatus disclosed herein.

23 shows a schematic example of a computer system 2300 programmed or otherwise configured to operate one or more of any of the methods provided herein. The computer system may control (eg, direct, monitor and/or regulate) various features of the methods, apparatus and systems of the present invention, such as, for example, controlling heating, cooling, lighting and/or ventilation of the enclosure, or any combination thereof . The computer system may be part of or in communication with any of the sensors or groups of sensors disclosed herein. A computer may be coupled to one or more of the mechanisms disclosed herein and/or any portion thereof. For example, a computer may be coupled to one or more sensors, valves, switches, lights, windows (eg, IGUs), motors, pumps, optical components, or any combination thereof.

A computer system may include a processing unit (eg, 2306) (also "processor", "computer" and "computer processor" as used herein). A computer system may include memory or memory locations (eg, 2302) (eg, random access memory, ROM, flash memory), electronic storage units (eg, 2304) (eg, hard disks), Communication interfaces (eg, 2303) (eg, network adapters) for communicating with one or more other systems, and peripheral devices (eg, 2305), such as cache, another memory, data storage, and / or electronic display adapter. In the example shown in Figure 23, memory 2302, storage unit 2304, interface 2303, and peripherals 2305 communicate with processing unit 2306 via a communication bus (solid line), such as a motherboard. The storage unit may be a data storage unit (or data repository) for storing data. The computer system may be operatively coupled to a computer network ("network") (eg, 2301) by means of a communication interface. A network can be the Internet, an Internet and/or an inter-enterprise network, or a corporate intranet and/or an inter-enterprise network that communicates with the Internet. In some cases, the network is a telecommunications and/or data network. The network may include one or more computer servers, which enable distributed computing, such as cloud computing. In some cases, a network may implement a peer-to-peer network with the aid of a computer system, which may enable devices coupled to the computer system to behave as clients or servers.

The processing unit can execute a sequence of machine-readable instructions, which can be embodied in a program or software. Instructions may be stored in a memory location, such as memory 2302. Instructions may be directed to a processing unit, which may then be programmed or otherwise configured to implement the methods of the present invention. Examples of operations performed by a processing unit may include fetching, decoding, executing, and writing back. The processing unit may interpret and/or execute the instructions. Processors may include microprocessors, data processors, central processing units (CPUs), graphics processing units (GPUs), system-on-chips (SOCs), co-processors, network processors, application-specific integrated circuits (ASICs), Application Specific Instruction Set Processor (ASIP), controller, Programmable Logic Device (PLD), Chipset, Field Programmable Gate Array (FPGA) or any combination thereof. The processing unit may be part of a circuit such as an integrated circuit. One or more of the other components of system 2300 may be included in a circuit.

The storage unit can store files, such as drivers, libraries, and saved programs. The storage unit may store user data (eg, user preferences and user programs). In some cases, the computer system may include one or more additional data storage units external to the computer system, such as on a remote server that communicates with the computer system via an intranet or the Internet.

The computer system can communicate with one or more remote computer systems via a network. For example, a computer system can communicate with a remote computer system of a user (eg, an operator). Examples of remote computer systems include personal computers (eg, portable PCs), tablet or tablet PCs (eg, Apple® iPad, Samsung® Galaxy Tab), telephones, smart phones (eg, Apple® iPhone, Android ( Android) devices, Blackberry®) or personal digital assistants. A user (eg, a client) can access the computer system via a network.

Methods as described herein may be implemented by means of machine (eg, computer processor) executable code stored on an electronic storage location of a computer system, such as, for example, memory 2302 or electronic storage unit 2304. Machine-executable or machine-readable code may be provided in the form of software. During use, processor 2306 can execute code. In some cases, the code may be retrieved from a storage unit and stored on memory ready to be accessed by the processor. In some cases, electronic storage units may be eliminated, and machine-executable instructions stored on memory.

The code may be precompiled and configured for use by a machine with a processor adapted to execute the code, or may be compiled during runtime. The code may be supplied in a programming language that may be selected to enable the code to be executed in a precompiled or as-compiled manner.

In some embodiments, the processor includes program code. The code may be program instructions. Program instructions may cause at least one processor (eg, a computer) to direct a feedforward and/or feedback control loop. In some embodiments, the program instructions cause at least one processor to direct a closed-loop and/or open-loop control scheme. Control may be based at least in part on one or more sensor readings (eg, sensor data). One controller can direct multiple operations. At least two operations may be directed by different controllers. In some embodiments, different controllers may direct at least two of operations (a), (b), and (c). In some embodiments, different controllers may direct at least two of operations (a), (b), and (c). In some embodiments, the non-transitory computer-readable medium causes each distinct computer to boot at least two of operations (a), (b), and (c). In some embodiments, different non-transitory computer-readable media cause each different computer to boot at least two of operations (a), (b), and (c). A controller and/or computer-readable medium may direct any of the apparatuses disclosed herein or components thereof. A controller and/or computer-readable medium may direct any operation of the methods disclosed herein.

In some embodiments, at least one sensor is operatively coupled to a control system (eg, a computerized control system). Sensors may include light sensors, acoustic sensors, vibration sensors, chemical sensors, electrical sensors, magnetic sensors, mobility sensors, motion sensors, speed sensors, orientation sensors sensor, pressure sensor, force sensor, density sensor, distance sensor or proximity sensor. Sensors may include temperature sensors, weight sensors, material (eg, powder) content sensors, metrology sensors, gas sensors, or humidity sensors. Metrology sensors may include measurement sensors (eg, height, length, width, angle, and/or volume). Metrology sensors may include magnetic, acceleration, orientation, or optical sensors. Sensors can transmit and/or receive acoustic (eg, echoes), magnetic, electronic, or electromagnetic signals. Electromagnetic signals may include visible, infrared, ultraviolet, ultrasonic, radio waves, or microwave signals. The gas sensor can sense any of the gases described herein. The distance sensor may be one type of metrology sensor. Distance sensors may include optical sensors or capacitive sensors. Temperature sensors may include bolometers, bimetals, calorimeters, exhaust thermometers, flame detection, Gardon meters, Golay cells, heat flux sensors, infrared thermometers, micro- bolometers, microwave radiometers, net radiometers, quartz thermometers, resistance thermometers, resistance thermometers, silicon bandgap temperature sensors, special sensors microwave/imagers, thermometers, thermistors, thermocouples, thermometers ( For example, resistance thermometers) or pyrometers. The temperature sensor may include an optical sensor. The temperature sensor may include image processing. The temperature sensor may include a camera (eg, IR camera, CCD camera). Pressure sensors may include barometers, barometers, booster gauges, Bourdon gauges, hot filament ionization gauges, ionization gauges, McLeod gauges, U-shaped oscillating tubes , permanent downhole manometer, manometer, Pirani gauge, pressure sensor, manometer, tactile sensor or time pressure gauge. Orientation sensors may include growth meters, capacitive displacement sensors, capacitive sensing, free fall sensors, gravimeters, gyroscope sensors, crash sensors, inclinometers, integrated circuit piezoelectric sensing sensors, laser rangefinders, laser surface velocimeters, lidars, linear encoders, linear variable differential transformers (LVDTs), liquid capacitance inclinometers, odometers, photoelectric sensors, piezoelectric accelerometers, Rate Sensors, Rotary Encoders, Rotary Variable Differential Transformers, Synchronizers, Shock Detectors, Shock Data Loggers, Tilt Sensors, Tachometers, Ultrasonic Thickness Gauges, Variable Reluctance Sensors or speed receiver. Optical sensors can include charge-coupled devices, colorimeters, contact image sensors, electro-optical sensors, infrared sensors, dynamic inductance detectors, light emitting diodes (eg, light sensors), Optically addressable potentiometric sensors, Nichols radiometers, fiber optic sensors, optical orientation sensors, photodetectors, photodiodes, photomultipliers, phototransistors, photoinductors detectors, photoionization detectors, photomultipliers, photoresistors, photoswitches, photocells, scintillation counters, Shack-Hartmann wavefront sensors (Shack-Hartmann), single-photon burst diodes, super Conductive nanowire single-photon detectors, transition edge sensors, visible light photon counters or wavefront sensors. One or more sensors can be connected to the control system (eg, to a processor, to a computer).

In some embodiments, the software application may include a facility viewer. The software application may provide the user with the ability to observe, manipulate (eg, correct or adjust) and/or create various features associated with the facility. Features may relate to the building structure of the facility (eg, fixtures), the facility's assets (eg, non-fixtures and/or fixtures), the facility's network, and/or the facility's control systems. For example, a facility viewer (eg, a building viewer) may facilitate the utilization, modification, and/or creation of topological electrical relationships in a digital avatar of a facility, and is used in a facility viewer software application (eg, an app) The digital avatar is displayed in the user interface (UI). Applications can reside in the cloud or on-premises (eg, in a facility or outside of a facility).

In some embodiments, the application may provide a search feature. In some embodiments, the application may facilitate rendering features. Rendering can be at least every about 5 minutes (min), 10 min, 20 min, 30 min, or 60 min. The rendering frequency of the simulation of the facility may be between any of the foregoing values (eg, 5 min to 60 min, 5 min to 20 min, or 20 min to 60 min). Rendering features can simulate external influences that affect the facility (eg, sunlight shining on the facility). Rendering features can simulate internal effects that affect the facility (eg, the environment that affects the facility). Rendering features may use input from one or more sensors of the facility (eg, historical values and/or current values). Rendering features can use input from a third party (eg, weather forecast). The rendering feature may use historical input (eg, input from this or other facilities, eg, in similar settings (such as similar geographic and/or environmental settings)). The rendering features may take into account one or more jurisdictional rules, regulations and/or constraints. The rendering features may take into account one or more industry recommendations, guidelines and/or standards. For example, a rendering feature can render sensor properties in enclosures such as a facility that vary over time. Attributes may include temperature, gas (eg, air) flow, gas distribution and/or content, noise levels, pressure levels, and the like (eg, depending on sensed measurements). The simulation may include generating a map of the properties of the enclosure for the entire facility. For example, a simulation may visualize a temperature map in a facility (eg, using the facility's temperature sensors). For example, simulations can visualize ventilation maps in a facility (eg, data using vent placement and HVAC operations). For example, a simulation can visualize a noise map in a facility (eg, using the facility's noise sensors). Rendering may be time-dependent rendering. For example, the user can view the evolution of the rendered properties over time (eg, by selecting various times and/or dates, or by selecting a range of times and/or dates). This rendering may be presented as a movie, which may be recorded as appropriate, eg, at the request of the user. The rendered movie may have frames every at least about 5 minutes (min), 10 min, 20 min, 30 min, or 60 min. The rendered frame of the digital clone of the facility may be between any of the above values (eg, 5 min to 60 min, 5 min to 20 min, or 20 min to 60 min).

In some embodiments, the software application may include a search feature. The search feature may facilitate searching the inventory of the facility depicted in the digital avatar (eg, building elements and/or assets (eg, such as non-fixtures and/or equipment)).

In some embodiments, the software application may render a virtual visualization of the facility in its environment in the real world. In some embodiments, the avatar simulation may consider the facility in its environment in the real world. For example, the software application and/or simulation of the digital clone may take into account the field of view affecting shadows and light outside the facility. For example, a software application may present an image (on the UI) of a facility in a municipal environment (eg, an urban environment) and/or in a terrain environment. For example, a software application may present an image (on the UI) of a facility in conjunction with any urban and/or structural engineered feature (eg, roads, bridges, and/or water fountains). Such features may be considered during rendering of the facility, eg, to account for their impact on the exterior and/or interior of the facility (eg, the interior environment).

In some embodiments, the software application may provide the report. Reports may be related to any aspect of digital clone functionality (eg, building elements, networks, controls, and/or assets (eg, fixtures, non-fixtures, and/or devices). Reports can be made instantly. Reports can be generated following changes to the digital avatar of the facility. Reports may provide an overview of facility assets (eg, including any available information including various identities and/or status of the assets). The report may provide the commissioning status of the facility (eg, including the assets within it). A digital clone may contain assets (eg, devices) that have already been commissioned in the facility and/or assets that are to be commissioned in the facility in the future. The user may be able to select various features for inclusion in the report, eg, using an application. For example, a user may choose to report the commissioning status of a facility's devices. In some embodiments, the system hierarchy is included in the digital avatar. The system hierarchy may include the hierarchy of controllers, devices, and/or partitions. Partitions may be grouped into groups (eg, each having a distinct name and/or notation). Partitions may be clustered (eg, where each cluster has a distinct name and/or notation). Partitions, their groupings and/or clusters may form a hierarchy of partitions. The user may select a report describing the selected level (eg, from the available options).

In some embodiments, the software application simulates impingement on and/or penetration of radiation into the facility. An application may use standard penetration depths, eg, based at least in part on space type and/or building vertical, eg, for occupancy location and/or device controls (eg, tinting controls for tintable windows).

In some embodiments, a software application may be used to evaluate the optimality of a device, such as sensors, transmitters, transceivers, antennas, and/or tintable windows, for example, using its simulation capabilities and other utilizations of digital avatars of the facility Location. For example, an application may facilitate the positioning of a weather sensor (eg, a sky sensor). The sky sensor may be placed outside the facility (eg, on a wall or on the roof of the facility. The application may assist in determining a favorable (eg, optimal) location for locating the weather sensor.

In some embodiments, a software application may be used, for example, to simulate and/or evaluate sensor data (eg, of a facility's sensors) in real-time (eg, as it measures data). The application can store sensor thresholds and/or lockouts. The application may allow the user to view sensor data, eg, as simulated with respect to the digital avatar. For example, the application may visualize the mapping of sensor data in at least a portion of the facility, eg, in real time and/or over time. Time and/or date based sliders or time and/or date ranges may be used to facilitate time functionality. For example, temporal functionality may facilitate the evolution of various aspects of the rendering facility (eg, sensed attributes and/or solar radiation) through a day cycle (a 24-hour cycle). The temporal functionality may facilitate rendering based on each season (eg, winter, summer, fall, or spring).

In some embodiments, the application utilizes a software module that includes APIs and/or services that facilitate access and/or use of design and engineering data (eg, via the cloud) for the facility. In some embodiments, applications may utilize software modules (eg, the Autodesk Forge platform) configured to allow access to design and engineering data in the cloud. The application facilitates the extraction of base code for third-party cloud-based design and/or engineering software (eg, Autodesk Forge). For example, applications may facilitate open standard file formats and/or data interchange formats (eg, which use human-readable text to store and transmit data consisting of attribute-value pairs and arrays (and/or other serializable values) data object) extraction. The application facilitates the extraction of language independent data formats. For example, an application may facilitate the extraction of JavaScript or JavaScript-related formats. For example, an application may facilitate the extraction of JavaScript Object Notation (JSON) such as HBJSON. The application can facilitate the extraction of file formats from this cloud application (eg, from a Forge model). The extracted file can be used in a control module (eg, intelligence) configured to control the facility (eg, the facility's control device). For example, extracted files (eg, HBJSON files) can be used to pollinate control systems (eg, by pollinating smart modules, such as in the cloud), and/or to facilities (eg, local) in the database. The facility's database may or may not be in the cloud. The database can be in the facility or external to the facility.

In some embodiments, the software application facilitates saving of input, changes and/or creation of digital avatars. The saved changes to the digital clone can be used for commissioning, for facility control, and/or for facility maintenance. A facility includes any portion of a facility, for example, as indicated in the digital avatar (and, sometimes, also those portions not indicated in the digital avatar).

In some embodiments, the software application may facilitate obtaining user input for use in generating understanding from the avatar (eg, intelligence that may be utilized by the control system). In some embodiments, the software application may include a web interface for generating understanding (eg, intelligence that can be utilized by the control system) from the digital avatar. Users can connect to the software application through a web interface. For example, a customer success manager (eg, CSM) can interact with the application in input information including: (i) partition and (as appropriate) segment name; (i) segment group and (as applicable) ) zoning group names; (ii) zoning clusters and (as appropriate) zoning cluster names; (iii) standard penetration depths (eg, based at least in part on space type and building verticals, such as for occupied locations); (iv) Position and/or (v) sensor threshold and/or sensor lockout for weather file capture.

In some embodiments, a software application (eg, using a digital avatar) renders one or more simulations depicted in an architectural model of the facility. A simulation may contain one or more thresholds. One or more thresholds may have properties, such as a sensed property (eg, temperature). For example, the simulation may present the sensed temperature at the location of the facility at a time, as depicted in a virtual image of the facility (eg, a digital clone of the facility). The simulation may be based, at least in part, on one or more parameters. The simulation may be based, at least in part, on one or more models (eg, based on a model used by the control system, such as an intelligence model). One or more models may include one or more learning modules (eg, using artificial intelligence). Examples of models, installations (eg, buildings), control systems, devices (eg, tinted windows), and networks can be found in the February 5, 2021 application titled "CONTROL METHODS AND SYSTEMS USING EXTERNAL 3D MODELING AND NEURAL NETWORKS U.S. Patent Application Serial No. 17/250,586, filed on August 14, 2019, and International Patent Application Serial No. PCT/US19/46524, entitled "CONTROL METHODS AND SYSTEMS USING EXTERNAL 3D MODELING AND NEURAL NETWORKS" (which is the national phase entry of International Patent Application Serial No. PCT/US19/46524), International Patent Application Serial No. PCT/ US 21/17603 and US Provisional Patent Application Serial No. 63/106,058, filed October 27, 2020, entitled "TINTABLE WINDOW FAILURE PREDICTION," which are incorporated herein by reference in their entirety. Software applications can utilize proprietary scripts. Dedicated scripts can extract data from building models. Extracted data may include partition dimensions (eg, base length scales (FLS) such as width, length, and/or height), footprint dimensions (eg, FLS), device (eg, smart window) properties, key viewing angles, or Window sill height, floor height. Smart window properties may include window dimensions (eg, FLS), or window material properties. Smart windows may incorporate tintable devices (eg, electrochromic devices). Window material properties may include the tintable entity of the smart window, the layer structure (eg, of the tintable device), the layer properties (eg, of the tintable device), or the electrical properties associated with the smart window. The data used for the simulation can be visualized in the digital avatar (eg, in the architectural design of the facility) and/or presented as a report (eg, in a table) and/or as a preset feature, eg, according to the user's preference. The user can manipulate the digital avatar presented in the UI of the application for better viewing by the user. For example, a user may rotate, resize, and move virtual images of facilities presented in the UI relative to the viewing area provided by the UI.

In some embodiments, software applications and/or digital clone simulations are used to find optimal placement of one or more sensors. The simulation can be subjected to analysis of total annual solar hours, which can help reduce (i) situational shadows on sky sensors and/or (ii) heat gain from the sun on the facade (eg, when (eg, , the device collective) when one or more sensors are mounted on the external window frame). Analysis can be coded in one or more scripts. Software applications and/or digital clone simulations can be used to find the best locations for sensors outside or inside the facility. Optimal sensor position analysis can be performed as part of a software application or as a separate module. For example, the one or more sensors may include sensors external to the facility. External sensors can be used to measure external influences on the facility. External influences may include radiation (eg, solar radiation), rain, snow, fog, clouds, hail, wind, or shading. The external sensor may be part of the sensor system. The sensor system may be an external sensor system (eg, a sky sensor system). Examples of external sensor systems (eg, sky sensors), facilities (eg, buildings), control systems, devices (eg, tintable windows), and networks can be found in the application filed on May 11, 2020 US Patent Application Serial No. 16/871,976, entitled "MULTI-SENSOR HAVING A LIGHT DIFFUSING ELEMENT AROUND A PERIPHERY OF A RING OF PHOTOSENSORS," filed November 26, 2019, entitled "MULTI-SENSOR DEVICE AND SYSTEM WITH A LIGHT DIFFUSING ELEMENT AROUND A PERIPHERY OF A RING OF PHOTOSENSORS AND AN INFRARED SENSOR" U.S. Patent Application Serial No. 16/696,887 and INTERNATIONAL PATENT APPLICATION titled "MULTI-SENSOR" filed on October 6, 2016 Serial No. PCT/US16/55709, each of these applications is incorporated herein by reference in its entirety. For example, a software application and/or a digital clone simulation can be used to find the best orientation for a sky sensor on a roof or on an exterior wall of a facility, for example, with the sky sensor passing through external obstructions (e.g., nearby structures or Vegetation (e.g., buildings, other engineered structures, and/or trees) is minimally shading. For example, one or more sensors may include sensors inside the facility. Software may use attributes (e.g., sensor Measured and/or simulated properties) to select the best sensor location in the facility. Properties may include sensed properties. Properties may include temperature, sound, humidity, gas content, gas velocity, gas pressure , particulate matter, volatile organic compounds, or light. Gases may include air, carbon dioxide, oxygen, carbon monoxide, hydrogen sulfide, one or more nitrogen oxide pollutants ( _NOx ), radon, or moisture (water in its gaseous state) .

In some embodiments, the software application may facilitate the interaction of the user directly interacting with the device in the digital avatar of the facility. The application can allow various sensor data to be mapped into the digital avatar of the facility. Sensor data may include forecasted sensor data, real-time measurements of the facility's sensors, or historical measurements. Sensor measurements can be presented as a function of time. Time can be divided into frequencies that are at least the measurement frequency of the sensor. The user may select a time lapse greater than the sensor's measurement frequency (eg, from a drop-down menu as a slider, and/or from a side list).

In some embodiments, the facility simulation and/or digital avatar takes into account customer data. In some embodiments, facility simulations and/or digital avatars have customer profiles. Customer information for customer feedback. Customer profiles may contain customer views. Customer data may be (i) entered directly into the digital avatar (eg, using an app) and/or (ii) entered by a client care representative. A customer care representative may be a representative of: (a) the company that creates and/or maintains the application; (b) the company that commissions and/or maintains the network of the facility; (c) the company that commissions and/or maintains the facility or (d) any combination thereof. In some embodiments, customer input can be visualized by an application. For example, customer input can be visualized as part of a virtual representation of the facility presented in the UI. For example, customer input can be visualized as data (eg, visualized as written data such as in a form). Customer input may include altering proposed target decisions made by the control system (eg, using a control system module). For example, client input may include window shading values that are altered by a control system (eg, using a control system module) to propose target shading values. Customer changes may be analyzed and/or acted upon. This analysis can be utilized by the control system (eg, by intelligence). The input can be an infographic associated with a specific asset. An asset may represent or be associated with a digital avatar of a facility. Infographics may include, for example, customer changes, customer service (eg, salesperson) tickets, tintable window failures, and the like. Applications and/or digital avatars may facilitate visualization of issues, eg, by associating comments to model objects (eg, facility assets). Comments may be made by any user of the App and/or the Client. Users can include commissioning service members, maintenance service members, customer service members, or customers.

In some embodiments, the software application includes a facility viewer. Facility viewers may include digital twin viewers. The application may display customer views and/or the status of various facility components to the user, such as to the customer. The application may facilitate the intuitive and/or visible setting of one or more partitions (eg, and their hierarchies). The application may allow the user to further partition and/or occupy the area in an intuitive manner (eg, while visualizing changes to the digital avatar of the facility and its impact on various aspects associated with the facility, such as environmental aspects). The application may, for example, automatically generate partitions (including their levels) and/or occupancies based at least in part on the penetration depth of the sun angle. Automatically generate presets for applications. The application may facilitate viewing (eg, visually) any delimited furniture, furniture, occupancy, occupancy, partition, sun rays (or any other attribute) in the digital avatar. Changes to properties can be simulated and/or represented as a function of time and rendered as a time-dependent virtual representation in the UI of the application. The user can select the time frequency for rendering, or the time frequency can be provided as a preset time lapse. The user can save the rendering over time as a movie.

In some embodiments, a software application may facilitate adjustment of a control module (eg, a software package) that controls a facility (eg, one or more devices in the facility). For example, the application may facilitate (eg, use intelligence) to adjust control system parameters on the digital clone (eg, locally or in a web application). Changes to the control module may be submitted to the field (eg, for use by the facility's control system). Such changes can be summarized manually and/or automatically, eg, in a report. The reports may be periodic reports, such as weekly reports. Reporting can be aperiodic (eg, as needed, and/or when alternated in the control module). Reports can be generated by the application, eg, based on user selections. Applications can have default preferences for automatically generating reports. The user may be able to change the default preferences of the application. Reports can be sent to select team members and/or clients. Users can list team members and/or clients. In some embodiments, the application may allow viewing of digital clones and/or simulations prior to commissioning (eg, putting on shelves) various aspects of the facility. The application may allow various aspects of the facility to be demonstrated at least in part by viewing and/or detecting digital avatars through the application (eg, using the various simulation capabilities it provides). An example of a control module can be found in International Patent Application Serial No. PCT/US14/16974, filed on February 18, 2014, entitled "CONTROL METHOD FOR TINTABLE WINDOWS", filed on May 7, 2015, entitled "CONTROL METHOD FOR TINTABLE WINDOWS" International Patent Application Serial No. PCT/US15/29675 for METHOD FOR TINTABLE WINDOWS, International Patent Application Serial No. PCT/US17/66198 for the title "CONTROL METHOD FOR TINTABLE WINDOWS" filed on December 13, 2017 No., International Patent Application Serial No. PCT/US21/17603 and International Patent Application Serial No. PCT/US19/46524, and US Patent Application Serial No. 17/250,586, and US Provisional Patent Application In Serial No. 63/106,058, each of these applications is incorporated herein by reference in its entirety.

In some cases, customer success managers (CSMs) do not have the tools (eg, automated tools) to incorporate various devices in their processing facilities. Building information management models (eg, BIM, such as Autodesk Revit files) can be static and have building elements with facilities, but not the devices installed in the facilities, let alone the updated state of such devices . Occasionally, architectural models provide a two-dimensional (2D) representation of a facility rather than a three-dimensional (3D) representation.

In some embodiments, a digital avatar of a facility integrates a (eg, 3D) architectural image of the facility with devices installed in the facility, which corresponds to the actual location of the devices installed in the facility. In some embodiments, this digital avatar may facilitate managing facilities at various levels, eg, through the use of applications (eg, as disclosed herein). The state of the device can be updated to reflect the state of the device in real time or substantially in real time. The digital clone may assist in the deployment and/or maintenance of the facility (eg, including the deployment and/or maintenance of the facility's devices). A digital avatar can act as a tool for a customer and/or a customer manager (eg, a CSM), for example, when interacting with customers or potential customers. A customer may be the owner or tenant of the facility (or any part thereof). The digital avatar may supplement the original BIM file (eg, augmented with device information), or utilize and/or incorporate the BIM file.

In some embodiments, a facility (eg, including a building) is controlled by a control system (eg, as disclosed herein). The control system controls various devices placed in the facility. For example, tintable windows are controlled by a control system. The control system may utilize a control module that calculates and predicts optimal shading values for shading the tintable windows. The control module (eg, which may be referred to herein as "smart") may take into account time of year, season (eg, winter or summer), location of facility (eg, and/or tintable windows), facility Nearby topology, shelters near the facility, structural features of the facility, weather and sun location to control the facility's devices (eg, tinted windows). Weather can be derived from sensors at the facility, from sensors unrelated to the facility, and/or from a third party (eg, a weather forecast service). In some embodiments, at least a portion of the weather data may be located in the facility or outside the facility (eg, at a different location and/or in the cloud).

FIG. 24 shows an example of sun position relative to facility 2400 over time and date. For example, 2403 shows the sun position during summer (eg, at the summer solstice in 2020), and 2401 shows the sun position in winter (eg, at the 2020 winter solstice). 2402 shows the degrees of rotation in the unit circle and associated cardinal directions (eg, cardinal points) north, south, west, and east. This graphic shows the extreme orientation of the sun, which can assist in evaluating the various aspects of the facility relative to solar radiation.

In some embodiments, the control software module takes into account the geographic location of the facility (eg, and/or tintable windows), topology near the facility, obstructions near the facility, structural features of the facility. Topologies near the facility may include considering topologies near the facility, such as including mountains, valleys, peaks, dykes, ridges, depressions, or slopes. The banks, ridges, depressions or slopes can be away from the window or towards the window (which the control software module can take into account). Obstructions near the facility (eg, which potentially affect light (eg, solar radiation) reaching the facility) may include adjacent man-made structures or vegetation (eg, trees and/or large shrubs). Man-made structures may include buildings, statues, monuments, fountains, civil engineering structures, or structurally engineered structures. Urban engineered structures may include bridges, pipelines, columns, tunnels, traffic lights, dams, power stations (or components thereof), electrical attachments, railways, or roads. The control module can take into account the municipal map to which the facility belongs. The control module may consider any reflective surface including metal surfaces (eg, metal cladding and/or metal statues) or bodies of water (eg, oceans, seas, lakes, pools, fountains, rivers and/or streams). A control module (eg, a software module used by a control system) may take into account (i) the facility and/or (ii) reflective, dispersive and/or absorbing surfaces of objects adjacent to the facility. Objects can include vegetation, natural inanimate objects, and man-made objects. Structural features of a facility may include external structural features (eg, which may affect the entry of radiation into the facility). External structural features may include fins, stems, overhangs, curved outer wall portions, straight outer wall portions, protrusions, or embossings.

In some embodiments, the software application may facilitate the annotation of the digital avatar of the facility by the user. Annotations may be visible in the UI, eg (i) in a virtual representation of the facility (eg, in a digital doppelganger) and/or (ii) as a separate block from the virtual representation of the facility. The user may be able to choose whether the annotation is presented as options (i), (ii), or both (i) and (ii) above. Certain annotations may be taken into account by the control system (eg, via a control system software package, such as intelligence). Certain annotations can be solicited from the user by the application.

Figure 25 shows examples of: a municipal map 2501; a topographic map 2503 showing various shaded mountains and valleys that can affect facilities located at 2506 in the valleys adjacent to the shaded mountains; a topology map 2502 depicting roads, and A digitized topology map 2504 near the facility where facility 2505 is located. Figure 26 shows an example of: an annotated bird's-eye view 2601 set nearby; an annotated bird's-eye view 2602 indicating a road near a facility; a town plan 2603 superimposed on a topographic map, the facility belonging to a municipality; , Facility 2605 and digital topographic map 2604 of the municipal plan in its vicinity. Any and all of the graph types depicted in FIGS. 25-26 may be considered (eg, considered) by a control system (eg, using predictive modules such as intelligence) to control the facility (eg, various tintable windows for the facility) coloring).

In some embodiments, the user may provide input to the software application, which may affect the control system. For example, a user may provide input that will alter the control system's decisions or guide the control system in its decision-making process. A software application may permit or restrict users from using it or making certain changes. Various users can have various permission levels. Permission levels can be guided by hierarchy.

In some embodiments, the user provides input to the software application and/or the control system (eg, using a control system software module). The application may be operatively coupled to the control system, which is included as part of the control system. The access levels, controls, and types of user interfaces presented to the user by the application may depend on the permissions granted to the user. Permissions may be granted through the application, through the control system and/or through the network. Privileges may depend on occupant roles (eg, building operations managers vs. employees, full-time employees vs. co-working space users) and/or the type of facility enclosure (eg, shared meeting rooms vs. separate offices). Permissions can have a hierarchical structure. Authority (eg, authority hierarchy) may be based, at least in part, on: (i) Hierarchy Hierarchy, (ii) Voting Majority, which may include thresholds and voting rights, (iii) System User Hierarchy (eg, system administrators may have higher level of user), (iv) geographic location of employee (e.g., remote employees may not be allowed to dictate the environment of non-remote occupiers when requested), (v) geographic location of facility, (vi) facility (or parts thereof) ownership, (vii) security levels (eg, network security levels assigned to different users), and/or (viii) energy, health, safety and/or jurisdictional considerations. Application and/or control system modules may contain logic. The logic may decide whether to suppress or allow direct changes based on the user permission scheme. The logic of the application may determine which user interfaces to present to the user, eg, based at least in part on the permissions scheme. Data from input provided by the user may be collected and/or utilized in this forecast or in another forecast even when the user does not have authority to make feasible decisions.

In some embodiments, various devices (eg, IGUs) are grouped into partitions of targets (eg, of an EC window). At least one partition (eg, each of the partitions) may comprise a subset of devices. For example, at least one (eg, each) partition of the device can be controlled by one or more respective floor controllers and one or more respective local controllers (eg, window controller) control. In some examples, at least one (eg, each) zone can be controlled by a single floor controller and two or more home controllers controlled by the single floor controller. For example, a partition may represent a logical grouping of devices. Each partition may correspond to a set of devices (eg, of the same type) in a particular location or area of a facility that are driven together based at least in part on its location. For example, a facility (eg, a building) may have four sides or sides (north, south, east, and west) and ten floors. In this teaching example, each partition may correspond to a set of smart windows (eg, tintable windows) on a specific floor and on a specific one of the four sides. At least one (eg, each) partition may correspond to a set of devices that share one or more physical characteristics (eg, device parameters such as size or age). In some embodiments, partitions of devices are grouped based at least in part on one or more non-physical characteristics such as, for example, security regulations or business class (eg, IGUs delimiting an administrator's office may be grouped in one or more each partition, while the IGUs that delimit non-managerial offices may be grouped in one or more different partitions).

In some embodiments, at least one (eg, each) floor controller is capable of addressing all devices in at least one (eg, each) of one or more respective partitions. For example, the master controller may issue a primary coloring command to the floor controller that controls the target zone. The primary shading command may include the (eg, abstract) identification of the target partition (hereinafter also referred to as the "partition ID"). For example, the partition ID may be the first agreement ID such as that just described in the example above. In such cases, the floor controller receives a primary rendering command including a rendering value and a zone ID, and maps the zone ID to a second protocol ID associated with the home controller within the zone. In some embodiments, the partition ID is a higher level of abstraction than the first agreement ID. In such cases, the floor controller may first map the zone IDs to one or more first protocol IDs, and then map the first protocol IDs to the second protocol IDs.

In some embodiments, the main controller is coupled to one or more outgoing networks via one or more wired and/or wireless links. For example, the master controller may communicate the acquired status information or sensor data to a remote computer, mobile device, server, database in or accessible to the outgoing network. In some embodiments, various applications executing within such remote devices, including third-party applications or cloud-based applications, can access data from or provide data to the MC. In some embodiments, an authorized user or application communicates requests to modify the shading state of various shadeable windows to the host controller over the network. For example, the host controller may first determine whether to grant the request (eg, based at least in part on power considerations or based at least in part on whether the user has appropriate authorization) before issuing the shading command. The host controller may then calculate, determine, select, or otherwise generate shading values, and transmit the shading values in primary shading commands to cause shading state transitions in the associated shading windows.

In some embodiments, the user submits this request from a computing device such as a desktop computer, laptop computer, tablet computer, or mobile device (eg, a smart phone). The user's computing device may execute a client-side application capable of communicating with the host controller (eg, via an application) and, in some instances, with a host controller application executing within the host controller. In some embodiments, the client-side application may communicate with a separate application in the same or different physical device or system as the main controller, which in turn communicates with the main controller application to effect the desired shading state modification . For example, a host controller application or other separate application may be used to authenticate the user to authorize requests submitted by the user. The user can select the object to be manipulated (eg, the IGU to be colored), and directly or indirectly inform the host controller of these selections, eg, by entering the enclosure ID (eg, room number) through the client-side application . There may be a hierarchy of permissions to change the use of the application and/or to change the digital avatar. The hierarchy may depend on the type of user. For example, factory employee users may not be allowed to change the device network ID. For example, employees may be allowed to change the tint state of windows adjacent to their workstations, but not the tint state of other tintable windows of the facility. For example, a visitor can be prevented from having the mobile circuitry of the visitor connected to the web, applications or making any changes to the digital avatar. Coupling to the network can be automatic and seamless (eg, after initial preferences have been set). Seamless coupling can occur without input from the user. A hierarchy of permissions may be based, at least in part, on (i) selected privileges, (ii) employment hierarchy and/or status, (iii) designated locations within the facility, (iv) access rights to various tiers of the facility network, and/or (v) ) in any combination thereof.

Figure 27 shows an example of a user interface screen of a software application (application) including a customer support portal. A user interface (UI) may allow searching for other customer locations in block 2705, eg, as a free search, and/or a drop down menu search indicated by a down arrow. The UI may include options in block 2708 to select client, software, app store, user and indicate the current user. When the current user's icon is clicked, a drop-down menu can appear allowing the user to log out of the application. The UI may include identification of a local area network (eg, ViewNet), such as by its home address. The UI may include, in block 2706, an overview of modules provided by the application, such as building viewers, service managers, asset explorers (eg, device explorers), user dictionaries, and configuration screens. Additional overview and/or detailed selections of modules may be available in block 2706 by pressing the down arrow to activate the drop-down menu. The user interface screen includes a visual model of the facility 2701 (eg, a location image), which may be optional. In block 2702, the user interface indicates the location name, identification, address and geographic coordinates. In block 2703, contacts for the facility (eg, location) may be available, such as a customer service manager, a project engineering manager, and a location contact. In block 2704, an overview of an asset (eg, device) may be indicated, such as any control panel, network window controller and/or network adapter (abbreviated as NWC/NA), sensor, transmitter or device Collectives (eg, sensing devices) and windows (eg, tintable windows and/or IGUs). The application may allow the user to delete the entry for the facility by pressing 2709 the delete field, or to edit the entry for the facility by pressing 2709 the edit field. Any of the fields in blocks 2707, 2706, 2703, 2704, 2701 can be interactive and, when selected by the user, can provide additional information and/or direct the application to the user after the user's selection The other user interface that will be displayed to the user immediately.

In some embodiments, a facility may be divided into one or more partitions. The partitions may be defined at least in part by the customer or by the facility manager. Partitions may be defined automatically, at least in part. For example, a partition of a device (eg, including a tintable window, sensor, or emitter) can be associated with: (i) the facade of the building it faces, (ii) the Floors, (iii) the buildings in the facilities in which they are housed, (iv) the functionality of the enclosures in which they are housed (such as conference rooms, gymnasiums, offices or cafeterias), (iv) the functionality of the enclosures in which they are housed Specified and/or actual occupancy (e.g., organizational functions), (v) specified and/or actual activities in the enclosure in which it is housed, (vi) tenants, owners and/or managers of the facility’s enclosure (eg, for facilities with various tenants, owners and/or managers) and/or (vii) their geographic location. Partitions may be changeable, eg, visually (eg, using a software application). The status of the partition (eg, the status of the devices incorporated therein) may be displayed by the application (eg, updated in real-time or substantially real-time). One or more partitions may be grouped. For example, all partitions in a floor can be grouped. There may be a partition hierarchy using any of partition associations (i) to (vii).

Figure 28 shows an example of a user interface screen of a software application (application) including a customer support portal. Except for sections similar to those described in the example of FIG. 27 (eg, 2708, 2707, 2805, and 2706), the UI screen shown in the example of FIG. "Smart Sandbox" options including setting and/or modifying zoning, occupancy, location parameters, generating intelligence and reviewing smart buildings. In some embodiments, "smart" refers to a control module that controls a building (eg, various devices housed in the building). The word "wisdom" may be replaced by any other name similar to the control module. FIG. 28 shows an example of the partition setting option in selection block 2802. The option in block 2801 for the user to select one or more partitions is as indicated by the words "Partition Settings". In this fictitious example, the customer's name is indicated as XYZ. Partitions can have a name (here, "Test Partition"), which can be selected from the drop-down menu visible when selecting the respective down arrow to the right of the word "Test Partition". The partition group (when available) is indicated (here "Partition Group Test") to be selected from the drop-down menu visible when the respective down arrow to the right of the word "Partition Group Test" is selected. The user is provided the option to add any image to the file in the image field, which can be viewed in the drop-down menu activated by selecting the drop-down menu next to the word "Add File" Image file (eg, file name). Once the selection is set, the user is presented with the option to save the selection by selecting the "Settings" field in block 2801. Configured partitions are indicated in the diagram of the facility in bold 2805 (eg, windows 2805 included in the partitions set up in 2801 as named test partitions). A toolbox is provided to the user in block 2803, the toolbox includes the following options: return to the home screen (by selecting the home page), fit the window (by selecting fit), reorient the facility in 3D space (by selecting the fit) by selecting the track), moving up and down and/or sideways (by selecting the pan), zooming in or out of the virtual representation of the facility (by selecting the zoom), measuring various distances in the facility (by selecting the measure), selecting A section of a facility (by selecting a section), marking (eg, annotating) a virtual depiction of the facility (by selecting a mark), and exploring another added feature (by selecting Explore).

In some embodiments, the control system takes into account the occupancy area of the facility. Occupants in the occupied area may be affected by sunlight and/or glare, depending on the positioning of the occupied area relative to the windows of the facility, and the state of its tint.

Figure 29 shows an example of a facility wall 2902 with windows 2904 belonging to partitions. The sun 2900 casts rays 2905 that are prevented from reaching the occupied area 2903 in the facility due to the overhang 2901 . The orientation of Sun 2900 can be predicted from its solar path. Figure 29 shows an example of a facility wall 2952 with windows 2954 belonging to partitions. The sun 2950 casts rays 2955 that are not blocked by overhangs 2951 through windows 2954 to occupied areas 2953 in the facility. The orientation of Sun 2950 can be predicted from its solar path. Occupied areas 2903 are boxes, each encompassing designated furniture (eg, of an office environment) and each not extending to the full height of its adjacent walls (eg, 2902 and 2952).

In some embodiments, the estimation of the level of illumination and/or glare of radiation (eg, sunlight) entering the occupied area takes into account one or more angles. The angle may be between a person at the edge of the occupancy and the full extent of the window adjacent to the occupancy. The angle may be a two-dimensional angle that takes into account the average occupant height. The glare zone can be a three-dimensional structure that slopes at the individual and extends to the entire opening of the window (eg, up to the frame). For example, the glare zone may be a three-dimensional cone-like structure that slopes at the individual and extends to the entire opening of the window (eg, a rectangular frame). The angle may be between a person located at the user's designated location in the occupancy area and the full extent of the window adjacent to the occupancy area. Tintable windows, control systems (and modules therein), devices, facilities (eg, buildings) networks, occupancy areas, and methods for determining and/or predicting tint levels for tintable windows (eg, by control systems Examples utilizing ) can be found in International Patent Application Serial Nos. PCT/US14/16974, PCT/US15/29675 and PCT/US17/66198, each of which is incorporated by reference in its entirety manner is incorporated herein. In some embodiments, the control system utilizes at least 2, 3, 4, 5 or 6 individual modules. At least one of the modules contributes to at least about 50%, 60%, 70%, 80%, or 90% of the requested settings, and other control system modules (eg, software modules) contribute to the remainder of the requested settings Part (eg, the target shading level for a shadeable window).

Figure 30 shows one example of an estimated field of view. A portion of enclosure 3005 with windows 3004 (which may belong to partitions) includes a portion of occupied area 3008 . At the edge of occupied area 3008, two occupants 3006 and 3007 are simulated. The field of view of the occupied area is estimated 3009 using the critical viewing angle of the occupant at the edge of the occupied area. Each occupant 3006 and 3007 has a critical viewing angle through window 3004. Occupant 3007 has a critical viewing angle 3001 , and occupant 3006 has a critical viewing angle 3002 . The field of view 3009 is estimated (eg, calculated) using the critical angle.

30 shows another example of an estimated field of view. A portion of enclosure 3035 with windows 3034 (which may belong to partitions) includes a portion of occupied area 3037 . At the designated location of the occupancy area 3037, the occupant 3036 is simulated next to the table 3038 positioned at its designated location in the enclosure 3035. When the occupant is positioned in the specified orientation and is viewing the outside of the window 3034 through its horizontal edge, the field of view 3039 of the occupied area is estimated using the occupant's critical viewing angle at two critical angles. Occupant 3036 views outside of window 3034 at first critical viewing angle 3031, which is the left-most lateral viewing (eg, line-of-sight) angle, and occupant 3036 is viewing the outside of window 3034 at first critical viewing angle 3032, which is the right-most lateral viewing (eg, viewing) angle outside of viewport 3034. The field of view 3009 is estimated (eg, calculated) using the critical angle.

Figure 30 shows an example of radiation entering the enclosure portion. A portion of enclosure 3065 with windows 3064 (which may belong to partitions) includes a portion of occupancy area 3067 where occupants are seated, each sitting next to a table (eg, in a workplace). Illumination is projected into the enclosure portion through the window 3064 and illuminates the occupants in the occupied area 3067, impinging on the occupied area with the length 3069 of the illumination zone 3061. When glare is detected and/or estimated by illuminating light in the illumination zone 3061, the window 3064 will be tinted to a darker tint than when no glare is detected and/or estimated (eg, tint level 1). (eg coloration level 4). When the external radiation source is from the sun, the glare-sensitive area begins at a distance 3068 from the outer wall where the radiation rays do not directly occupy the outer wall as they are projected through the window 3064.

In some embodiments, the tintable windows are tinted to various tint levels. For example, there may be at least 2, 3 or 4 levels of coloration. Tint level 1 may be the brightest tint level (eg, no tint, or maximum clear window). The higher the tinting level number, the darker the tinting can be. For example, when the control level is shaded to four different shade levels, shade level 4 may be the darkest shade. For example, there may be at least 2, 3, 4, 5, 6, 7, 8, 9 or 10 levels of coloration. For example, there may be an infinite number (eg, consecutive) of tinting levels between the lightest tinting (eg, no tinting) and the darkest tinting levels. For example, there may be a discretized number of shading levels.

In some embodiments, a user of a software application (application) can change and/or determine the occupied area, eg, in a control device for a facility (eg, controlling the tint level of tintable windows). For example, the user may determine and/or change one or more volume parameters of the existing occupancy ratio. For example, a user may determine and/or change the placement of occupied areas in a facility. For example, a user may determine and/or change the existence of occupied areas in a facility (eg, a user may delete or create occupied areas). The occupied area can be changed individually. The occupant zones in the partitions can be collectively changed. For example, all occupant areas in a partition can be altered to have a certain height. For example, all occupant zones in a floor, in a building, and/or in a facility can be altered to have a certain height. The occupied area can be determined using the length, width and height of the framed area. An occupied area can be represented as the length, width and height (or any other representation of a physical volume) of the space in which the occupant will stay. In some embodiments, the penetration depth of radiation entering the building includes the offset of the occupied area from the window partition. The user can enter the length of the offset away from the window into the building (eg, on a measurement scale such as feet and inches or meters and centimeters).

Figure 31 shows an example of a user interface screen of a software application (application) including a customer support portal. Except for sections similar to those described in the example of FIG. 27 (eg, 2708, 2707, 3105, and 2706), the UI screen shown in the example of FIG. "Smart Sandbox" options including setting and/or modifying zoning, occupancy, location parameters, generating intelligence and reviewing smart buildings. In some embodiments, "smart" refers to a control module that controls a building (eg, various devices housed in the building). The word "wisdom" may be replaced by any other name similar to the control module. 31 shows an example of the footprint setting option in selection block 3102. The facility, as depicted in 3106, includes the occupancy plan and fixtures of the facility (shown in horizontal cross-section). The options for the user to set the footprint in block 3101 are as indicated by the words "footprint setting". The application provides default settings for the footprint. By continuing by selecting options in block 3101, the user accepts the default settings. The user has the option to customize the footprint by selecting Customize in block 3101. The footprint may be selected for various tint levels of the tintable window (as indicated in block 3101 as tint 3 (lighter tint) and tint 4 (darker tint)). The user can indicate the height (eg, in feet and inches) of the occupied area in various shade levels. The user may enter penetration depth related values into the respective fields in block 3101, based on the penetration depth of the room boundary (PD based on the room boundary). The penetration depth may include the offset of the footprint from the window partition. The user is prompted in block 3101 to enter the amount of offset (in feet (ft) and inches (in)) away from the window. The user can indicate whether furniture boundaries play a role in defining the occupancy area by selecting Yes to the prompted question. The user can preview the footprint by selecting the option Preview. The user may save the defined footprint by selecting option settings in block 3101. The user may be prompted to select a space to set the occupied area as indicated by the words in area 3104. The user can view geographic cardinal directions north, east, south, and west, and facilities by showing indicators at the top (eg, schematically indicated as the front, top, bottom, back, and sides (eg, left and right) of a cube) 3105 For placement, the indicator is placed on a unit circle depicting north, south, west, and east of the associated cardinal directions (eg, cardinal points). This graphic shows the extreme orientation of the sun, which can assist in evaluating the various aspects of the facility relative to solar radiation. The user is provided with a toolbox in block 3103, which includes the following options: return to the home screen (by selecting the home page), fit the window (by selecting fit), reorient the facility in 3D space (by selecting the fit) by selecting the track), moving up and down and/or sideways (by selecting the pan), zooming in or out of the virtual representation of the facility (by selecting the zoom), measuring various distances in the facility (by selecting the measure), selecting A section of a facility (by selecting a section), marking (eg, annotating) a virtual depiction of the facility (by selecting a mark), and exploring another added feature (by selecting Explore).

In some embodiments, the parameters are updated in the digital clone of the facility once the user has completed the adjustment of the various parameters using the software application. This process may be called "pollination". The application may add any (eg, critical) missing features to the digital clone (eg, using default settings). Critical features can be features that, if not added, would create errors and prevent the rendering of the simulation. Simulations and/or applications or portions thereof may run locally in the facility or in a remote setting (eg, on the cloud). In some embodiments, applications may utilize an open model platform. The simulation and/or application may be operatively coupled to the facility's control system. Applications and/or simulations may facilitate testing designs of facilities and components therein (eg, assets such as devices) prior to deployment, thereby testing such facility designs (eg, at least in part by running simulations on digital clones). Applications can facilitate viewing various layers of a facility while ignoring other layers. For example, applications can facilitate viewing device collective connectivity to the network without viewing the inner walls. For example, an application may facilitate viewing only the temperature sensor and not any other sensors. For example, an application may facilitate viewing tinted windows without viewing interior furniture. For example, an application can facilitate viewing a facility, including its assets, without simulating light effects. The application may facilitate searching for asset types (eg, by name), or searching for specific assets (eg, by ID). The application can provide easy search for any asset and/or quick identification of its The ability of the entity's location. Easy searching can include typing asset names, aliases or serial numbers in the search box. An application may facilitate viewing all assets of that type in a digital avatar (eg, as represented in the UI). The user can intuitively select a specific device in the avatar, and detect its status and/or related information (eg, network ID and/or its manufacturer's information). States may appear in the avatar as annotations, as optional collapsible (eg, drop-down) menus, and/or as sidebars. This state can also be present when the device is changing and/or collecting data (eg, in real time). For example, when a user selects a sensor, the sensor's data may be displayed (eg, collected in a time window (which the user can select) and/or in real time (eg, as it is collected) )). The application can receive real-time data and update its database accordingly (eg, in real-time), which data can be used for simulations. The application can be configured to display the path of the sun's motion (eg, historical, real-time, and/or expected). The application can be configured to, for example, show the planned versus actual tinting status of one or more tintable windows of a facility (eg, building) at different times. Different times include historical, immediate, and/or expected times (eg, and dates). The application may facilitate the addition or incorporation of images within the avatar, for example, to show the context of the user's location. The graph may be small compared to the entire facility. The map may include the entire facility or a portion of the facility (eg, a map of a portion of the facility associated with a user, such as a map of the facility that houses the asset of interest). The application may facilitate changing the extent of the graph (eg, using zoom in/out icons). The application may facilitate expanding the scope of the facility portion shown by the diagram, or reducing the scope of the facility portion displayed by the diagram. The size of the displayed graph may or may not remain the same on the GUI screen. An application may facilitate reducing and/or expanding the size of the graph displayed on its user interface.

Figure 32 shows an example of a user interface screen of a software application (application) including a customer support portal. Except for sections similar to those described in the example of FIG. 27 (eg, 2708, 2707, 3105, and 2706), the UI screen shown in the example of FIG. "Smart Sandbox" options including setting and/or modifying zoning, occupancy, location parameters, generating intelligence and reviewing smart buildings. In some embodiments, "smart" refers to a control module that controls a building (eg, various devices housed in the building). The word "wisdom" may be replaced by any other name similar to the control module. FIG. 32 shows an example of a selection to generate a smart option, as can also be viewed in field 3205. This option prompts for updates to the smart control module and polls (eg, updates) the digital avatars of the facility with any user updates. Inform the user of the pollination status in field 3201. For example, in Figure 32, the state depicted in field 3201 is Check Wisdom Settings. A time estimate is presented to the user at 3204, which in this example is 45 minutes. The detailed status is depicted in field 3206. The detailed status includes the version of the avatar (V.1.0), and its author (John Doe). The detailed status field indicates what the software went through (report any errors missing partition names, confirm missing occupied areas). Other detailed status indicators in detailed status field 3206 are possible, as are different general status options in field 3201.

In some embodiments, the application may facilitate viewing the avatar in the UI as a pedestrian simulation for the existing space of the facility (eg, from an average person perspective).

Figure 33 shows an example of a user interface screen of a software application (application) including a customer support portal. Except for sections similar to those described in the example of FIG. 27 (eg, 2708, 2707, 3105, and 2706), the UI screen shown in the example of FIG. "Smart Sandbox" options including setting and/or modifying zoning, occupancy, location parameters, generating intelligence and reviewing smart buildings. In some embodiments, "smart" refers to a control module that controls a building (eg, various devices housed in the building). The word "wisdom" may be replaced by any other name similar to the control module. Figure 33 shows an example of selecting a review smartly constructed building. Block 3301 allows the user to pull the smart field from the drop-down menu that can be activated by selecting the down arrow in field 3301. The image of the facility is displayed in 3304. The user can manipulate the image using the toolbox in block 3105, which includes the following options: return to the home screen (by selecting the home page), fit the window (by selecting fit), reorient the facility in 3D space (by selecting Orbit), moving up and down and/or sideways (by selecting Pan), viewing a virtual image of the facility with an average-person line of sight (by selecting the first person), zooming in or out of a virtual depiction of the facility (by selecting the first person) select zoom), measure various distances in the facility (by selecting measure), select a segment of the facility (by selecting a segment), mark (eg, annotate) a virtual depiction of the facility (by selecting a mark), and Explore another added feature (by selecting Explore). The example UI shown in FIG. 33 allows the user to choose between weekdays and non-workdays (eg, holidays) in block 3321, to select a date in 3322, and a time in block 3323. The user can change the date and time using the sliding ruler or the side arrows. The user can use arrow 3325 to change the date. The user can toggle between the weekday and non-weekday options by selecting box 3321, which will cause the date in box 3322 to change. Block 3322 includes an indicator when the data is today (eg, today). The time scale provided in block 3323 may be discretized (eg, hourly), or continuous. The date and time selection serves as a rendering criterion for the virtual depiction of the facility 3304 (as simulated with respect to sun exposure) and any shadows wagered on various facility parts. In the example shown in Figure 33, Tuesday, June 8, 2021 is a weekday, and at 7AM, shadows are cast in façade 3331 as the sun casts on façade 3332. The user may be able to change the time and data and observe changes in shadows and light relative to the facility. A user can use the toolbox 3305 to manipulate the facility and observe (for a given time and date) the shadows cast on the facility, and the parts of the facility that are illuminated by light and/or experience glare. Users can observe occupancy zone selection and the effect of zone selection during this simulation. Once the user is satisfied with all selections as observed in the simulation, the user can choose to submit the building to the location field 3324, which will complete the selection of the control module (eg, intelligence). A toolbox is provided to the user in block 3305, the toolbox includes the following options: return to the home screen (by selecting the home page), fit the window (by selecting fit), reorient the facility in 3D space (by selecting the fit) by selecting Orbit), moving up and down and/or sideways (by selecting Pan), viewing a virtual image of the facility with an average person line of sight (by selecting First Person), zooming in or out of a virtual depiction of the facility (by selecting Zoom) ), measure various distances in a facility (by selecting a measure), select a segment of a facility (by selecting a segment), mark (eg, annotate) a virtual depiction of a facility (by selecting a mark), and explore other Once features are added (by selecting Explore).

33 shows an example of preparing and/or modifying a digital avatar of a facility in block 3310, starting with entering and/or adjusting details entered in 3311 via the application for an update, which is simulated and verified, and then Sent for pollination of the avatar in 3312 and then sent for storage in 3313, the stored avatar may be sent for detection in optional operation 3314. Once detection is satisfactory, deploy the digital clone for (i) utilization by the control system (eg, using smart modules), (ii) device and/or facility commissioning, and/or (iii) facility and/or or maintenance of the equipment of the facility.

In some embodiments, the software application (application) includes a management module. The management module facilitates the management of the various devices of the facility. For example, an application facilitates the selection of a device in a facility to view its status and related information. The management software application module may provide capabilities similar to those discussed above (eg, with respect to Figures 18 and 21).

Figure 34 shows an example of a UI for an application with a management module. The UI displays in field 3401 an indication of the simulated selected facility. The user can use the down arrow in field 3401 to select another facility. A down arrow opens a drop-down menu listing other simulated facilities from which the user can choose. Field 3402 indicates various options of options that the user can view in the UI (eg, overview, sensing (eg, sensor devices), or smart windows (eg, tintable windows). Shown in FIG. 34 The overview option is selected in the example. The selected facility simulation in 3401 is visually depicted in the virtual representation of facility 3405. Block 3470 provides the user with the option to expand the facility view by selecting magnifying glass 3475, understanding the facility in 3471 relative to the basic Directions North, southwest, and east orientations, which include the unit circle and associated cardinal directions (eg, cardinal points), and also include opposing facades of buildings (eg, schematically indicated as the front, top, bottom, back, and sides of a cube) ), the user can select a 3D view by selecting 3473. The user can toggle between selections of detailed information about the selected item (eg, facility 3405) in icon 3472. Help can be provided by clicking on icon 3474. Using User identification (eg, abbreviation) is presented by logging in in icon 3404. The user may log out by clicking on icon 3404, which may present a menu allowing the user to select a logout option. Tool manipulation facilities may be used in block 3406 Simulation 3405 (eg, a virtual depiction of a facility). Portions of the simulated facility are interactive. For example, devices of the facility may be interactive. For example, a user may select a device in the facility simulation 3405 ( For example, smart window 3490a), which may prompt to zoom on that device 3490b. The user may view details of the selected device by selecting icon 3472 that will present menu 3476. An indication of the details is presented in 3477. Details may include The device's network identification (e.g., the device's name), the device's factory identification (e.g., the window ID), and any other technical information and/or status of the device, such as those listed in field 3476 and/or or status (eg, whether the device is commissioned). Some indicators are optionally indicated by alphanumeric characters (eg, window ID), and some are indicated by image icons (eg, commissioning indicators). Use The user can manipulate the facility and observe (for a given time and date) the shadows cast on the facility, and portions of the facility that are illuminated by light and/or experience glare using the toolbox 3406. The toolbox is provided to the user in block 3406, The toolbox includes the following options: rotate the virtual facility along the vertical axis by selecting icon 3451, fit to the screen by selecting icon 3452, move the virtual facility image vertically by selecting icon 3453, Icon 3454 View virtual image of facility at average person line of sight, record rendered movie of virtual facility by selecting icon 3455, measure various distances in facility by selecting icon 3456, segment plane 3457, explosion model object 3458, floor 3459, Model Browser 3460, Object Properties 3461, Change Settings by Selecting Icons 3462, Render Sun Objects and Shadows 3463.

In some embodiments, the software application may present a virtual visualization of the inside of the facility in the real world. In some embodiments, the digital clone simulation may consider the interior of the real-world interior of the facility (eg, as planned and/or as sensed by sensors). For example, the software application and/or simulation of the digital clone may take into account the field of view affecting shadows and light within the facility. For example, a software application may present an image (on the UI) of at least a portion of a facility, its fixtures and/or non-fixtures. For example, the software application may present an image (on the UI) of the facility in one or more of the following: walls, openings (eg, windows, vestibules, hallways, hallways, piers, and/or doors), Ceilings, floors, furniture and/or lighting. Such features may be considered during rendering of the facility, for example, to consider the effect of these features on the interior of the facility (eg, the interior environment such as light and shadow distribution).

In some embodiments, the field of view is the volume of space visible from a given point in space, and the location specification for that point. The field of view may be three-dimensional, or represented as a two-dimensional map (eg, a horizontal cross-section of a 3D field of view). The shape of the boundaries of the field of view may or may not vary with location. A field of view may be a volume of space illuminated by a point light source.

35 shows an example of a field of view on a two-dimensional floor plan 3500 of a facility. The window opening 3510 is positioned at the wall 3520 of the facility. The set of locations on the floor plan 3500 is hit by the ray 3530 depicted in the field of view 3540, which can be used to evaluate the light penetrating from the window 3510.

While preferred embodiments of the invention have been shown and described herein, it will be apparent to those skilled in the art that such embodiments are provided by way of example only. It is not intended that the invention be limited to the specific examples provided in the specification. While the invention has been described with reference to the foregoing specification, the description and illustration of the embodiments herein are not intended to be construed in a limiting sense. Numerous changes, changes, and substitutions will now occur to those skilled in the art without departing from the invention. Furthermore, it is to be understood that all aspects of the invention are not limited to the specific depictions, configurations, or relative proportions set forth herein, which depend upon various conditions and variables. It should be understood that various alternatives to the embodiments of the invention described herein may be employed in practicing the invention. Accordingly, it is intended that the present invention also covers any such alternatives, modifications, variations or equivalents. It is intended that the following patent claims define the scope of the present invention and that methods and structures within the scope of these claims and their equivalents be covered thereby.

100: Electrochromic device 102: Substrate 104: the first conductive layer 106: the first electrochromic layer 108: Ion conductor layer 110: the second electrochromic layer 112: the second conductive layer 114: Electrochromic Stacking 116: Voltage source 200: System 202: Electrochromic Windows 204: Buildings 206: Heating, ventilation and air conditioning systems 207: Interior Lighting System 208: Security System 209: Power Systems 210: Building Management Systems 211: Main Controller 212: Network Controller 214: Window Controller 300: System 304: Distributed local controller 306: Floor Controller 308: Main Controller 401: Location 403: Partition 405: Main Controller 406: Network Controller 407: Window Controller 422:IGU 424: Window Controller 503: Network configuration file 504: Control Logic 508: Graphical User Interface 509: Smart System 601: Operation 602: Operation 603: Operation 604: Operation 611: Operation 701: IGU and window controller placement 702: Control Panel 703: Trunk 705: Wall Interface 801:IGU 900: Procedure 901: Architectural Schema 902: Interconnection Schema 903: Network ID information 904: Commissioning logic 905: Network configuration file 1000: Program 1001: Operation 1002: Operation 1003: Measured bearing 1004: Commissioning logic 1005: Network configuration file 1100: Digital Clone 1101: BIM Archives 1200: closed body 1201: Controller 1202: Digital Clone 1203: Network link 1204: Network link 1205: Interactive Target Device 1206: Virtual Objects 1207: Marcher 1208: Mobile Devices 1209: Identify the capture device 1300:ID Tag 1301: Window ID 1302: QR code 1400: Digital Clone 1401: BIM Systems 1402: Server 1403: Mobile Devices 1404: Display 1405: Sensor 1407: Target Device 1408: Capture Device 1409: Application 1500: Mobile Devices 1501: Human Marcher 1502: Real Facilities 1503: Visual Display Section 1504: Application Control Icon 1505: Virtual representation 1510: Dropdown menu 1512: Information 1515: Virtual Target Device 1600: Mobile Devices 1601: Real Target Device 1602: Real Target Device 1603: Real Target Device 1604: Real Target Device 1610: View 1611: Capture frame 1612:ID code 1700: User Interface Screen 1701: Wall 1702:IGU 1703: Display Identifier 1800: Virtual Room 1801: Target Device 1802: Data Records 1803: Identification code 1901: Operation 1902: Operation 1903: Operation 1904: Operation 1905: Operation 1906: Operation 1907: Operation 1908: Operation 1909: Operation 1910: Operation 1911: Operation 1912: Operation 1913: Operation 1914: Operation 1915: Operation 2000: Facility Management Application 2002: Building model 2004: User input 2010: Viewer Module 2020: Master Controller 2022: Control Instructions 2024: Installation Information 2030: Network Configuration File 2102: Windows 2103: Greeting 2104: Navigation Controls 2106: Surface 2108: Dialog 2200: Methods 2202: Operation 2204: Operation 2206: Operation 2208: Operation 2210: Operation 2212: Operation 2214: Operation 2300: Computer Systems 2301: Computer Network 2302: Memory 2304: Storage Unit 2303: Interface 2305: Peripherals 2306: Processing Unit 2400: Facilities 2401: Sun Position 2402: degree of rotation 2403: Sun Position 2501: Municipal Map 2502: Topography 2503: Topographic Map 2504: Digitized Topography 2505: Facilities 2506: Valley 2601: Annotated aerial view 2602: Annotated bird's-eye view 2603: Urban Planning 2604: Digital Topology Drawing 2605: Facilities 2701: Facilities 2702: Blocks 2703: Block 2704: Blocks 2705: Block 2706: Block 2707: Blocks 2708: Blocks 2709: Delete Field/Edit Field 2801: Blocks 2802: Blocks 2803: Block 2804: Blocks 2805: Window 2900: Sun 2901: Outriggers 2902: Facility Wall 2903: Occupied area 2904: Window 2905: Light 2950: Sun 2951: Outriggers 2952: Facility Wall 2953: Occupied area 2954: Window 2955: Light 3001: Critical Perspective 3002: Critical Perspective 3004: Window 3005: Closure 3006: Occupier 3007: Occupier 3008: Occupied area 3009: Field of View 3031: First Critical Perspective 3032: First Critical Perspective 3034: Window 3035: Closure 3036: Occupier 3037: Occupied area 3038: Table 3039: Field of View 3061: Irradiation Zone 3064: Window 3065: Closure 3067: Occupied area 3068: Distance 3069:Length 3101: Blocks 3102: Blocks 3103: Blocks 3104: District 3105: Indicator 3106: Facilities 3201: Field 3202: Blocks 3203: Send model 3204: time estimate 3205:Field 3206: Field 3301: Blocks 3302: Blocks 3304: Facilities 3305: Block 3310: Blocks 3311: Operation 3312: Operation 3313: Operation 3314: Operation 3315: Operation 3321: Block 3322: Blocks 3323: Block 3324: field 3325: Arrow 3331: Facade 3332: Facade 3401: Field 3402: Field 3403: Field 3404: Icon 3405: Facilities 3406: Block 3451: Icon 3452: Icon 3453: Icon 3454: Icon 3455: Icon 3456: Icon 3457: Section Plane 3458: Explosion Model Object 3459: Floor 3460: Model Browser 3461: Object Properties 3462: Icon 3463: Rendering sun objects and shadows 3470: Block 3471: Orientation 3472: Icon 3473: Icon 3474: Icon 3475: Magnifying Glass 3476: Menu 3477: Details 3490a: Smart Window 3490b: Device 3500: 2D Floor Plan 3510: Window Opening 3520: Wall 3530: Light 3540: Sight

The novel features of the present invention are set forth in detail in the appended claims. The features and advantages of the present invention will be better understood with reference to the following embodiments and accompanying drawings or diagrams (also referred to herein as "Fig./Figs.") that illustrate the principles of utilizing the present invention Illustrative examples of, in the drawings:

[FIG. 1] is a schematic cross-section depicting the formation of an electrochromic device stack;

[Fig. 2] schematically shows the control system of the building;

[FIG. 3] A schematic block diagram showing the control system;

[FIG. 4] depicts a hierarchical structure in which devices can be configured;

[FIG. 5] schematically depicts a network configuration file used by control logic to perform various functions on the network;

[Fig. 6] schematically depicts the process of creating a network configuration file;

[FIG. 7] An interconnection diagram depicting closed body parts;

[FIG. 8] An elevation view depicting an interconnection pattern;

[Fig. 9] schematically shows a block diagram related to commissioning;

[FIG. 10] schematically shows a block diagram related to commissioning;

[FIG. 11] A schematic depiction of the use of a Building Information Model (BIM) file to generate a virtual representation of a building;

[Fig. 12] schematically depicts a digital avatar of an enclosure corresponding to a real enclosure, and a control system;

[FIG. 13] An example identification mark showing a target device;

[FIG. 14] schematically depicts a system for considering devices in enclosures;

[FIG. 15] Shows imagery associated with real and virtual navigation in the environment to identify the target device and/or the location of the target device;

[FIG. 16] depicts a mobile device scanning the identification code of the target device among the target devices;

[FIG. 17] depicts a graphical user interface (GUI) portion that provides navigation within an augmented reality representation;

[FIG. 18] Shows the selected target device representation and information stored in the digital avatar about the selected target device;

[FIG. 19] is a schematic flowchart of a method associated with considering a target device;

[Fig. 20] is a schematic diagram showing the structure of a facility management application;

[Fig. 21] is an example of the GUI portion of a facility management application;

[Fig. 22] A schematic flowchart depicting the procedures used in design and commissioning;

[FIG. 23] schematically depicts a processing system;

[FIG. 24] A schematic depiction of time-dependent sun orientation relative to a facility;

[FIG. 25] Various topographical and schematic representations of the depicted area;

[FIG. 26] Various topographical and schematic representations of the depicted area;

[Fig. 27] User interface screen depicting software application;

[Fig. 28] A user interface screen depicting a software application;

[FIG. 29] schematically shows a footprint and associated components;

[FIG. 30] A schematic representation of facility sections and associated fields of view and illumination zones;

[FIG. 31] A user interface screen depicting a software application;

[FIG. 32] A user interface screen depicting a software application;

[Fig. 33] depicts the user interface screen of the software application, and the sequence of operations;

[FIG. 34] A user interface screen depicting a software application; and

[FIG. 35] A view (Isovist) in a building is shown schematically.

The figures and components therein may not be drawn to scale. Various components of the drawings described herein may not be drawn to scale.

1500: Mobile Devices

1501: Human Marcher

1502: Real Facilities

1503: Visual Display Section

1504: Application Control Icon

1505: Virtual representation

1510: Dropdown menu

1512: Information

1515: Virtual Target Device

Claims (111)

A method of logging into one or more real target devices, the method comprising: (A) identifying a location information of a real target device at least in part by: (i) using a mobile device to select a virtual target device in a virtual representation of an enclosure in which the real target device is placed, the A virtual target device is a virtual representation of the real target device included in the one or more real target devices disposed in the enclosure, and/or (ii) using a geographic location that locates the real target device News; (B) using an identification capture device to capture an identification code of the real target device, the identification code attached to the real target device; and (C) logging into the real target device at least in part by linking (I) the identification code, (II) the location information, and (III) the virtual representation of the enclosure. The method of claim 1, wherein the virtual representation of the enclosure is an augmented reality. The method of claim 1, wherein the virtual representation of the enclosure is displayed on the mobile device, wherein the virtual representation includes a virtual representation of at least some of the one or more real target devices. The method of claim 3, further comprising navigating within the virtual representation of the enclosure based on movement of the mobile device within the enclosure. The method of claim 4, wherein the mobile device is transported by a traveler within the enclosure, and wherein a zoomed view in the virtual augmented reality representation is presented in real time on a display of the mobile device to at least partially A virtual representation of the real target device is depicted based on a current location of one of the pedestrians. The method of claim 5, wherein the traveler is a human. The method of claim 5, wherein the traveler is a robot with image recognition capability. The method of claim 3, further comprising updating the virtual representation of the enclosure based on the registration of the target device. The method of claim 8, wherein the virtual representation of the enclosure is derived from and/or includes an architectural model of the enclosure. The method of claim 9, further comprising updating the building model according to the registration of the real target device. The method of claim 9, further comprising determining the real target device at least in part by utilizing the virtual representation of the enclosure, the virtual representation of the real target device, and associated information obtained by utilizing the capture device one of the states. The method of claim 11, wherein the associated information is linked to the real target device and/or linked to the enclosure. The method of claim 11, wherein the associated information is obtained from a source identified by the identifying retrieval device as a result of the retrieval. The method of claim 13, wherein the source is at least one server file linked by the identifier. The method of claim 11, further comprising (a) initiating service of the real target device when the determined state indicates a service need, and (b) updating the determined state upon completion of the service. The method of claim 1, wherein the geographic information is absolute information. The method of claim 16, wherein the absolute information is derived at least in part from a global positioning system (GPS) receiver or from an ultra-wideband (UWB) receiver. The method of claim 1, wherein the geographic information is a relative location in the virtual representation of the enclosure. 19. The method of claim 18, wherein the relative position is referenced to a fixture of the enclosure. The method of claim 1, wherein the identification retrieval device is mobile. The method of claim 20, wherein the identification capture device captures the identification code optically and/or electronically. The method of claim 21, wherein the identification code includes a barcode and/or a quick response (QR) code. The method of claim 21, wherein the identification code includes at least a one-dimensional code or a two-dimensional code. The method of claim 21, wherein the identification code comprises an electromagnetic code. The method of claim 1, wherein when the location information is identified, the real target device does not have a corresponding virtual target device representation in the virtual representation of the enclosure. The method of claim 1 or claim 25, further comprising using the identification code to populate (a) the virtual representation of the enclosure with a virtual representation of the real target device and/or associated information of the real target device and/or /or (b) at least one associated database of the virtual representation of the enclosure. The method of claim 26, wherein the identification code is linked to the virtual representation of the real target device and/or the associated information about the real target device in the at least one association database. The method of claim 27, wherein the at least one association database includes a lookup table. The method of claim 25, further comprising selecting the virtual representation of the real target device from a plurality of choices presented by the mobile device. The method of claim 25, further comprising selecting the identification code of the real target device from a plurality of identification codes presented by the mobile device. The method of claim 1, further comprising transmitting the retrieved identification code to at least one database for storing and/or operatively coupled to the virtual representation of the enclosure. The method of claim 31, wherein the enclosure comprises a network, wherein the mobile device is communicatively coupled to the at least one database via the network in a wired and/or wireless manner. The method of claim 32, wherein the network is communicatively coupled to the real target device. The method of claim 32, wherein the network is a hierarchical network including a plurality of controllers. The method of claim 32, wherein the network provides power and communications, the network is configured for at least fourth (4G) generation or at least fifth (5G) generation cellular communications. The method of claim 32, wherein the network is configured for media and/or video transmission using coaxial cable, optical wire, and/or twisted pair. The method of claim 1, wherein the mobile device is included in a handheld pointing device. The method of claim 1, wherein the mobile device is included in a mobile phone. The method of claim 1, wherein the mobile device is included in a tablet computer. A non-transitory computer-readable medium for logging into one or more real target devices, the non-transitory computer-readable medium, when read by one or more processors, is configured to execute items such as claim 1 to claim Operation of any one of the methods of 39. An apparatus for logging into one or more real target devices, the apparatus comprising at least one controller having circuitry configured to: (A) operatively coupled to an identification capture device and coupled to a virtual representation of an enclosure in which the one or more real target devices are positioned; (B) receiving or directing the receipt of location information for a real target device at least in part by: (i) selecting a virtual target device in a virtual representation of an enclosure in which the real target device is located, the virtual target the device is a virtual representation of the real target device included in the one or more real target devices, and/or (ii) geographic information locating the real target device; (C) receiving, or directing to receive, identification information for the real target device from the identification capture device configured to capture an identification code for the real target device, the identification code being attached to the real target device; and (D) logging or directing logging into the real target device at least in part by linking or directing linking (I) the identification code, (II) the location information, and (III) the virtual representation of the enclosure. The apparatus of claim 41, wherein the at least one controller is configured to generate or direct the generation of the virtual representation of the enclosure as an augmented reality. The apparatus of claim 41, wherein the at least one controller is configured to display or direct display of the virtual representation of the enclosure on the mobile device, wherein the virtual representation includes at least one of the one or more real target devices Some virtual representations. The apparatus of claim 43, wherein the at least one controller is further configured to navigate or guide navigation within the virtual representation of the enclosure based on movement of the mobile device within the enclosure. The apparatus of claim 44, wherein the mobile device is transported by a traveler within the enclosure, and wherein the at least one controller is configured to present or direct presentation of the virtual extension in real time on a display of the mobile device One of the augmented reality representations zooms the view to depict a virtual representation of the real target device based at least in part on a current location of the traveler. The apparatus of claim 45, wherein the traveler is a human. The apparatus of claim 45, wherein the traveler is a robot with image recognition capabilities. The apparatus of claim 41, wherein the at least one controller is further configured to update or direct update the virtual representation of the enclosure based on the registration of the real target device. The apparatus of claim 48, wherein the virtual representation of the enclosure is derived from and/or includes an architectural model of the enclosure. The apparatus of claim 49, wherein the at least one controller is further configured to update or direct update of the building model based on the registration of the real target device. The apparatus of claim 49, wherein the at least one controller is further configured to, at least in part, by utilizing (i) the virtual representation of the enclosure, (ii) the virtual representation of the real target device, and (iii) A state of the real target device is determined or guided to be determined by using the associated information obtained by the capture device. The apparatus of claim 51, wherein the associated information is linked to the real target device and/or linked to the enclosure. The apparatus of claim 51, wherein the at least one controller is further configured to obtain or direct obtaining the associated information from a source identified by the identifying capturing device as a result of the capturing. The apparatus of claim 53, wherein the source is at least one database file linked by the identifier. The apparatus of claim 51, wherein the at least one controller is further configured to (a) initiate service of the real target device or direct initiating service of the real target device when the determined state indicates a service need , and (b) the status as determined by the immediate update or boot update upon completion of the service. The device of claim 41, wherein the geographic information is absolute information. The apparatus of claim 56, wherein the at least one controller is further configured to derive or direct the derivation of the absolute information, at least in part, from a global positioning system (GPS) receiver or from an ultra-wideband (UWB) receiver. The apparatus of claim 41, wherein the geographic information is a relative location in the virtual representation of the enclosure. The apparatus of claim 58, wherein the at least one controller is further configured to reference or direct reference to the relative position to a fixture of the enclosure. The apparatus of claim 41, wherein the identification retrieval device is mobile. The apparatus of claim 60, wherein the at least one controller is configured to direct the identification capture device to optically and/or electronically capture the identification code, the controller operatively coupled to the identification capture Take the device. The device of claim 61, wherein the identification code includes a barcode and/or a quick response (QR) code. The device of claim 61, wherein the identification code includes at least a one-dimensional code or a two-dimensional code. The apparatus of claim 61, wherein the identification code comprises an electromagnetic code. The apparatus of claim 41, wherein when the location information is identified, the real target device does not have a corresponding virtual target device representation in the virtual representation of the enclosure. The apparatus of claim 41 or claim 65, wherein the at least one controller is further configured to use or direct use of the identification code with (i) a virtual representation of the real target device and/or (ii) the real target The associated information of the device populates at least one associated database of (a) the virtual representation of the enclosure and/or (b) the virtual representation of the enclosure. The apparatus of claim 66, wherein the identifier is linked to the virtual representation of the real target device and/or the associated information about the real target device in the at least one association database. The apparatus of claim 67, wherein the at least one association database includes a lookup table. The apparatus of claim 41, wherein the at least one controller is further configured to facilitate selection of the virtual representation of the real target device from a plurality of selections presented by the mobile device. The apparatus of claim 69, wherein the at least one controller is further configured to facilitate selection of the identification code of the real target device from a plurality of identification codes presented by the mobile device. The apparatus of claim 41, wherein the at least one controller is further configured to communicate or direct the communication of the captured identification code to at least one of the virtual representations stored and/or operatively coupled to the enclosure database. The apparatus of claim 71, wherein the enclosure comprises a network, wherein the mobile device is communicatively coupled to the at least one database via the network in a wired and/or wireless manner. The apparatus of claim 72, wherein the network is communicatively coupled to the real target device. The apparatus of claim 72, wherein the network is a hierarchical network including a plurality of controllers. The apparatus of claim 72, wherein the network provides power and communications, the network is configured for at least fourth (4G) generation or at least fifth (5G) generation cellular communications. The apparatus of claim 72, wherein the network is configured for media, video and/or power transmission using coaxial cable, optical wire and/or twisted pair. The apparatus of claim 41, wherein the mobile device is included in a handheld pointing device. The apparatus of claim 41, wherein the mobile device is included in a mobile phone. The apparatus of claim 41, wherein the mobile device is included in a tablet computer. A non-transitory computer-readable medium for logging into one or more real target devices, the non-transitory computer-readable medium, when read by one or more processors, is configured to perform any of the requests such as Operation of the equipment of item 79. A method for simulating a real facility, the method comprising: (i) generating a digital avatar of a real facility at least in part by using a virtual architectural model of a real facility; (ii) populating in the digital clone at least one device of the real facility at a virtual location corresponding to its real location in the real facility, the at least one device being controllable; and (iii) Simulate or lead to simulate the effect of at least one environmental attribute on the real facility. The method of claim 81, wherein the environmental attribute comprises lighting, radiation, temperature, gas velocity, gas flow, gas content, gas concentration, gas pressure, sound, volatile organic compounds, or particulate matter. The method of claim 82, wherein the irradiation is an external radiation impinging on and/or penetrating the real facility. The method of claim 82, wherein the gas comprises oxygen, carbon dioxide, carbon monoxide, radon, oxygen, nitrogen, hydrogen sulfide, one or more nitrogen oxide pollutants (NOx), or water vapor. The method of claim 81, further comprising displaying the digital avatar on a user interface to visualize the digital avatar in a facility viewer when the digital avatar is affected by the environmental attribute. The method of claim 85, wherein the simulation is a time-varying simulation. The method of claim 86, further comprising saving the time-varying simulation. The method of claim 85, further comprising using the facility viewer to solicit an input from a user that affects one or more aspects of the digital avatar. The method of claim 81, wherein the at least one device comprises a tintable window, a sensor and transmitter, a controller, a transceiver, an antenna, a media display, or a collection of devices. The method of claim 89, wherein the apparatus collectively comprises (i) a transceiver, (ii) a sensor, or (iii) a sensor and a transmitter. The method of claim 81, wherein the digital avatar is used to control the real facility. The method of claim 81, further comprising adjusting or creating a footprint of the real facility. The method of claim 81, wherein the at least one device is a plurality of devices, and wherein the method further comprises adjusting or creating a partition of the real facility associated with at least a portion of the plurality of devices. The method of claim 93, which associates the at least the portion of the plurality of devices with the partition. The method of claim 81, wherein the at least one device is a plurality of devices of different types, and wherein the method further comprises searching for one of the different types of the plurality of devices. The method of claim 96, further comprising presenting the type of the different types of the plurality of devices in the digital avatar. The method of claim 81, wherein the at least one device is a plurality of devices, and wherein the method further comprises selecting a device of the plurality of devices. The method of claim 97, further comprising presenting the one of the plurality of devices in the digital avatar along with its status, network identification and/or factory information, wherein the network identification is the one device in the digital avatar A unique identifier on the network of one of the real facilities. The method of claim 81, further comprising a mapping of the at least one environmental attribute in the digital avatar. The method of claim 99, wherein the simulation is a time-dependent simulation. The method of claim 81, further comprising populating the digital avatar with input from a user. The method of claim 103, wherein a user of the user interface includes a commissioning staff, a maintenance staff, a customer service staff or a customer. A non-transitory computer-readable medium for visualizing a digital avatar of a real facility, the non-transitory computer-readable medium, when read by one or more processors, is configured to perform operations including those of claim 81 to An operation of any of the methods of claim 102 . An apparatus for simulating a real facility, the apparatus comprising at least one controller configured to perform or direct the performance of any of the methods of claim 81 to claim 102. A system for simulating a real facility, the system including a network configured to transmit one or more signals associated with any of the methods as claim 81-102. A non-transitory computer-readable medium for visualizing a digital avatar of a real facility, the non-transitory computer-readable medium, when read by one or more processors, is configured to perform operations including : (i) generating or directing the generation of a digital avatar of a real facility at least in part by using a virtual architectural model of a real facility; (ii) in the digital clone at least one device of the real facility is populated or directed to be populated at a virtual location corresponding to its real location in the real facility, the at least one device being controllable; and (iii) Simulate or lead to simulate the effect of at least one environmental attribute on the real facility. The non-transitory computer-readable medium of claim 106, wherein the operations further comprise displaying or directing display of the digital avatar on a user interface to visualize the digital avatar when the digital avatar is affected by the environmental attribute. An apparatus for simulating a real facility, the apparatus comprising at least one controller configured to: (i) generating or directing the generation of a digital avatar of a real facility at least in part by using a virtual architectural model of a real facility; (ii) in the digital clone at least one device of the real facility is populated or directed to be populated at a virtual location corresponding to its real location in the real facility, the at least one device being controllable; and (iii) Simulate or lead to simulate the effect of at least one environmental attribute on the real facility. The apparatus of claim 108, wherein the simulation is used to control the real facility. The apparatus of claim 108, wherein the at least one controller is configured to direct a software application to display the avatar on a user interface to visualize the avatar when the avatar is affected by the environmental property, wherein The at least one controller is operatively coupled to the application or incorporates the software application. A system for simulating a real facility comprising: A network configured to: at least one device operatively coupled to the real facility, the at least one device is populated in a digital avatar at a virtual location corresponding to its real location in the real facility, the at least one device accessible via the network control; communicating the digital avatar of the real facility generated at least in part by using a virtual building model of a real facility; and A simulation that includes at least one environmental attribute's impact on one of the real facilities is communicated.

Images