WinAll Inputs & Monitors

Multiple Virtual Monitors

Virtual Mouse

Virtual Multitouch

Head Tracking

​​​​WinAll leads to pervasive XR and it has to sustain WinAll like front end GPUs first to sustain later back-end GPUs. No one is safe without grounding to me/Americans owning top innovations/power, serious lessons to take at this point. Let's Win All together now!  ​​​We are working on C# HCI demos while waiting on donations and WinAll marketing. This is a c# example using latest Leap SDK to begin with LeapCSharpExmaple and we just need to add a C# 3D module and our own fast typing module. 

We may also refer to relevant C# examples to render virtual inputs silhouettes on top of and send input events to Windows UI. Again, we only need sufficient donations and business partnerships instead of becoming top leader of tech giants. Our business shall remain private and independent for robust and efficient executions. We get fundings from donations, US Sovereign Wealth Fund, competitive businesses' stock shares, etc. and use them to market/develop WinAll and terminate, confiscate, swallow, or depopulate super rats and punish robbing others, etc. and will closely partner with most competitive businesses. Cooperating businesses will both donate and partner with our business directly at the top levels, including appropriate leadership changes, with relevant agreements. ​

With WinAll, we did gain great mobility and freedom for work and play. I contacted Phil Spencer to market and develop WinAll together with his platforms/divisions reaching 500 million people monthly. He shall lead as real Microsoft CEO now and officially soon to request other top executives including Windows division ones to do the same and reach a lot more people/businesses efficiently.  ​​​​I'm roughly done with my virtual inputs app, which draws keys around extended fingertip(s), and quickly detects the 3-axis hand movement/rotation based on speed/velocity/data for key presses, with more optimizations and features added later. With WinAll, our future offices may include chair bed or hammock, or may be mobile indoor/outdoor ones everywhere, for us to better enjoy diverse places/experiences/lives. I also contacted Microsoft alumni for filing lawsuits killing super rats and easily win all together.

As our hands face cameras, we may draw a virtual keyboard below hands for reference and extend a finger then rotate hand relatively around wrist to certain angle range or move relatively to certain range in one direction like up down as a key press, with assigned keys highlighted, and move index or pinky fingers with more assigned keys further apart to press keys further away, as another efficient way of virtual typing. ​​It's more robust and convenient to activate the column of keys assigned to a finger by extending all other fingers except for the typing one. Image key textures will be used later. I attached some screenshots for reference. The index or pinky fingertip just has to bend down more to activate the other column. The activated column of keys is highlighted and hovered keys while hand is moving up down are marked, and a key is pressed when hovered above a time threshold. Current Leap Motion SDK seems lack of previous features such as tap/gesture detections. Microsoft may want to acquire it, just like that it also makes keyboard/mouse products.​

I leveraged extended display mode to capture the primary display as background of my app launched with PowerToys on 2nd XR display and send inputs there with InputSimulator package, much better than vnc one already. The two tasks turn out to be pretty simple ones with snapshot uploaded. I have removed VR vnc client app from online shop. Android/iOS are top cancers/tumors again and can't run full desktop Linux at all, just like that pests can't fake humans except for unconditional deaths first. 2D only hand tracking is garbage, while 3D one can do all: keyboard, mouse, multitouch, and 3D inputs. My Windows Virtual Inputs app will be added to online shop soon. ​​I also easily added the virtual mouse module activated with only the first 3 fingers extended. Mouse movement follows index fingertip position. The short finger bending triggers single click, while long one triggers double click. The less bending of index finger triggers up scrolls, while more triggers down scrolls. And the multi-touch swipe and zooming module is activated by extending all fingers and moving hand left/right, up/down, or forward/backward for swiping left/right, up/down, or zooming in/out. The pics are attached for reference. 

I further easily integrated multiple virtual monitors with convenient inputs focus switches, more useful in case of head/hand inputs, using virtual display driver as attached, while single display w/o virtual desktops are quite enough. Appealing 3D hands interactions are more demanding physical simulations, like gas, water, fire, sand, etc. Leap Motion can also be used for 6DoF head tracking and eye tracking with CV. They all require general purpose computing power too. I'm adding the head, eye, spatial tracking, and 3D inputs as hobbies or optional components. We may need better sensors/device for them. Now I'm just waiting on the WinAll deal to happen and automatically win all.​​ I got some partial results for head tracking as attached. We can further train the models for the cases we wear different XR glasses and cameras are placed below the head with some image processing and data filtering to get the robust head poses. Eye marks are included in face marks already, with only gaze direction and blink detection to be processed. Stereo images generate 3D object point clouds. With good camera/sensing devices, hand/head/eye/spatial tracking can all be easily integrated. 

Those camera sensors and features are already integrated in Microsoft HoloLens, Meta Orion AR, HMDs, China XVisio, Intel RealSense, etc. Smartphones have front/back cameras. Sign language inputs need them too. Now we just need to pack those better cameras/sensors into smart neckwear with front ones for face/head/eye and upper body tracking and back ones for hand/spatial/lower body tracking or omnidirectional tracking. Partial eye and object tracking results are also attached. Perhaps a leap motion with a mini camera and occasionally RealSense can largely do the jobs for now. These smart neckwears also work with tons of small Windows gaming handhelds or tablets without additional changes by including many phone sensors/features. ​

I'm wrapping up my virtual inputs app and focusing on making virtual keyboard, mouse, multi-touch, and multiple monitors work seamlessly together to maximize productivity/performance and also help with WinAll marketing. I'll continue head/hand/spatial tracking work when free or better device available. Right now, we just need solid business partners to fund and market WinAll on our platforms first or reach that marketing threshold, then Microsoft will sign WinAll deals and bad quality competitors will die/lose automatically. Some people perhaps forget how they used to compete due to bad impacts of past destructive cancerous decade. Now those who can compete in normal healthy ways or recover first can succeed first. Let us do real businesses to easily win all together!    

I added two more XR and mini PC videos in the Doc & Media section, one is 9 XR Glasses comparison, another is a foldable keyboard gaming PC. With phone features integrated in PC or smart neckwear, we have everything. There are many varieties of XR glasses on the market. The mini-PC ad (https://b23.tv/ACfkh0k) from 1:47min is funny. BestBuy as major tech physical retailer is also selling Viture XR glasses now. XR glasses ads are coming to my Facebook feeds. Now we need relevant businesses/people to fund and market WinAll directly with me as innovation owner and healthy normal business practice , followed by more others to automatically naturally achieve our goals. All XR glasses will be used for general purpose computing/gaming, niche smart glasses will be replaced by general purpose XR glasses and smart neckwear, so will VR HMDs and gaming consoles, or WinAll will replace those special purpose/niche devices as mentioned.

Relevant vendors shall stop wasting resources on dead products. For instance, Meta's Aria 2 AR glasses shall be neck based and include phone features. We don't need cameras mounted on glasses to figure out head position/pose. We will use Windows IoT on those XR glasses and smart neckwears. Smartwatch and hand/spatial trackers on the neck can replace smartphone and keyboard and realize XR features for tons of portable PCs for now. Wireless and other physical retailers may follow BestBuy/etc. to at least market XR glasses for PCs now.  PC vendors shall sell their products along with XR glasses and smartwatches with AsteroidOS, sim, wifi, camera, power bank, etc. to easily replace Google/Apple devices. I recently lost my XR glasses cable and easily got a replacement from Amazon (https://shorturl.at/QRLKK). I also ordered simple testing kiddo smartwatch and SLAM device. Tech industry is so crowded that seems you can easily deliver coolest tech product if you can dream it. 

Here're other smart wear OS/hardware vendor/source for reference. While existing good smartwatches can replace smartphones (https://hesckj.com/, https://shorturl.at/zxIqn), future ones may be bigger like 3- inch vision focused with better horizontal back and front cameras for various XR tracking/inputs, connected to XR display, and easily neck mounted as single device. Politics to me is like dirty wasteful trivial decorations while tech/economy innovations can solve most issues efficiently. ​​I contacted Hololens, xvisiotech, hsckj for smart neckwear device customization to fit in WinAll future products. Microsoft is underperforming Apple and can't stop crisis while with simply our WinAll deals and existing WinAll products, it can already defeat others. Apple and Trump/Musk/Meta already offered some help that I didn't take because they can't really address the issues. I will go with Apple if Micrsoft isn't an option though. The bottlenecks are apparently both Trump Admin and Microsoft original leaders who can't even Win All with me as normal healthy business practices and sustained crisis till now. ​​​​​