Barco v. Vivitek - Complaint

Case 3:19-cv-03250 Document 1 Filed 06/10/19 Page 1 of 16
Caitlin Comstock Blanche (SBN 254109)

1 caitlin.banche@klgates.com
K&L GATES LLP
2 One Park Plaza 12th Floor
Irvine, CA 92614
3 Tel: (949) 253-0900
Fax: (949) 253-0902
4
Attorneys for Plaintiffs Barco NV and Barco, Inc.
5
8 UNITED STATES DISTRICT COURT FOR THE
9 NORTHERN DISTRICT OF CALIFORNIA

10
11 BARCO NV and BARCO, INC. Civil Action No.
12 Plaintiffs, Judge:
13 v. ORIGINAL COMPLAINT FOR PATENT

INFRINGEMENT OF U.S. PATENT NOS.
14
VIVITEK CORPORATION and DELTA 8,756,348, 9,083,769 AND D699,241
15 ELECTRONICS, INC.
JURY TRIAL DEMANDED
16 Defendants
17
18 Plaintiffs Barco NV and Barco, Inc., collectively doing business as Barco (“Plaintiffs” or
19 “Barco”) by and through their undersigned counsel, file this Original Complaint for Patent
20 Infringement against Defendants Vivitek Corporation and Delta Electronics, Inc. and allege on
21 knowledge as to their actions, and upon knowledge and information and belief as to the actions of
22 others, as follows:
23 NATURE OF THE ACTION
24 1. This action arises under the patent laws of the United States, 35 U.S.C. §§ 1, et seq.,
25 from Defendants’ infringement of U.S. Patent No. 8,756,348; U.S. Patent No. 9,083,769, and U.S.
26 Patent No. D699,241 (collectively, the “Patents-in-Suit”)
27 2. Barco seeks injunctive relief as well as damages.
28 ///
-1- COMPLAINT FOR INFRINGEMENT OF PATENT
303436699 v1
1 THE PARTIES
2 3. Plaintiff Barco NV is a foreign company incorporated under the laws of Belgium with
3 its principal operating business located at Beneluxpark 21, BE-8500 Kortrijk, Belgium.
4 4. Plaintiff Barco, Inc. is a company incorporated under the laws of Delaware, and has a
5 principal place of business at 421 McCarthy Blvd, Milpitas, CA 95035.
6 5. Defendant Vivitek Corporation (“Vivitek”) is a company incorporated under the laws
7 of California. Upon information and belief, Vivitek has a principal place of business at 46101
8 Fremont Blvd, Fremont, California 94538. Vivitek may be served through its registered agent for
9 service, CT Corporation System, 818 West Seventh Street, Suite 930, Los Angeles CA 90017.
10 6. On information and belief, Defendant Delta Electronics, Inc. (“Delta Electronics”) is
11 a Taiwanese corporation with its principal place of business at 186 Ruey Kuang Rd., Neihu, Taipei
12 11491, Taiwan, R.O.C.. Delta Electronics can be served with process pursuant to the California
13 Long Arm Statute, Cal. Code Civ. Proc § 410.10.
14 7. Vivitek manufactures, imports, offers for sale, and sells wireless presentation tools to
15 resellers, distributors, and consumers throughout the United States, including in this District.
16 8. Vivitek is an agent and alter-ego of Delta Electronics in that it is controlled and
17 dominated by Delta Electronics and is a wholly-owned subsidiary of Delta Electronics. Specifically,
18 Vivitek is described “as a brand of Delta” on websites that can be visited by customers in the United
19 States:
20 ~ • C i https://www.vivit ekusa .com/productdetail/LauncherPlus/
21
vivitek· Abrandor A =
22 Products v Solutions v Programs ..,
23 Home I Products / ProJector
24
25
LauncherPlus
26
27 See https://www.vivitekusa.com/productdetail/LauncherPlus/
28 ///
303436699 v1
1 JURISDICTION AND VENUE

2 9. Subject matter jurisdiction is proper in this Court under 28 U.S.C. §§ 1331 and
3 1338(a) because the claims arise under the patent laws of the United States, 35 U.S.C. § 1 et seq.
4 10. This Court has personal jurisdiction over Vivitek insofar as it is incorporated in this
5 District, and maintains a regular and established place of business at 46101 Fremont Boulevard,
6 Fremont, California 94538, located in this District.
7 11. As to Vivitek, venue is proper in this Judicial District under 28 U.S.C. § 1400(b)
8 because Vivitek is incorporated in California, and has a regular and established place of business at
9 46101 Fremont Boulevard, Fremont, California 94538, located in this District.
10 12. This Court has personal jurisdiction over Delta Electronics because, directly or
11 through intermediaries including its wholly-owned subsidiary Vivitek, it has committed acts in this
12 District that give rise to this action, or otherwise has established minimum contacts with this District
13 such that the exercise of personal jurisdiction over Delta Electronics would not offend traditional
14 notions of fair play and justice.
15 13. For example, Delta Electronics has placed and is continuing to place infringing
16 products into the stream of commerce via an established distribution channel that includes Vivitek,
17 with the knowledge and understanding that such products are being and will continue to be sold in
18 the State of California, including in this District. For at least the reasons set out in paragraph 8,
19 Delta Electronics has held itself out as controlling and directing Vivitek’s activities, including the
20 acts of infringement set out herein.
21 14. In addition, on information and belief, Delta Electronics also operates directly in the
22 United States through its wholly-owned subsidiary Delta Electronics (Americas) Ltd., (“DEA”) a
23 California corporation that it controls and which acts as its agent in the United States. Upon
24 information and belief, DEA shares the same principal place of business as Vivitek, namely 46101
25 Fremont Boulevard, Fremont, California 94538, located in this District.
26 15. As to Delta Electronics, venue is proper in this District pursuant to 28 U.S.C. §
27 1391(b) and (c) and 28 U.S.C. § 1400 because: (i) Delta Electronics does business in this District,
28 directly or through intermediaries; (ii) at least a portion of the acts of infringement described herein
303436699 v1
1 occurred in this District; (iii) Delta Electronics regularly solicits business, engages in other persistent
2 courses of conduct, or derives revenue from goods and services provided to individuals in this
3 District.
4 BARCO AND ITS INNOVATIONS
5 16. Barco is a leading global technology company known for its high-quality presentation
6 tools, screens, monitors, video walls, projectors, LED screens and streaming devices.
7 17. Barco develops networked visualization solutions for the entertainment, enterprise
8 and healthcare markets. Barco’s solutions help people to enjoy compelling entertainment
9 experiences; its products foster knowledge sharing and smart decision-making in organizations.
10 18. Barco has expended tremendous resources developing wireless presentation
11 technology. Barco’s ClickShare product is a revolutionary wireless presentation and collaboration
12 tool that enables meeting participants to easily display and share the information on their laptop on a
13 main presentation screen in a meeting room or conference center, without cables, set-up, or delay.
14 19. As a result of its innovative wireless technology, seamless operation, and smart
15 design, Barco’s ClickShare product has become the top choice for organizations seeking to share
16 ideas and build knowledge bases.
17 20. The ClickShare tool has won numerous industry awards, received consistently
18 favorable press, and enjoyed considerable commercial success.
19 21. A strong portfolio of patents, which includes each of the Patents-in-Suit, protect
20 Barco’s investment in its innovative wireless presentation tools.
21 THE PATENTS-IN-SUIT
22 22. On June 17, 2014, the U.S. Patent and Trademark Office issued U.S. Patent No.
23 8,756,348 (“the ’348 Patent”), titled “Electronic Tool and Methods for Meetings,” and with a
24 claimed priority date of September 14, 2011. A true and correct copy of the ’348 Patent is attached
25 at Exhibit 1.
26 23. The ’348 Patent is presumed valid under 35 U.S.C. § 282(a).
27 24. Barco NV is the owner and assignee of all substantial rights, title, and interest in the
28 ’348 Patent.
303436699 v1
1 25. On July 14, 2015, the U.S. Patent and Trademark Office issued U.S. Patent No.
2 9,083,769 (“the ’769 Patent”), titled “Electronic Tool and Methods for Meetings,” and with a
3 claimed priority date of September 14, 2011. A true and correct copy of the ’769 Patent is attached
4 at Exhibit 2.
5 26. The ’769 Patent is presumed valid under 35 U.S.C. § 282(a).
7 ’769 Patent.
8 28. On February 9, 2018, an anonymous third party requested reexamination of the ’348
9 Patent and the ’769 Patent by the U.S. Patent Office.
10 29. On March 15, 2019, the U.S. Patent Office issued a Reexamination Certificate with
11 respect to the ’769 Patent, confirming that Claim 1 and 7 were as patentable as amended over the
12 prior art. See Exhibit 3. Claims 2-6, 8-10, and 13-22, dependent on an amended claim, were also
13 determined to be patentable. Id. Additionally, new claims 23-25 were added and determined to be
14 patentable. Id.
15 30. On May 24, 2019, the U.S. Patent Office issued a Reexamination Certificate with
16 respect to the ’348 Patent, confirming that Claims 1, 2, 4, 5, and 10-20 were as patentable as
17 amended over the prior art. See Exhibit 4. Additionally, new claims 21-26 were added and
18 determined to be patentable. Id.
19 31. The ’769 Patent and the ’348 Patent share a common specification. The ’769 Patent
20 and the ’348 Patent claim and disclose an electronic meeting tool and method for communicating
21 arbitrary media content from users at a meeting. The invention comprises a node configuration
22 means that receives user selected arbitrary media content adapted to control and operate the display
23 of the user selected arbitrary media content via a display node coupled to a display.
24 32. The ’769 Patent and the ’348 Patent describe the explosion of electronic
25 communication tools designed to assist groups of persons to communicate with each other to
26 collaborate, problem-solve, negotiate, teach, and learn at the time of the invention. (See, e.g., ’769
27 Patent at 1:25-39).
28 ///
303436699 v1
1 33. However, those electronic communications tools were often poorly designed or
2 cumbersome, not least because of the complexity of the networking infrastructure, and firewalls and
3 other security measures that restricted the use of peripheral devices communicating across a
4 network. (See, e.g., ’769 Patent at 4:38-59). Thus, even though inexperienced users necessarily
5 needed to utilize the technology, the tools themselves demanded a high level of technical expertise.
6 Id. In turn, that led to lower productivity, lack of participation, and delay. Id.
7 34. The ’769 Patent and the ’348 Patent disclose an invention that overcomes these
8 problems. One aspect of the invention describes an electronic meeting tool for communicating
9 arbitrary media content from users at a meeting comprising: a node configuration means adapted to
10 operate a display node of a communications network, the display node being coupled to a first
11 display, the node configuration means being adapted to receive user selected arbitrary media content
12 and to control display of the user selected arbitrary media content on the first display; and at least
13 one peripheral device adapted to communicate the user selected arbitrary media content via the
14 communications network, wherein the peripheral device is a connection unit comprising: (a) a
15 connector adapted to couple to a port of a processing device having a second display, a memory and
16 an operating system: and (b) a transmitter for communicating with the communications network, a
17 program adapted to be loaded onto the processing device and to run on the operating system of the
18 processing device, said program being adapted to obtain user selected arbitrary media content, said
19 program leaving a zero footprint on termination, and an input device to allow the user to carry out a
20 user action that triggers transfer of said user selected arbitrary media content to said transmitter
21 through said port. (See ’769 Patent at 5:3-27).
22 35. The following shows one version of the Barco ClickShare tool, which is an
23 embodiment of a peripheral device in accordance with the invention of the ’769 Patent and the ’348
24 Patent:
25 ///
26 ///
27 ///
28 ///
303436699 v1
1
Internal WiFi antenna's
2 transceiver
Base ------ti-
Actuator and
Button input dev ice
3
internal mass storage
4 Vi sual
indicator
dev ice storing portable
application
5 .,_ Flexible con nect ion for data

signals and power
7 USB device interface
9 See, e.g., ’769 Patent, Fig. 10; see also id. 14:1-2 and 17:6-7.
10 36. On February 11, 2014, the U.S. Patent and Trademark Office issued design patent
11 U.S. Patent No. D699,241 titled “Peripheral Device for Computers” (“the D’241 Patent”). A true
12 and correct copy of the D’241 Patent is attached at Exhibit 5.
13 37. The D’241 Patent is presumed valid under 35 U.S.C. § 282(a).
15 D’241 Patent.
16 39. The D’241 Patent claims an ornamental design for peripheral device for computers,
17 and includes exemplary Figure 6 as shown below:
18
19
20
21
22
23
24
25
26
27
28 See, e.g., D’241 Patent, Fig. 6.

303436699 v1
1 DEFENDANTS’ INFRINGING ACTIVITY

2 40. Defendants have entered the wireless presentation tool market, including the market
3 for wireless presentation tools in the United States.
4 41. However, rather than develop their own technology, Defendants have copied Barco’s
5 patented technology, and have incorporated Barco’s patented technology into their wireless
6 presentation tools. Defendants thus unfairly compete with Barco in the marketplace by offering for
7 sale and selling these infringing products throughout the United States, including in California.
8 42. Defendants have sold infringing products to customers throughout the United States
9 and in this District, including to Barco’s own customers. Defendants have sold or offered for sale
10 infringing products to certain distributors who comprise an important part of Barco’s own supply
11 chain. Defendants have also participated in many of the same industry events and trade shows as
12 Barco, demonstrating and marketing their infringing products alongside Barco’s ClickShare and
13 other wireless presentation products.
14 43. As a result of these infringing activities, Defendants have caused direct injury to
15 Barco throughout the United States.
16 THE ACCUSED PRODUCT
17 44. Defendants make, use (including by testing), sell, offer for sale within the United
18 States, and import into the United States, a variety of wireless presentation tools.
19 45. One wireless presentation tool that Defendants make, use (including by testing), sell,
20 offer for sale within the United States, and import into the United States, is the LauncherPlus (the
21 “Accused Product”).
22 46. The Accused Product is described as a “plug-and-play” device, which “allows users
23 to “establish a direct, ad-hoc wireless connection to their NovoEnterprise unit, without impacting the
24 security of their corporate network,” and which “features five physical buttons that grant users the
25 ability to intuitively control their projection at will, without having to run any software on their
26 device.” (See www.vivitekusa.com/productdetail/LauncherPlus/).
27 47. An image of the LauncherPlus is below:
28 ///
303436699 v1
10 See id. (rotated from original).
11 48. On or about April 2017, Barco communicated to Defendants its belief that
12 Defendants’ wireless presentation products infringed Barco’s intellectual property, citing specific
13 Barco patents (including the ’348 Patent) in both the United States and Europe for Defendants’
14 review and investigation.
15 49. Defendants had continued exposure to Barco’s wireless presentation technology
16 during 2017 and 2018 through both parties’ continued market presence and participation in industry
17 events and trade shows worldwide.
18 50. Barco also continued to communicate directly with Defendants about Barco’s
19 concerns surrounding the potential infringing activity, including Defendants’ manufacture, use,
20 marketing, and sale of the Accused Product.
21 51. Defendants are well aware of Barco and Barco’s intellectual property rights embodied
22 in the ClickShare technology. Barco NV has already been forced to seek relief from a Dutch court
23 in The Hague, Netherlands, in connection with Delta Electronics’ infringing acts in offering for sale
24 and selling the Accused Product without license or authorization in Europe.
25 52. Faced with Defendants’ refusal to cease their infringing activities in the United
26 States, Barco has been forced to file this suit to seek this Court’s protection of its valuable
27 intellectual property rights.
28 ///
303436699 v1
1 COUNT I: DEFENDANTS’ INFRINGEMENT OF THE ’348 PATENT

2 53. Barco incorporates by reference each of its allegations in the foregoing paragraphs as
3 though set forth fully herein.
4 54. As shown in Exhibit 6, by making, using (at least by testing), selling, offering for
5 sale, or importing the Accused Product in this Judicial District and throughout the United States
6 without license or authorization, Defendants are now and have been directly infringing at least claim
7 1 of the ’348 Patent, either literally or under the doctrine of equivalents, as proscribed by 35 U.S.C.
8 § 271, et seq.
9 55. Exhibit 6 is intended solely to satisfy the notice requirements of Federal Rule of Civil
10 Procedure 8(a)(2), and does not represent Barco’s preliminary or final infringement contentions or
11 preliminary or final claim construction positions. Barco reserves the right to modify its infringement
12 theories reflected in Exhibit 6 as discovery progresses in this case, including through contentions
13 disclosures and claim construction in accordance with the Patent Local Rules in this District.
14 56. As a direct and proximate result of Defendants’ direct infringement of the ’348
15 Patent, Barco has been and continues to be damaged. Defendants’ infringing activities will continue
16 unless enjoined by this Court or until the patent expires, whichever is sooner.
17 57. Since at least April 2017, Delta Electronics has known that the Accused Products
18 directly infringe one or more claims of the ’348 Patent. Because Vivitek is an alter ego of Delta
19 Electronics in the United States, such knowledge can additionally be imputed to Vivitek.
20 58. Defendants have additionally indirectly infringed and continue to indirectly infringe
21 at least claim 1 of the ’348 Patent by actively inducing their customers and users of the Accused
22 Product or functionally equivalent products by, among other things, providing the Accused Products
23 to users along with instructions on how to use the Accused Product in a manner that Defendants
24 knew would directly infringe each element of at least claim 1 of the ’769 Patent.
25 59. Defendants have engaged and will continue to engage in such inducement having
26 actual knowledge of the ’348 Patent since at least April 2017. Furthermore, Defendants knew or
27 should have known that their actions would and will continue to induce direct infringement by the
28 ///
- 10 - COMPLAINT FOR INFRINGEMENT OF PATENT
303436699 v1
1 users of the Accused Products or functionally equivalent products, and have intended and will
2 continue to intend that their actions would induce direct infringement by such users.
3 60. As a direct and proximate result of Defendants’ indirect infringement by inducement
4 of the ’348 Patent, Barco has been and continues to be damaged. Defendants’ infringing activities
5 will continue unless enjoined by this Court or until the patent expires, whichever is sooner.
6 61. By engaging in the conduct described herein, Defendants have injured Barco and are
7 thus liable for infringement of the ’348 Patent, pursuant to 35 U.S.C. § 271.
8 62. Defendants have committed these acts of infringement without license or
9 authorization.
10 63. Defendants have committed these acts of infringement with actual knowledge of the
11 ’769 Patent since at least April 2017, and thus have acted recklessly and willfully with regard to
12 Barco’s rights in the ’348 Patent.
13 64. As a result of Defendants’ willful infringement of the ’348 Patent, Barco has suffered
14 monetary damages and is entitled to a monetary judgment in an amount at least adequate to
15 compensate for Defendants’ infringement.
16 65. Barco will continue to suffer damages in the future unless this Court enjoins
17 Defendants’ infringing activities or the patent expires, whichever is sooner. As such, Barco is
18 entitled to compensation for any continuing and/or future infringement up until the date that
19 Defendants are finally and permanently enjoined from further infringement or the patent expires,
20 whichever is sooner.
21 COUNT II: DEFENDANTS’ INFRINGEMENT OF THE ’769 PATENT
24 67. As shown in Exhibit 7, by making, using (at least by testing), selling, offering for
25 sale, or importing the Accused Product in this Judicial District and throughout the United States
26 without license or authorization, Defendants are now and have been directly infringing at least claim
27 1 of the ’769 Patent, either literally or under the doctrine of equivalents, as proscribed by 35 U.S.C.
28 § 271, et seq.
303436699 v1
1 68. Exhibit 7 is intended solely to satisfy the notice requirements of Federal Rule of Civil
2 Procedure 8(a)(2), and does not represent Barco’s preliminary or final infringement contentions or
3 preliminary or final claim construction positions. Barco reserves the right to modify its infringement
4 theories reflected in Exhibit 7 as discovery progresses in this case, including through contentions
5 disclosures and claim construction in accordance with the Patent Local Rules in this District.
6 69. As a direct and proximate result of Defendants’ direct infringement of the ’769
7 Patent, Barco has been and continues to be damaged. Defendants’ infringing activities will continue
8 unless enjoined by this Court or until the patent expires, whichever is sooner.
9 70. Since at least June 2018, Delta Electronics has known that the Accused Products
10 directly infringe one or more claims of the ’769 Patent. Because Vivitek is an alter ego of Delta
11 Electronics in the United States, such knowledge can additionally be imputed to Vivitek.
12 71. Defendants have additionally indirectly infringed and continue to indirectly infringe
13 at least claim 1 of the ’769 Patent by actively inducing their customers and users of the Accused
14 Product or functionally equivalent products by, among other things, providing the Accused Products
15 to users along with instructions on how to use the Accused Product in a manner that Defendants
16 knew would directly infringe each element of at least Claim 1 of the ’769 Patent.
17 72. Defendants have engaged and will continue to engage in such inducement having
18 actual knowledge of the ’769 Patent since at least June 2018. Furthermore, Defendants knew or
19 should have known that their actions would and will continue to induce direct infringement by the
20 users of the Accused Products or functionally equivalent products, and have intended and will
21 continue to intend that their actions would induce direct infringement by such users.
22 73. As a direct and proximate result of Defendants’ indirect infringement by inducement
23 of the ’769 Patent, Barco has been and continues to be damaged. Defendants’ infringing activities
24 will continue unless enjoined by this Court or until the patent expires, whichever is sooner.
25 74. By engaging in the conduct described herein, Defendants have injured Barco and are
26 thus liable for infringement of the ’769 Patent, pursuant to 35 U.S.C. § 271.
27 75. Defendants have committed these acts of infringement without license or
28 authorization.
303436699 v1
1 76. Defendants have committed these acts of infringement with actual knowledge of the
2 ’769 Patent since at least June 2018, and thus have acted recklessly and willfully with regard to
3 Barco’s rights in the ’769 Patent.
4 77. As a result of Defendants’ willful infringement of the ’769 Patent, Barco has suffered
5 monetary damages and is entitled to a monetary judgment in an amount at least adequate to
6 compensate for Defendants’ infringement.
12 COUNT III: DEFENDANTS’ INFRINGEMENT OF THE D’241 PATENT
15 80. By selling, offering for sale, distributing, and advertising the Accused Product in this
16 Judicial District and throughout the United States without license or authorization, Defendants are
17 now and have been directly infringing the D’241 Patent, either literally or under the doctrine of
18 equivalents.
19 81. A side-by-side comparison, shown below, demonstrates how the Accused Product
20 (left) misappropriates Barco’s patented design (right):
21 Accused Product Barco D’241 Patented Design
22
23
24
25
26
27
28
303436699 v1
1 82. The images above are demonstrative of the similarities between the Accused Product
2 and Barco’s protected design. Both feature a square-shaped body with an elongated USB cable. The
3 square body has rounded corners, and the USB cable is affixed by a rounded connection point to the
4 body. The body features a single large circular clicker button, which takes up the predominant
5 surface of the square body. The entire apparatus in both instances is designed to fit in the palm of a
6 user and be operated single-handedly.
7 83. The design of the Accused Product is substantially the same as the design embodied
8 in the D’241 Patent such as to deceive and induce an ordinary observer to purchase the Accused
9 Product supposing the same to be Barco’s innovative ClickShare product.
10 84. Defendants’ conduct in selling, offering for sale, distributing and advertising the
11 Infringing Products directly infringes the D’241 Patent, and Defendants have committed these acts
12 of infringement without license or authorization.
13 85. Defendants are thus liable for infringement of the D’241 Patent, pursuant to 35
14 U.S.C. § 271.
15 86. As a direct and proximate result of infringement of the D’241 Patent, Barco has
16 suffered monetary damages and is entitled to a monetary judgment in an amount at least adequate to
17 compensate for Defendants’ infringement, as well as Defendants’ total profits under 35 U.S.C. §
18 2819.
24 ///
25 ///
26 ///
27 ///
28 ///
303436699 v1
1 PRAYER FOR RELIEF

2 WHEREFORE, Barco prays for the following relief:
3 A. Defendants be adjudged to have infringed the Patents-in-Suit directly and by way of induced
4 infringement, either literally or under the doctrine of equivalents;
5 B. That Defendants, and each of their officers, directors, agents, servants, employees, attorneys,
6 affiliates, divisions, branches, parents, and those persons in active concert or participation
7 with any of them, be preliminarily and permanently restrained and enjoined from directly or
8 indirectly infringing the Patents-in-Suit;
9 C. An award of damages pursuant to 35 U.S.C. § 284 sufficient to compensate Barco for
10 Defendants’ past infringement and any continuing or future infringement up until the date
11 that Defendants are finally and permanently enjoined from further infringement or the patents
12 expire, whichever is sooner, including compensatory damages;
13 D. An additional award of total profits pursuant to 35 U.S.C. § 289 for Defendants’ past
14 infringement and any continuing or future infringement of the D’241 Patent, up until the date
15 that Defendants are finally and permanently enjoined from further infringement or the patents
16 expire, whichever is sooner,
17 E. An assessment of pre-judgment and post-judgment interest and costs against Defendants,
18 together with an award of such interest and costs, in accordance with 35 U.S.C. § 284;
19 F. That Defendants be directed to pay enhanced damages under 35 U.S.C. § 284 and Barco’s
20 attorneys’ fees incurred in connection with this lawsuit pursuant to 35 U.S.C. § 285; and
21 G. Such other and further relief as this Court may deem just and proper.
22 Dated: June 10, 2019 Respectfully submitted,
23 K&L Gates LLP
24 /s/ Caitlin Blanche
One Park Plaza 12th Floor
26 Irvine, CA 92614
Tel: (949) 253-0900
27 Fax: (949) 253-0902
28 Attorneys for Plaintiffs Barco NV and Barco, Inc.
303436699 v1
1 JURY DEMAND
2 Pursuant to Federal Rule of Civil Procedure 38(b), Barco hereby demands a trial by jury on
3 all issues triable of right by a jury.
4 Dated: June 10, 2019 Respectfully submitted,
5 K&L Gates LLP
6 /s/ Caitlin Blanche
One Park Plaza 12th Floor
8 Irvine, CA 92614
Tel: (949) 253-0900
9 Fax: (949) 253-0902
10 Attorneys for Plaintiffs Barco NV and Barco, Inc.
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
303436699 v1
Case 3:19-cv-03250 Document 1-1 Filed 06/10/19 Page 1 of 22
Exhibit 1
I 1111111111111111 11111 1111111111 11111 111111111111111 IIIII IIIIII IIII IIII IIII
US008756348B2
c12) United States Patent (IO) Patent No.: US 8,756,348 B2

Beel et al. (45) Date of Patent: Jun.17,2014
(54) ELECTRONIC TOOL AND METHODS FOR 2005/0036509 Al 2/2005 Acharya et al.
MEETINGS 2006/0031779 Al 2/2006 Theurer et al.
2006/0095376 Al 5/2006 Mitchell et al.
2007/0005809 Al 1/2007 Kobayashi et al.
(75) Inventors: Koen Simon Herman Beel, Lochristi 2007/0244970 Al 10/2007 Watanabe et al.
(BE); Yoav Nir, Rekkem (BE); Filip 2009/0046139 Al 2/2009 Cutler et al.
Josephine Johan Louwet, Knesselare 2009/0198839 Al 8/2009 Banerjee et al.
(BE); Guy Coen, Aalst (BE) 2010/0087139 Al 4/2010 Glass
(Continued)
(73) Assignee: Barco N.V., Belgie (BE)
FOREIGN PATENT DOCUMENTS
( *) Notice: Subject to any disclaimer, the term ofthis
patent is extended or adjusted under 35 EP 1 187 480 Al 3/2002
U.S.C. 154(b) by 92 days. EP 1 246 395 Al 10/2002
WO 00/52887 Al 9/2000
(21) Appl. No.: 13/270,659 OTHER PUBLICATIONS
(22) Filed: Oct. 11, 2011 Examination Report of German Patent and Trademark Office regard-
ing related German Patent Application 10 2011 055 443.2, May 30,
(65) Prior Publication Data 2012.
US 2013/0067121 Al Mar. 14, 2013 (Continued)
Related U.S. Application Data Primary Examiner - Scott Sun

(60) Provisional application No. 61/534,592, filed on Sep. (74) Attorney, Agent, or Firm - Bacon & Thomas, PLLC
14, 2011.
(57) ABSTRACT
(51) Int. Cl. An electronic meeting tool for communicating arbitrary
G06F 13/38 (2006.01) media content from users at a meeting includes a node con-
G06F 3/00 (2006.01) figuration operating a display node of a communications net-
(52) U.S. Cl. work that is coupled to a display. The node configuration
USPC ............ 710/20; 710/2; 710/5; 710/8; 710/11; receives user selected arbitrary media content and controls
710/15 display of the user selected arbitrary media content on the
( 58) Field of Classification Search display. At least one peripheral device communicates the user
None selected arbitrary media content via the communications net-
See application file for complete search history. work. The peripheral device is a connection unit including a
connector that couples to a port of a processing device having
(56) References Cited a second display, a memory and an operating system; and a
transmitter communicating with the communications net-
U.S. PATENT DOCUMENTS work. A program is provided to run on the operating system of
6,966,035 Bl 11/2005 Suess et al.
the processing device and obtains user selected arbitrary
8,316,138 B2 11/2012 Chang media content, while leaving a zero footprint on termination.
2002/0196378 Al 12/2002 Slobodin et al.
2004/0263636 Al 12/2004 Cutler et al. 20 Claims, 5 Drawing Sheets
64
60
...._r-----.. Portable
application
Input
Device /
, . 48 / 62 Base node
Program
31 ........._
I
Client
I
/
4/
o;splay I
...._I'-- Processing - Connector~~
Unit Tran~~1tter ·· Base Node
Projector
Device
Visual - - 61
Indicator 63 36 44
US 8,756,348 B2
Page 2
(56) References Cited International Search Report in PCT/EP2012/068167, Mar. 19, 2013.
International Search Report in PCT/EP2012/068168, Mar. 4, 2013.
U.S. PATENT DOCUMENTS International Search Report in PCT/EP2012/068169, Jan. 28, 2013.
2010/0302130 Al 12/2010 Kikuchi et al. Search Report in GB1206841.7, Aug. 28, 2012.
2011/0115689 Al 5/2011 Sugiyama et al. Proc. 3rd International Conference on Ubiquitious Intelligence and
2012/0331509 Al* 12/2012 Laksono ......................... 725/56 Computing, Sep. 2006, pp. 688-697, Wenbing Jiang, et al.; "Free
2013/0050254 Al* 2/2013 Tran et al. ..................... 345/629 Speech: a novel wireless approach for conference projecting and
OTHER PUBLICATIONS cooperating".
International Search Report in PCT/EP2012/068166, Mar. 6,
2013. * cited by examiner
U.S. Patent Jun.17,2014 Sheet 1 of 5 US 8,756,348 B2
30
f
Camera
40_.
51
0.
"·
/1
I
I
I 37
3,8
L I Meeting Table
LMicr:~~onc (( \ \
···y·····[1~
50
44 45 52~
: i 36 49
: .--·- - - - - - - - - - - + - - - - - .
Display Whiteboard
t Fig. la
43
64
60 ....._:
''-----....._ Portable Input V 48 62 Base node
application Device / / Program
31 Client
I I
Connector
/
4/ Display/
-------- ---- ........
Processing e--
Unit
Tram,:itte0 ·-· .. Base Node
Projector
Device
Visual - ~ 61
Indicator 63 36 44
Fig. lh
C:Se:~l.,(Bi: s,h::;,.,.-.,;k::;j
trut~i::di:::::--.s
le, lh~: s:,,;!1,,:'f'
Fig. 2
-~--
,,____... VViFi
GUI 1 Base IJF
~ - - ~(20)
USH
......___ / Unit _...---.
HF
~ - - 13 Video
Butto'rr...- out
Base node
Soft~vare
-6 )I LED (~,J
Fig. 3
.. :r---:-
...., D --~~~~~......._
---------, ..___,
Dongle
\il)_f:1·F1·
,~
inte~rtace ( 3 J:
~ -...... 9
Butto~-
Porta b!e ,. , .
l ED (101 app!ieatinn , 7)/
---------1
Fig. 4
...-'-'-'-'~~~~~~"-'I· CF-'-'-'~~~~~~_,,
Computer
,,.. Run-time- exe-cution '\

1 context dient_safware ,:.:;\
\ {RAf;,11 ( ,:.;:< I
..... -- - - - ~· ~:~•~ - - - ___ .....
___ ...
Fig. 5
D
V:.:..J
Cs:r.,.,:::rs ; tr.:;'.·<.::R19
lm:t:~·;,;:ci:.i:J.n&
fG3" tr:£sy~tem
Fig. 6
,-----------~o· .----------.
. .... ... ,___,,
USBstick
Mass (
Storage , 8
Fig.7
WiFi
Client operating device t/F
J........._, I
IJSB
GUI ( 18) 1
',.___/ I UF
1/ Run-lime exerution ',

1 mnle~:t client ::,uftware ,. . . . . . ,
' iRA.M; (25)
.... -- - - - .:. _·-~ )- - - - __.-.______,-
Fig. 8
W'iFi
Client. op,erat.ing device llF
' - ·R- t· - - - ut•· - - -.. \

. un- tme exec inn
1
1 oontext d_ ient_ software,.--,.,
\ (:RAf:B 125 )
.... -- - - - : :..._"·~·--_ - - - ~...____...
___
Fig. 9
----=-- Internal WiFi antenna's

transceiver
Actuator and
Button input device

Visual
device storing portable
indicator
application
Flexible connection for data

signals and power
USB device interface
Fig. 10
US 8,756,348 B2
1 2
ELECTRONIC TOOL AND METHODS FOR line by which they can pace and measure their productivity
MEETINGS and that of their colleagues. Unfortunately, for many infor-
mation managers, being in perpetual meetings has reduced
RELATED APPLICATIONS their ability to prepare adequately for the next meeting, per-
5 petuating a vicious and negative cycle.
This benefit of provisional patent application No. 61/534, However, Marc Al-Hames et al. report in "Audio-Visual
592 filed Sep. 14, 2011 is claimed and said application is Processing in Meetings: Seven Questions and Current AMI
incorporated herein by reference. Answers", that although large parts of working days are con-
sumed by meetings and conferences, unfortunately a lot of
FIELD 10
them are neither efficient, nor especially successful. They
report a study in which people were asked to select emotion
The present invention relates to electronic tools for meet-
terms that they thought would be frequently experienced in a
ings including methods or devices for providing connection
meeting. The top answer-mentioned from more than two
to a communications network, to networks or methods of
third of the participants-was "boring"; furthermore nearly
operating the network, methods or devices for use in display- 15
ing media content as well as software for performing any of one third mentioned "annoyed" as a frequently perceived
these methods. emotion.
The conclusion is that despite the plethora of electronic
TECHNICAL BACKGROUND aids to meetings, fundamental problems in handling meetings
20 have not been solved. In fact organising and conducting meet-
Tools for Collaboration ings in a business context involves a large number of factors.
Participation
Allowing ad hoc groups of persons to communicate with A lack of efficiency of meetings is addressed in the article
each other is one of the fundamental aspects of collaboration, "Mood indicators on electronic meeting tools" IBM, IP.com
problem solving, negotiation, teaching and education, etc. To 25 number: IPCOM000011711D, Publication Date: Mar. 12,
assist in communication, there has been an explosion of elec- 2003. This article addresses the issue that the lack of direct
tronic communication tools such as electronic conferencing feedback makes meetings clumsy, inefficient and often
tools, e.g. synchronous and asynchronous conferencing, unproductive. It proposes a "mood indicator" as well as an "I
online chat, Instant Messaging, audio conferencing, video- want to ask a question" indicator which allow the presenter to
conferencing, data conferencing, application sharing, remote 30 choose an appropriate moment to pause, change track or field
desktop sharing, electronic meeting systems, collaborative a question. It is argued that interrupting a presenter in full flow
management (coordination) tools, project management sys- can be awkward; however, sometimes it is difficult to get an
tems, knowledge management systems, and social software opportunity to ask a question or make a comment when many
systems. different people are trying to make their voices heard. In a
One classic approach is the lecture or seminar often involv- 35 similar vein, U.S. Pat. No. 6,966,035 suggests displaying a
ing a presentation using presentation software. To a large "murmur frame" for a participant to express a view. To
extent the traditional single person presentation or lecture has increase user participation, US 2010/0087139 discloses a
been maintained with the audience being in a rather passive system for sending a selection to another computer, and US
mode as far as determining, constructing, augmenting or 2006/0095376 discloses a system for secure voting. Com-
modifying the information to be presented is concerned. 40 menting, voting or selecting requires that a central authority
As with other business processes, meetings are going digi- provides the information that is to be selected or commented
tal. Increasingly, people are using computer technology alone or voted on. Hence, these proposals still leave a central figure
and in conjunction with broadband networks to support their such as the presenter in a dominating position and the other
meeting objectives prior to and during an actual meeting. For members of the meeting are largely an audience with limited
example, e-mail is used to pass around files for people to read 45 selection or voting or participation rights.
prior to a meeting. A further problem with meetings is that someone is usually
Collaborative workspaces in corporate networks and on the late or has to leave early. With the person arriving late one has
Internet offer geographically distributed collaborators a vir- to decide if the meeting is interrupted and a summary of the
tual repository for documents related to a project or a meet- proceedings so faris given. For the person leaving early (often
ing. Electronic meeting support systems, such as interactive 50 a senior person), subsequent discussions can go missing. If
network-connect white boards and videoconferencing appli- there is a notes taker, this provides a personal summary of the
ances, are available for the benefit of those who share the meeting-but not an objective one.
same room as well as those who are in remote locations. Presents systems do not provide an optimal solution.
The AMIDA Final Public Report describes the overall Legal and Security Issues
methodology behind the development of meeting support 55 A legal requirement of a meeting is that presentations,
technologies. It reports that numerous studies confirm that comments and submissions need to be completely reproduc-
meetings dominate the way people work. Namely, according ible-in some circumstances, e.g. in a share holders' meet-
to a study conducted by MCI Worldcom in 2003 a business ing, the events in the meeting should be subject to total recall.
person participates in 60 meetings per month. People meet in Computer-supported collaborative work technologies, par-
groups for a multitude of reasons. They interact in numerous 60 ticularly those which capture human verbal and non-verbal
predictable and unpredictable ways and the results of their communications (audio and video interaction) in addition to
interactions are as varied as the people who participate and text and graphics generated during a meeting, promise to have
the projects on which they are collaborating or communicat- a long term impact on how people will prepare for and behave
ing. Studies of business processes also reveal that approxi- during and following meetings. In addition, connecting to a
mately 80% of the "workload" associated with a project or 65 network brings the danger of virus, malware or spyware trans-
process happens in preparation for a meeting. In other words, fer in either direction, and there is danger of copying of
many people view the "live" meeting as a milestone or dead- confidential information.
US 8,756,348 B2
3 4
Practical Difficulties play content of the computer. US 2009/0198839 discloses
Scalability and Ease of Use such a pluggable cable arrangement. US 2011/0115689 dis-
There are even more fundamental problems with using closes a similar USB solution for wireless connection to a
electronic tools in meetings. If two persons want to make two projector. Accordingly connecting a projector to a computer
presentations then usually either both presentations must be 5 using the standard USB port might become commonplace
placed on one machine or there is a need to swap between the with time. However, this usually requires special drivers and
presenters' machines. To bring the display content of a com- even special hardware. Connecting a projector to a computer
puter to a projector, the most common ways are to use a cable using the standard USB port hence might become common-
that connects the display adapter of the graphics card to the place-but even when that happens there will be a mix of new
and legacy machines for several years.
video input of the projector [method 1] or to use a software 10
Firewalls
that captures the display contents and sends it over a wired or
Additional problems can occur with firewalls. Typically a
wireless network to a remote base unit connected to the pro- visitor to a meeting will bring a computer such as a laptop that
jector [method 2]. This is often called "remote desktop" and is set up for a different corporate networking environment and
is mostly used for remote administration or remote IT assis- hence has different or incompatible networking settings. The
tance purposes. 15 setting up of a firewall can be complicated and if this is not
Less common but also practiced methods are to use a done correctly, telecommunication software that has to pass
special device connected to the display adapter of the graph- through a firewall may be blocked. In order to solve problems
ics card that captures, encodes and streams the display con- associated with firewalls it may be necessary to open ports or
tent over a wired or wireless network [method 3]. identify or even add programs in an exception list. If, besides
Method 1 has several practical problems and disadvan- 20 a network (hardware) firewall and an operating system fire-
tages. In meetings where people want to contribute content wall, there is any software based third-party firewall like
from their own computers, e.g. to project images on a display, Zonealarm, Norton Systemworks, CA Internet Security Suite
typically a video cable such as a VGA cable is used to connect or McAfee Firewall, then it is necessary to follow that soft-
each PC one at a time to the projector. This is not only not ware developer's documentation to place programs on a safe
scalable but also can be and often is quite a cumbersome 25 list or adding exceptions to the firewall rules. Such activity is
process that typically wastes valuable meeting time and takes beyond the usual user. Fussing with computer settings, or
the dynamism out of the meeting. Connection can be made having to call for IT support wastes valuable meeting time and
more difficult and time consuming for example if the com- takes the dynamism out of the meeting.
puter has to be rebooted for it to detect the projector or when Conclusion
the format of the PC differs from the format of the projector. 30 The following problems remain for holding a face-to-face
In addition changing format can leave the computer with a meeting using advanced electronic tools at the present time:
new format that is not compatible with its own screen so that Complexity of the networking infrastructure.
on reboot of the PC alone, nothing is displayed on the com- High demands on technical expertise of users in current
puter screen. Without a visible screen image the necessary systems that are supposed to be designed to support
re-configuration can be difficult. These issues are aggravated 35 everyday use by the non-expert user.
by a number of elements: Barriers to the use of complicated technology in meetings.
The use of many different video adapters, such as VGA, Great variety of possible collaborative software solu-
DVI, DP, HDMI, .... tions-none of which seems to solve the fundamental
Reach depends on cable length: too long leaves a tangled problems of holding successful meetings.
cable "salad" in the meeting room, too short reduces 40 Meetings being boring or annoying for members of the
flexibility, often necessitating people to move around in meeting.
the meeting room when they want to present something. Complexity of firewalls and other security measures
Cable connection is either point to point or requires tedious employed in corporate networks.
and extensive cabling and the use of complex and expen- Lack of, or restriction of participation by members of a
sive video switches. 45 meeting.
It is often difficult and time consuming to find the right Time taken to prepare presentations for meetings.
display resolution and refresh rate that both the com- Need to record events in the proper time sequence at meet-
puter and the display or projector support. ings without burdening a meeting more than necessary.
Method 2 also has many drawbacks. If the connection is Although some tools solve some of these problems effec-
made to a corporate LAN there is a danger of virus, malware 50 tively, no electronic meeting tool solves all of them.
or spyware transfer in either direction, there is danger of
copying of confidential information, and there is the difficulty SUMMARY OF THE INVENTION
of making the connection, e.g. entry of a user code and pass-
word, as well the administration of such passwords and user An object of the present invention is to provide network
codes. 55 solutions including electronic tools for meetings including
The advantage of method 3 is that the computer does not devices for providing connection to a communications net-
need to use its own processing power to bring the display work, to methods of operating the network, methods of dis-
content in a form that is easily transported over a network. playing media content as well as software for performing any
This advantage becomes less relevant as computers grow in of these methods or for implementing such systems.
processing power. A drawback of method 3 is that the same 60 In an aspect the present invention provides an electronic
problems often encountered with method 1 of connecting to meeting tool for communicating arbitrary media content from
the display adapter remain. Another drawback is that the users at a meeting comprising: a node configuration means
special device referred to requires significant processing adapted to operate a display node of a communications net-
power, which means that this device will consume much work, the display node being coupled to a first display, the
power, be relatively big and certainly be relatively expensive. 65 node configuration means being adapted to receive user
An alternative method in the making today is to use the well selected arbitrary media content and to control display of the
known USB interface of the computer for extracting the dis- user selected arbitrary media content on the first display; and
US 8,756,348 B2
5 6
at least one peripheral device adapted to connnunicate the dard class of peripheral devices, the peripheral device com-
user selected arbitrary media content via the connnunications prising a memory in which executable software code is stored
network, wherein the peripheral device is a connection unit for execution on the processing device, said executable soft-
comprising: ware code comprising:
(a) a connector adapted to couple to a port of a processing 5 a first software code portion for setting up, by means of the
device having a second display, a memory and an oper- pre-installed generic driver of the operating system, a
ating system; and means for connnunication between the peripheral device
(b) a transmitter for connnunicating with the connnunica- and the processing device;
tions network, a second software code portion for connecting the processing
a program adapted to be loaded onto the processing device 10
device to a connnunications network via the peripheral
and to run on the operating system of the processing device,
device, the peripheral device having a transceiver;
said program being adapted to obtain user selected arbitrary
a third software code portion for screen scraping data from the
media content, said program leaving a zero footprint on ter-
mination, and an input device to allow the user to carry out a processing device; and
user action that triggers transfer of said user selected arbitrary 15
a fourth software code for routing screen scraped data
media content to said transmitter through said port. between the processing device and the connnunications
The program can be stored on the peripheral device. The network over the means for connnunication; wherein the
transmitter can be a wireless transmitter or transceiver. The first software code portion is adapted to use the generic
peripheral device can be a plug-and-play device. The program connnunication protocol for transferring the screen
cane adapted to screen scrape content of the second display. 20 scraped data between the processing device and the periph-
The input device can be physical actuator coupled to the eral device.
peripheral device. The physical actuator preferably has a The first software code portion can be adapted to present
surface area of between 100 and 14,400 square nnn. Alterna- the peripheral device to the processing device as a human
tively, the input device can be a key displayed on the second interface device and wherein the pre-installed generic driver
display. The key displayed on the second display can be one 25 is a human interface device driver. The first software code
not screen scraped by the program. portion can be adapted to present the peripheral device to the
In another aspect the present invention provides a method processing device as a mass storage device and wherein the
for connecting a processing device to a connnunications net- pre-installed generic driver is a mass storage device driver.
work, the processing device having a memory, a display and The first software code portion can be adapted to present the
an operating system with at least one pre-installed generic 30
peripheral device to the processing device as a composite
driver providing a generic connnunications protocol for com-
device and wherein pre-installed generic drivers drive differ-
munication between processing device and a standard class of
ent device interfaces independently.
peripheral devices, the method comprising the steps of:
The executable software code can comprise fifth code for
a) coupling a peripheral device to the processing device, the
peripheral device having a transceiver; 35
providing a means for connecting to the connnunications
b) setting up, by means of the pre-installed generic driver of network including a base node. The executable software code
the operating system, a means for communication between can comprise sixth code for providing means for capturing
the peripheral device and the processing device; video frame buffers of the processing device.
c) coupling the processing device to a communications net- The executable software code can comprise seventh code
work via the peripheral device; 40 for providing a means for encoding, compressing and option-
d) routing screen scraped data between the processing device ally encrypting the screen scraped data and sending the screen
and the connnunication network via the means for com- scraped data the connnunication network. The executable
munication, wherein the generic connnunication protocol software code can comprise eighth code for providing a
is used for transferring the screen scraped data between the means for handling the peripheral device. The executable
processing device and the peripheral device. 45 software code can comprise ninth code for providing means
Step b) can comprise presenting the peripheral device to for initiating connection to the base node. The executable
the processing device as a human interface device and software code can comprise tenth code for receiving inputs
wherein the pre-installed generic driver is a human interface from an input device on the peripheral device. The executable
device driver. software code can comprise eleventh code for providing a
Alternatively step b) can comprise presenting the periph- 50 means for sending state changes to the visual indicator on the
eral device to the processing device as a mass storage device peripheral device. The executable software code can com-
and wherein the pre-installed generic driver is a mass storage prise twelfth code for providing a means for presenting to the
device driver. user a GUI. The executable software code can comprise thir-
Alternatively, step b) comprises presenting the peripheral teenth code for presenting a GUI for administration of the said
device to the processing device as a composite device and 55 executable software code when executed as a portable appli-
wherein pre-installed generic drivers drive different device cation. The executable software code can comprise four-
interfaces independently. teenth code for providing a means for displaying and activat-
A client application can be stored on the peripheral device ing a key on the display of the client processing device for
which when run on the processing device obtains the screen allowing a user to input the start the transfer of data from the
scraped data. Such a client application can be a portable 60 processing device to the base node.
application. In another aspect the present invention provides a periph-
In another aspect the present invention provides a peripheral device for providing connnunication connectivity to a
eral device for providing connnunication connectivity to a processing device which is provided with memory, a display
processing device which is provided with memory, a display and an operating system with at least one pre-installed
and an operating system with at least one pre-installed 65 generic driver providing a generic connnunication protocol
generic driver providing a generic connnunication protocol for connnunication between the processing device and a stan-
for communication between the processing device and a standard class of peripheral devices, the peripheral device com-
US 8,756,348 B2
7 8
prising a memory in which executable software code is stored a memory in which executable software code is stored for
for execution on the processing device, said executable soft- execution on the processing device, said executable software
ware code comprising: code comprising:
a first software code portion for setting up, by means of the a first software code portion for setting up, by means of the
pre-installed generic driver of the operating system, a 5 pre-installed generic driver of the operating system, a
means for communication between the peripheral device means for communication between the peripheral device
and the processing device; and the processing device;
a second software code portion for connecting the processing a second software code portion for connecting the processing
device to a communications network via the peripheral device to a communications network via the peripheral
device, the peripheral device having a transceiver; and 10 device, the peripheral device having a transceiver;
a third processing software code for routing data between the a third software code portion for receiving media content
processing device and the communications network over from the network and for displaying the media content on
the means for communication; wherein the first software the display in accordance with a set of rules; wherein the
code portion is adapted to use the generic communication first software code portion is adapted to use the generic
protocol for transferring the data between the processing 15 communication protocol for transferring the media content
device and the peripheral device, and an input device between the peripheral device and the processing device.
coupled to the peripheral device, the input device being The executable software code can comprise fourth code for
adapted to react to a user action to trigger the transfer of the providing a means for correctly configuring a receiver as an
data from the processing device to the peripheral device. access point. The executable software code can comprise fifth
The first software code portion can be adapted to present 20 code for providing a means for listening for output of con-
the peripheral device to the processing device as a human nection units trying to connect on a specific port. The execut-
interface device and wherein the pre-installed generic driver able software code can comprise sixth code for providing a
is a human interface device driver. The first software code means for a GUI for administration purposes. The executable
portion can be adapted to present the peripheral device to the software code can comprise seventh code for providing a
processing device as a mass storage device and wherein the 25 means for publishing its presence over the network using the
pre-installed generic driver is a mass storage device driver. Zeroconf protocol. The executable software code can com-
The first software code portion can be adapted to present the prise eighth code for providing a means for accepting and
peripheral device to the processing device as a composite installing software updates. The executable software code can
device and wherein pre-installed generic drivers drive differ- comprise ninth code for providing a means for providing
ent device interfaces independently. 30 facilities for pairing of connection units to the processing
The input device is preferably a physical actuator coupled device. The executable software code can comprise tenth
to the peripheral device. The physical actuator preferably has code for providing a means for auto-composing of different
a surface area of between 100 and 14,400 square mm. The incoming arbitrary media streams and rendering of compos-
input device can be for example a key for display on the ited image on display. The executable software code can
display. The executable software code can comprise fourth 35 comprise eleventh code for providing a means for receiving,
code for providing a means for connecting to the communi- decrypting and decoding incoming arbitrary media content.
cations network including a base node. The executable soft- The executable software code can comprise twelfth code for
ware code can comprise fifth code for providing a means for scaling of incoming arbitrary media streams. The executable
capturing video frame buffers of the processing device. The software code can comprise thirteenth code for providing a
executable software code can comprise sixth code for provid- 40 means for displaying incoming arbitrary media content in
ing a means for encoding, compressing and optionally accordance with a set of rules.
encrypting the video frames and sending them over a secure The present invention also provides a method for commu-
link to the base node. The executable software code can nicating arbitrary media content from users at a meeting
comprise seventh code for providing a means for handling the comprising:
peripheral device. The executable software code can com- 45 operating a display node of a communications network, the
prise eighth code for providing a means for initiating connec- display node being coupled to a first display, to receive user
tion to the base node. The executable software code can selected arbitrary media content and to control display of
comprises ninth code for receive inputs from an input device the user selected arbitrary media content on the first dis-
on the peripheral device. The executable software code can play; and connecting a peripheral device to a port of a
comprise tenth code for providing a means for sending state 50 processing device and communicating the user selected
changes to the visual indicator on the peripheral device. The arbitrary media content via the communications network,
executable software code can comprise eleventh code for loading a program onto the processing device and running the
providing a means for presenting the user a GUI. The execut- program on the operating system of the processing device
able software code can comprise twelfth code for presenting to obtain user selected arbitrary media content, said pro-
GUI for administration of the executable software code when 55 gram leaving a zero footprint on termination, and
executed as a portable application. The executable software triggering transfer of said user selected arbitrary media con-
code can comprise thirteenth code for providing a means for tent to said transmitter through said port after a user action
displaying and activating a key on the display of the process- on an input device.
ing device for allowing a user input to start the transfer of data The present invention also provides a peripheral device
from the processing device to the base node. 60 comprising:
In another aspect of the invention a peripheral device is a base
provided for providing communication connectivity to a pro- a connector for connection to a plug and play port of a host
cessing device which is provided with memory, a display and processing device,
an operating system with at least one pre-installed generic a flexible connection between the base and the connector for
driver providing a generic communication protocol for com- 65 transferring data signals and power,
munication between the processing device and a standard an actuator on the base for actuating a signal and for trans-
class of peripheral devices, the peripheral device comprising ferring the signal to the connector for transfer to the port,
US 8,756,348 B2
9 10
wherein the base has electronics comprising permanent to run without installation on the target machine. This type of
storage for storing a portable application, a processing application is stored on a removable storage device such as a
engine, a transceiver and a visual indicator. CD, USB flash drive, flash card, or floppy disk-storing its
The present invention also provides a method for providing program files, configuration information and data on the stor-
communication connectivity from a processing device, 5 age medium alone. It is a program that can be stored on an
setting up a communications network between a base node of electronic device such as a USB flash drive, iPod, memory
the communications network and a peripheral device card, portable hard drive or other portable electronic device
coupled to the processing device; and runs on a computer or other processing device coupled to
transferring media content between the processing device and the electronic device without making permanent configura-
the peripheral device,
lO tion changes to the host computer. All such programs have a
transmitting the media content from the peripheral device to
zero-footprint, meaning all temporary files, registry entries,
the communications network,
and any other changes to the machine exist only while the
receiving media content from the communications network at
the base node and displaying the media content on a display program is running.
in accordance with a set of rules. 15
To be considered a portable application, for purpose of this
With any of the above embodiments using pairing of the invention, a software program must:
peripheral device, the only user actions required to connect Not require any kind of formal installation onto a computer's
the processing device to the communications network and permanent storage device to be executed, and can be stored on
hence to the first or central display are plug in the peripheral a removable storage device such as USB flash drive, iPod,
device into the processing device, optionally press the button 20 memory card, portable hard drive or other portable electronic
on the peripheral device. This method allows for an automatic storage device thus enabling it to be used on multiple com-
connection of the peripheral device to the display node with- puters.
out any user interaction or configuration Settings are stored with, and can be preferably carried around
Embodiments of the present invention also include any of with, the software (i.e., they are written to the electronic
the above software code being stored on a non-transitory 25 device such as a USB drive). Settings are not stored to the
storage medium. registry or any other central system database of the computer.
Definitions Leaves a zero (or near-zero) "footprint" on any PC it is run
"Plug and play" is a term used to describe the characteristic on after being used. i.e., all temporary files/registry settings
of a computer bus, or device specification, which facilitates should be either avoided or at least removed once the program
the discovery of a hardware component in a system, without 30
has exited, and files created by the user can be saved directly
the need for physical device configuration, or user interven-
to the same removable media as the application is stored on.
tion in resolving resource conflicts. Plug and play devices can
A portable application does not leave its files or settings on
be added to a bus of a computing system (while running or
the host computer on which it runs. For example, the appli-
when shut down), and the newly added device and possibly
the rest of the computing system is automatically configured 35 cation does not write to the Windows registry or store its
to make the newly added device work, both from hardware configuration files (such as an INI file) in the user's profile;
and from software perspective. instead, it stores its configuration files in the program's direc-
Plug and play interfaces include for example (not an tory. Another requirement, since file paths will often differ on
exhaustive list): Firewire (IEEE-1394), PCI, Mini PCI, PCI changing computers due to variation in Windows drive letter
Express, Mini PCI Express, PCMCIA, PC Card, Universal 40 assignments, is the need for applications to store them in a
Serial Bus (USB), SDIO cards. relative format. Preferably, such a program does not require a
"Auto-configuration" is the automatic configuration of launcher program to copy necessary settings and files to the
devices without manual intervention, without setting any host computer when the application starts and move them
switches or jumpers, and without any need for software con- back to the application's directory when it closes as this may
figuration. An example of auto-configuring devices: USB 45 leave a residue on the hard drive in case of power failure.
devices. Examples of auto-configuring protocols: DHCP, "Electronic meeting systems" (EMS) need to be distin-
Zeroconf, Bonjour. guished on the one hand from classic groupware, on the other
A plug and play device has auto-configuration software by from web conferencing systems. In reality, there is some
default to make it plug and play. Example: USB devices are overlap between minor features of products of the named
made to be plug and play by including the correct auto- 50 categories. The main difference from groupware is the inten-
configuration software (e.g. host driver, host stack, applica- sity of collaboration. EMS should be distinguished from sys-
tion software). Autoconfiguration can also refer to a software tems with which it is possible to show the contents of an
alone and is not restricted to a physical device. individual computer screen on a remote display with multiple
"Hot swapping and hot plugging" are terms used to users at the same time.
describe the functions of replacing computer system compo- 55 "Groupware" supports collaboration within groups where
nents without shutting down the system. More specifically, the individual contributions remain identifiable. In contrast,
hot swapping describes replacing components without sig- EMS enables the group to cooperatively produce a result for
nificant interruption to the system, while hot plugging which the group is responsible as a whole. In a business
describes the addition of components that would expand the process, groupware and electronic meeting systems comple-
system without significant interruption to the operation of the 60 ment each other: Groupware supports teams when research-
system. A well-known example of this functionality is the ing and creating documents in the run up to an EMS session
Universal Serial Bus (USB) that allows users to add or or when implementing the results of such a session.
remove peripheral components such as a mouse, keyboard, or "Web conferencing systems" and "electronic meeting sys-
printer. Other examples are eSATA, PCie, FireWire, for tems" complement each other in the online meeting or work-
example. 65 shop: EMS extends the web conferencing system by provid-
A "portable application" (portable app ), sometimes also ing interactive tools for producing and documenting group
called standalone, is a computer software program designed results. On the other hand, "web conferencing systems"
US 8,756,348 B2
11 12
complement EMS with the screen sharing and voice confer- ing mass storage, a CD-ROM, a keyboard etc. or combina-
encing functionality required in synchronous online meetings tions of these. Such devices can be readable and writable
and not present in EMS. computer peripheral memory devices such as USB memory
"Data conferencing" refers to a communication session sticks, flash memories, external hard drives, or more.
among two or more participants sharing computer data in real 5
time. Interaction and presentation devices such as a screen, BRIEF DESCRIPTIONS OF THE DRAWINGS
keyboard, mouse, camera, etc. can be shared. It is a term used
to distinguish from video conferencing and audio conferenc- FIG. la shows a meeting room that can be used with
ing. The data can include screen, documents, graphics, draw- embodiments of the present invention. FIG. lb shows a com-
ings and applications that can be seen by the participants of 10 bination of a client processing device, a connection unit, a
the meeting. base node and a display in accordance with an embodiment of
"Application sharing" is an element of remote access, fall- the present invention.
ing under the collaborative software umbrella, that enables FIG. 2 shows a screen display in accordance with an
two or more users to access a shared application or document embodiment of the present invention.
from their respective computers simultaneously in real time. 15 FIGS. 3 to 5 show a base node and a peripheral device and
Generally, the shared application or document will be running a client processing device in accordance with embodiments of
on a host computer, and remote access to the shared content the present invention.
will be provided to other users by the host user. Application FIG. 6 shows a display in accordance with an embodiment
sharing should be distinguished from systems in which col- of the present invention.
laboration on the applications between different users is not 20 FIG. 7 shows a peripheral device in accordance with an
possible but the contents of individual computer screens can embodiment of the present invention.
be projected onto a remote display with multiple users at the FIG. 8 shows a client processing device in accordance with
same time. an embodiment of the present invention.
The term "arbitrary media content" refers to the fact that a FIG. 9 shows a further client processing device in accor-
user may generate, create or select any media content that is 25 dance with an embodiment of the present invention.
appropriate to display. This differs from client voting on, or FIG. 10 shows an embodiment of a peripheral device in
selecting of media content that is displayed by another in a accordance with an embodiment of the present invention.
meeting or presentation. This term refers to client oriented,
distributed rights and privileges for the display of content DETAILED DESCRIPTION OF THE
rather than a central presenter providing content which is 30 EMBODIMENTS OF THE PRESENT
presented to the members of the meeting. INVENTION
"Screen scraping" in our sense refers to reading the video
frame buffers and processing them, rather than just rendering The present invention will be described with respect to
them on a display. Screen scraping for presentations is particular embodiments and with reference to certain draw-
described in US2002/0196378 to Slobodin et al which is 35 ings but the invention is not limited thereto but only by the
included herein by reference. claims. The drawings described are only schematic and are
"Auto composition" or "auto layout" refers to the auto- non-limiting.
matic nature in which multiple graphics/video sources are Furthermore, the terms first, second, third and the like in
rendered on a central display, without user intervention and in the description and in the claims, are used for distinguishing
a way that a user would intuitively expect it to happen. 40 between similar elements and not necessarily for describing a
"Wireless" and "wireless communication network" can be sequential or chronological order. The terms are interchange-
any network that does not use cable links between nodes, e.g. able under appropriate circumstances and the embodiments
uses RF, optical or InfraRed for communication purposes, of the invention can operate in other sequences than described
such as IrDA, diffuse infra-red, WLAN, WiMax, WiFi, WiFi or illustrated herein.
Direct, Bluetooth or any other wireless communication net- 45 Moreover, the terms top, bottom, over, under and the like in
work known to the person skilled in the art. the description and the claims are used for descriptive pur-
"Computer" generally refers to a processing device, i.e. poses and not necessarily for describing relative positions.
having a processing engine capable of various types of digital The terms so used are interchangeable under appropriate
processing, such as rendering graphics images for display. A circumstances and the embodiments of the invention
computer can be in the form of a work station, a personal 50 described herein can operate in other orientations than
computer, a lap-top, a palm top, a PDA, a smartphone, a tablet described or illustrated herein.
etc. Generally a computer has memory such as volatile RAM. The term "comprising", used in the claims, should not be
Non-volatile memory such as a hard disc, optical disk or solid interpreted as being restricted to the means listed thereafter; it
state memory can be included in the computer or can be a does not exclude other elements or steps. It needs to be
peripheral device. Currently most computers are electronic 55 interpreted as specifying the presence of the stated features,
but the term "computer" also includes optics based comput- integers, steps or components as referred to, but does not
ing devices. preclude the presence or addition of one or more other fea-
The term "pre-installed generic driver" is intended to mean tures, integers, steps or components, or groups thereof. Thus,
a driver which is installed on a processing device such as a the scope of the expression "a device comprising means A and
computer as a standard driver, e.g. is installed with the instal- 60 B" should not be limited to devices consisting only of com-
lation of the operating system. Such a driver is standard for ponents A and B. It means that with respect to the present
the operating system and can drive a standard class of periph- invention, the only relevant components of the device are A
eral devices coupled to or connected to the processing device. andB.
The installation of a specific driver for such a peripheral Similarly, it is to be noticed that the term "coupled", also
device is not required. Such a generic driver can be a human 65 used in the description or claims, should not be interpreted as
interface driver (HID) or a mass storage device driver, which being restricted to direct connections only. Thus, the scope of
has predetermined software components configured for driv- the expression "a device A coupled to a device B" should not
US 8,756,348 B2
13 14
be limited to devices or systems wherein an output of device network 50 is the base or display node 36. This node 36 may
A is directly connected to an input of device B. It means that optionally be a wireless access point. The base node 36 may
there exists a path between an output of A and an input of B also be a processing device or host computer and may be
which may be a path including other devices or means. coupled to a second connection unit 49 that provides access to
Elements or parts of the described devices may comprise 5 the network 50 thus linking all of the processing devices 31,
logic encoded in media for performing any kind of informa- 36 together. The connection unit may have an input device as
tion processing. Logic may comprise software encoded in a described above. Alternatively, network connections installed
disk or other computer-readable medium and/or instructions on the base node 36 can be used. Audio equipment 46 may be
encoded in an application specific integrated circuit (ASIC), provided, e.g. a telephone that allows other members of the
field programmable gate array (FPGA), or other processor or 10 meeting to call in from remote destinations.
hardware. The display node 36 is coupled to and adapted to allow
References to software can encompass any type of pro- display of media on some kind of display 44. The display
grams in any language executable directly or indirectly by a node is in embodiments of the present invention a base node
processor. of the communications network 50. The display 44 may be a
References to logic, hardware, processor or circuitry can 15 projector and screen, the projector being coupled to the base
encompass any kind oflogic or analog circuitry, integrated to node 36. A whiteboard 45 can optionally be provided that can
any degree, and not limited to general purpose processors, be optionally coupled to the display 44 and/or the base node
digital signal processors, ASICs, FPGAs, discrete compo- 36, e.g. when the whiteboard can record electronically what is
nents or transistor logic gates and so on. written on it. Optionally, a camera 35 may be provided to
Embodiments of the present invention provide solutions to 20 record the entries on the whiteboard 45. The camera 35 may
three major problems with meetings: have a third connection unit 52 for connecting the camera 52
a) the time taken to prepare for a meeting. This is mainly to the network 50 so that the data from the whiteboard can be
achieved by allowing "on-the-fly" presentation of any dis- recorded and stored or transmitted to other networks via
playable information. This information does not have to be router 42. The connection unit 52 may have an input device as
linked into any particular presentation software, nor to be 25 described above.
compatible with any such presentation software, Optional equipment can be cameras 39, 40, 41 for record-
b) the time taken to conduct the meeting using electronic ing the progress of the meeting. These cameras can be linked
meeting tools. This is achieved by reducing the time to by a network 51, e.g. a cable network to the router 42 and/or
connect computers to the display or projection system. the base node 36. Another optional item is a microphone or
c) the time taken to reflect and review and document the 30 microphones 38 that can be used to transfer audio, e.g. to the
meeting afterwards. This is achieved by providing the pos- processing devices 31 and to loud speakers (not shown)
sibility ofrecording the course of the meeting in the same attached to the base node 36 or part of the display 44.
time sequence that it was carried out as well as be able to Any or all of the outputs of the processing devices 31, the
store all data presented and who presented it. cameras, the whiteboard, etc. can be recorded and stored
FIG. la is a schematic representation of a generic meeting 35 digitally, e.g. in node 36 or elsewhere to provide a complete
room 30 with a meeting table that can be used with embodi- record with correct time sequence.
ments of the present invention. Participants 37 have some Summarizing the above, the present invention provides an
form of processing device 31 such as a laptop computer, a electronic meeting tool for communicating arbitrary media
tablet, a PDA etc. Each of the processing devices 31 can be a content between different users 37 (with theirown processing
host device and has a first connection unit 47 to which it is 40 devices 31, e.g. PC, mobile phone, or tablet) and one display
coupled. The first connection unit 47 provides access to a or projector or multiple displays or projectors 44 in the meet-
network 50 which in this case is a wireless network, but could ing room 50.
be a wired network. Each connection unit 47 may be coupled Referring to FIGS. la and lb embodiments of the present
to an input device 48 which will be described in more detail invention comprise a base or display node 36 being a process-
later. A user 37 will typically at a distance from the processing 45 ing device, e.g. a host computer adapted to receive user
device 37 which is ergonomically satisfactory. This ergo- selected arbitrary media content, the base node 36 being
nomic boundary is typically an area of about 1000 sq cm to coupled to a central display 44 which can be a fixed format
4000 sq cm. This ergonomic boundary will typically have the display or a projector or similar. The arbitrary media content
user as one side of the boundary and the comfortable reach of can be provided from any of the user processing devices 31.
the arms will determine an area on the left and right of the 50 The base node 36 can be adapted to display the received user
processing device which falls within the ergonomic boundary selected arbitrary media content in accordance with a set of
and the far edge of the boundary of the processing device rules, e.g. FIFO, automatically, on request or approval, forced
(normally delimited by a display screen) will determine the to display, in accordance with a priority etc. Optionally the
other side of the ergonomic boundary. The area defined by the base node 36 is adapted to force display of the received user
ergonomic boundary will overlap or include the processing 55 selected arbitrary media content, i.e. to allow participation in
device 31 itself. The processing device will also have an outer the meeting by an individual user displaying own selected
physical boundary. The input device 48 is preferably arranged content on display 44 independently of the person who is
to operate outside the boundary of the processing device 31 nominally responsible for giving a presentation or chairing
but within the ergonomic boundary. Preferably the input the meeting. Forcing the display can also be considered as a
device is arranged to function when it is flat on the table. The 60 rule. The meeting tool can also be adapted to allow a priority
input device preferably has an size of activation area of setting. This means that a user can set a priority setting for the
between 1 and 144 square cm. media to be displayed. A priority of"l" for example can be
Preferably the network 50 is a local area network, i.e. interpreted by the base node as a forced display, a priority "2"
preferably local to the meeting room for security reasons but can be interpreted by the base node as display as soon as
the network 50 may have access to other local or wide area 65 possible, priority "3" can be interpreted by the base node as
networks such as 51 or to a larger corporate network or the place in queue and display as the time comes etc. Setting and
internet 43, for example via a router 42. Another node of the using priorities for display are also considered to be working
US 8,756,348 B2
15 16
to rules. To execute the rules, the base node 36 may have a receiver is preferably a transceiver. Optionally the transmit-
decision module. The base node 36 may be a host computer ter/receiver can be a wireless transmitter/receiver.
having a processing engine such as a microprocessor and a The input device 48 allows a user interaction with the
memory. Preferably, the base node 36 is adapted to treat connection unit 47. Preferably the input device 48 is physical
media content passed to the base node 3 6 from any or all of the 5 actuator coupled to the connection unit 47. The user action
connection units 47 in an equal manner. The base node 36 applied to the input device 48 generates a signal that can
may be adapted to auto compose the media content on the trigger transfer of data from the processing device 31 (to
central display 44 connected to it, e.g. from one or more which the connection unit 47 is coupled) to the network 50.
processing devices 31. Preferably the input device 48 has an activating surface that is
An independent aspect of the present invention is at least 10 between 100 and 14,400 square mm. Optionally, the input
one connection unit 47, (optionally 49 for receiving) adapted device 48 can be a key displayed on the client display 1 of a
to communicate the user selected arbitrary media content to client processing device 31. This key can be activated, e.g. by
said base node 36. Preferably the connection units 47 and/or use of a pointing device such as a mouse trigger transfer of
optionally 49 are physical plug-and-play devices. An data from the processing device 31 to the network 50.
example of a connection unit is shown schematically in FIG. 15 The connection unit 47 is preferably provided with a visual
10. indicator 61, e.g. for allowing user feedback from the con-
The connection unit 47 may integrated into a user process- nection unit 47 of the status of any activity.
ing device 31, e.g. as an internal peripheral device or may The system also can include a server program 64 adapted to
preferably be an external peripheral device comprising a con- be loaded onto the base node 36, said program 64 being
nector adapted to couple to a port of a user processing device 20 adapted to receive arbitrary media content from one or a
31. The processing device 31 may have a client display, a plurality of client processing devices 31 through said connec-
processing engine such as a microprocessor, a memory and an tion units 47, (optionally 49), and to show this plurality of
operating system. The optional connection unit 49 may inte- arbitrary media content streams on one or a plurality of dis-
grated into the base node 36, e.g. as an internal peripheral plays 44. The server program 64 may be adapted to allow
device or may be an external peripheral device comprising a 25 display in accordance with one or more rules, e.g. FIFO,
connector adapted to couple to a port of the base node 36. The automatically, on request, forced, in accordance with a prior-
connection unit 49 may be fully integrated into the base node ity etc. To execute the rules, the server program 64 may have
36, e.g. is an internal network interface of the base node 36. a decision module.
The base node 36 may have a processing engine such as a Preferably, the server program 64 is adapted to treat media
microprocessor, a memory and an operating system. 30 content passed to it from any or all of the connection units 47
The user processing devices 31, the connection units 47, in an equal manner. The server program 64 may be adapted to
(optionally 49) and the base node 36 co-operate to form a auto compose the media content on the central display 44.
communication network 50 for linking between at least one of The server program 64 may be a portable application
the plurality of processing devices 31, 36 and the central adapted to be loaded onto the base node 36 and to be run on
display device 44. The communication network 50 is adapted 35 the operating system of the base node 36. The portable appli-
to receive arbitrary media content from at least one of the cation 64 runs a process on the base node 36 that is adapted to
plurality of processing devices 31 and to transmit the arbitrary display an arbitrary media content received from the client
media content of at least one of the plurality of processing processing device 31 via the communication network 50, the
devices to the central display device 44. process leaving a zero footprint on termination. Optionally
An independent aspect of the present invention is a por- 40 the portable application 64 is stored on each connection unit
table application 60 adapted to be loaded onto a client pro- 49 and optionally 7 and can be installed therefrom.
cessing device 31 and to be run on the operating system of the The system may also include a central display device 44
client processing device 31. The portable application 60 runs and optionally a whiteboard 45 or other display means such as
as a process on the client processing device 31 that is adapted a printer. The display 44 being adapted to receive user
to deliver an arbitrary media content from the client process- 45 selected arbitrary media content, and may be adapted to allow
ing device 31 to the communication network 50 in response to display of the received user selected arbitrary media content
a user action applied to an input device 48, the process leaving in accordance with one or more rules, e.g. FIFO, automatic,
a zero footprint on termination. Optionally the portable appli- forced, on request or approval, in accordance with a priority
cation 60 is stored on each connection unit 47 and optionally etc.
49. Preferably the portable application 60 is adapted to 50 Optionally, one of the connection units 47 can be adapted
"screen scrape" content of the client display of the client to be a master connection unit. Such a master connection unit
processing device 31. Optionally the portable application 60 may be adapted to instruct the base node when media content
when run on a processing device 31 is adapted to "screen from a client processing device 31 may be displayed or which
scrape" content of the client display of this client processing of the processing devices may be allowed to send content for
device 31 and to transmit it via a connection unit 47. Option- 55 display.
ally the portable application 60 when run on the processing In embodiments of the present invention, at least one por-
device is adapted to "screen scrape" content of the client table application is used, e.g. for the client software on a client
display of the client processing device 31 and to transmit it via procesing device 31 or optionzlly on the base node 36. In
a network interface of the processing device 31, for example these embodiments, one of the pre-installed generic drivers of
if the connection unit 47 has no transmitter. 60 the operating system on the relevant computer device 31, 36
The connection unit 47 for communicating with said base is exploited for setting up communication from the computer
node 36 has a network interface e.g. comprising a transmitter device 31, 36 to the network 50 via the connection unit 47,
62. The transmitter 62 is preferably a transceiver. Optionally (optionally 49). The generic driver is used in connection with
the transmitter/receiver can be a wireless transmitter/receiver. the connection unit 47, (optionally 49) operating as a periph-
The base node 36 for communicating with the connection 65 era! device but the use can go beyond that of the standard class
unit 47 has a receiver 63 which can be included in the con- of peripheral devices for which the generic driver is intended.
nection unit 49 or integrated into the base node 36. The In some embodiments the connection unit 47, (optionally 49)
US 8,756,348 B2
17 18
operated as a peripheral device communicates with the rel- The visual indicator 61 on the connection unit 47 indicates
evant processing device 31, 36 by using a generic communi- to the user and to other participants in the meeting that media
cation protocol provided by the pre-installed generic driver. content is being sent by that connection unit 47 to the base
Pre-installed USB drivers are examples. Preferably the set- node 36 for display.
ting up of the communication of network 50 using connection 5 Repeating the second user interaction on the input device
unit 47, (optionally 49) does not alteror affect the networking 48 of a connection unit 47 decouples the media content from
capability of the relevant processing device 31, 36. For that connection unit 47 from the base node 36. The base node
example, if a browser is started on the client processing 36 removes that media content from the composed image on
device 31, this browser can use the standard network inter- the central display and recomposes the remaining content on
faces on the processing device 31. This means that transfer of 10 the central display.
data via the connection unit 47 (optionally 49) is independent The content on the central display/projector is auto
of transfer of data over the network interfaces of processing arranged as shown in FIG. 2. When user 1 adds content,
device 31 or 36. This has the advantage that each user can his/her display will be scaled to fill the available central
carry out processing such as searching on the internet to display canvas as much as possible, but without affecting the
gather data independently of the transfer of data to be 15 aspect ratio. When user 2 adds in, his content is added to the
diplayed during a meeting, or receive emails etc. side of the first image. When user 3 adds his content, the
The use of a portable application has the advantage that any arrangement is triangle wise. Adding user 4, the image
modification to settings in the register or generally in the becomes a 2 by 2 tiling, which is the maximum available.
operating system can be avoided, so that upon any form of When an additional user attempts to add content, he will be
termination, e.g. disconnecting the electronic device, system 20 blocked. When a user initiates action to remove his/her con-
crash, no trace is left. This is generally termed "zero foot- tent, his/her media content is removed from the central dis-
print". play and one moves backward in the composition sequence
The present invention has the advantage of scalability. It shown in FIG. 2.
can provide a display system for use by a plurality of users in Base Node Software
meetings. Every user in the meeting thus can have a client 25 The base node software has one or more of the following
processing device 31 for coupling to a connection unit 47. A features:
first user action connects the client processing device 31 to the First code for providing a means or a method step for
base node 36, e.g. by inserting a connection unit 47 into the correctly configuring the receiver of the base node as an
relevant interface connector on the processing device 31, e.g. access point.
a USB interface. A second user action comprising activating 30 Second code for providing a means or a method step for
a button or key on the input device (e.g. by depressing it) then listening for output of connection units trying to connect
starts the process of transmitting arbitrary media content from on a specific port.
the client processing device 31 to the base node 36. This Optionally, third code for providing a means or a method
process preferably includes screen scraping data from the step for a GUI for administration purposes, offered for
processing device. Using screen scraping avoids special pro- 35 example over a web interface.
grams being installed on the base node 36 to carry out graphi- Optionally, fourth code for providing a means or a method
cal commands sent from the processing device 31. When the step for publishing its presence over the network using
base node 36 receives the plurality of arbitrary media content, the zeroconf protocol.
it can allow auto composition of this media content on the Optionally, fifth code for providing a means or a method
central display connected to it. 40 step for accepting and installing software updates of the
The present invention will now be described further with base node as well as for the portable application software
reference to certain more specific embodiments. for the connection units.
With reference to FIG. 2, the base node software (6) run- Sixth code for providing a means or a method step for
ning on a base node 36 can be adapted to display on the central providing facilities for pairing of connection units to the
display a splash screen (21) showing its readiness to receive 45 base node.
arbitrary media content over its receiver. This splash screen Seventh code for providing a means or a method step for
(21) can also show instructions on how to use the system, as auto-composiing of different incoming arbitrary media
well as the configuration parameters (see later) to reach the streams and rendering of composited image on display
base node 36. These configuration parameters are also shown or projector screen.
in a transparent canvas at the bottom of the central display 50 Eighth code for providing a means or a method step for
(22). receiving, decrypting and decoding incoming arbitrary
A client processing device 31 that wants to have its arbi- media content.
trary media content displayed on the central display con- Optionally ninth code for providing a means or a method
nected to the base node 36 is connected to a connection unit step for scaling of incoming arbitrary media streams
47. The portable application 60 will be executed on the client 55 Optionally tenth code for providing a means for displaying
processing device 31 as a host device. A first user interaction incoming arbitrary media content in accordance with a
creates a connection between the portable application 60 and set of one or more rules.
the base node 36 using the transmitter in the connection unit Any of the above code may be stored on a non-transitory
47 and the receiver in the base node 36. A second user inter- machine readable storage medium such as an optical disk, a
action, this time on the input device 48, activates screen 60 magnetic disk, magnetic tape, solid state memory etc.
scraping by the portable application of the arbitrary media Portable Application for the Client Processing Device
content from the client processing device display, which is The portable application comprises an algorithm for screen
then sent over the connector unit 47 to the base node. scraping. Screen scraping algorithms include VNC and RDP
The base node 36 receives the plurality of arbitrary media or similar. The algorithm may include a combination of algo-
content coming from one or more connection units 47, and 65 rithms such as VNC and RDP that are optimized for different
auto composes this media content for rendering on the central content, e.g. static text or video. The portable application has
display. one or more of the following features:
US 8,756,348 B2
19 20
Eleventh code for providing a means or a method step for Program updates of portable application and server pro-
connecting to a network including the base node. gram can be performed locally
Twelfth code for providing a means or a method step for Portable applications are used, no installation, multi-plat-
capturing video frame buffers of the client processing form, no vendor specifics
device, i.e. computer (C), also called screen scraping. Particular implementation of screen scraping done by por-
Thirteenth code for providing a means or a method step for table application avoids vendor specific graphics
encoding, compressing and optionally encrypting these devices
video frames and sending them over a secure link to the Standard drivers are used
base node. Only changed areas such as rectangles or No configuration changes on the client processing devices
triangles of the screen need to be transferred, and differ- 10 Zero footprint applications on client processing devices-
ent types of rectangles or triangles are encoded in dif- nothing to clear up or adjust or reset
ferent ways (e.g. RLE, JPEG, ... ) to optimise perfor- Own networking facilities of client processing devices not
mance. blocked
Fourteenth code for providing a means or a method step for No configuration changes on the user computers
handling the connection unit. 15 Low virus, malware and spyware risk
Fifteenth code for providing a means or a method step for The portable application may be stored on a non-transitory
initiating connection to base node. machine readable storage medium such as an optical disk, a
Sixteenth code for receive inputs from the input device on magnetic disk, magnetic tape, solid state memory etc.
the connection unit. Second Embodiment
Seventeenth code for providing a means or a method step 20 In the second embodiment, referring to FIGS. 2 to 5, the
for sending state changes to the visual indicator on the base node is a separate physical processing device called base
connection unit. unit (B), comprising permanent storage, memory, a process-
Optionally, eighteenth code for providing a means or a ing engine, a wireless access point (4), a plug and play inter-
method step for presenting the user a GUI (18). face such as a USB port (11), a graphics display output
Optionally, nineteenth code for presenting GUI for admin- 25 adapter (5) like VGA/DP/DVI/HDMI, and optionally an
istration of the portable application. audio output adapter (27). An input device having an actuator
Optionally, twentieth code for providing a means or a such as a button 13 and a visual indicator 14 are optional.
method step for displaying and activating a key on the The connection unit is a physical device in the form of an
display of the client processing device for allowing a external peripheral device (shown in the drawings as a
user input to start the transfer of data from the client 30 "dongle" D) comprising permanent storage storing the por-
device to the base node. table application (7) and configuration parameters (12),
Any of the above code may be stored on a non-transitory memory, a processing engine (e.g. CPU, FPGA), a wireless
machine readable storage medium such as an optical disk, a transmitter such as WiFi (3), a plug and play interface such as
magnetic disk, magnetic tape, solid state memory etc. a USB interface (2), a button as input device (9), an LED ring
In this embodiment the portable application stored on the 35 as visual indicator (10). The portable application is stored on
connection unit, and is executed in an execution context on the peripheral device (7).
the client processing device. The portable application does The client processing device is host device, for example a
not need to be copied to or installed on the computer. It can be computer or laptop comprising a display, a plug and play
executed directly from the connection unit. It will only be interface such as a USB port (2), memory, and a processing
copied temporarily into an execution context on the client 40 engine such as a microprocessor.
processing device. There are also no changes in configuration The system thus comprises
or settings in the client processing device. This means that an external peripheral device (D) that has a plug and play
nothing will remain on the client processing device when the interface such as a USB interface (2) on one end and a
connection unit is removed. It also implies that the portable communications interface such as a wireless interface
application will run on client processing devices where the 45 configured as client (3) on the other end.
user does not have the necessary access rights to install soft- a base unit (B) that has a communications interface such as
ware. a wireless interface configured as access point on one
The portable application is designed in such a way that end (4) and a video card adapter (5) like VGA, DVI, DP
No specific drivers need to be installed on the client pro- or HDMI on the other end.
cessing device. 50 a portable application (7) stored on the peripheral device
Pre-installed drivers are used, e.g. for classes of peripheral (D) but executed on the client processing device (C)
devices. a base node software (6) stored and executed on the base
It is independent from vendor specific graphics hardware. unit (B)
It runs on at least one and preferably on a variety of differ- The external peripheral device (D) also preferably has any
ent client processing devices, including Windows, Mac 55 one or any combination of:
OS/X, Linux, Android, iOS and many others. a large button as actuator for the input device (9) allowing
Advantages user interaction with the peripheral device. The button
The present application has one or more of the following preferably has an actuation surface area of between 100
advantages: and 14,400 square mm.
No need for a master role in the meeting 60 visual indication such as a LED (10) allowing user feed-
Standard plug and play connectivity of connection units to back from the peripheral device
base node An advantage of embodiments of the present invention is to
Simple and well known user actions are employed provide data transfer to the peripheral device via a peripheral
Own networking facilities of client processing devices not interface such as a USB interface on any processing device
blocked 65 such as a computer in a manner that is largely operating
No configuration changes on the client processing device system independent and without leaving a footprint (Zero-
Input devices are easily accessible; e.g. large size Footprint ). Installation of drivers and/or applications onto
US 8,756,348 B2
21 22
such a processing device as a computer is not necessary channel from the peripheral device to the base unit. The
wherever pre-installed generic drivers are present. Adminis- content is not shown yet. The LED (10) on the peripheral
trator rights on the processing device such as a computer are device now turns white to give a visual indication of this new
preferably not necessary. To avoid the need for administrator state.
rights, embodiments of the present invention use other 5 When the user at the computer (C) wants to show her
peripheral device pre-installed drivers such as USB class content, she presses the button (9). When the button was
drivers supported without any extra installation. Embodi- previously in state "connected" (see FIG. 6), it will check the
ments of the present invention route at least screen scraped state of the base unit (P). If the base unit is not in state "full",
data presented by client software running on the processing the peripheral device will send the screen scraped arbitrary
device for transfer to a communications network via a periph- 10 media content to the base unit (B), which will add the media
eral device such as a USB device. This bypasses any network content to the composition on the central display. The periph-
interface of the processing device (and hence many firewalls) eral device LED (10) now turns red to indicate "showing"
but only for the specific client software. Other applications state (FIG. 6).
are not affected and can make use of the standard network The button (9) acts as a toggle. When the user presses the
interfaces, i.e. packets from/to the TCP/IP stack are trans- 15 button again, that computer displays content will be removed
ferred to a network device as normal. The client software is from the projector. The LED (10) goes back to white.
launched from the peripheral device such as a USB composite Use of the auto-run feature is optional if possible and
device or storage device as a portable application, which can enabled on the computer (C) to start the client software (7) as
avoid that any traces are left on the host OS. soon as the peripheral device is plugged in. On Windows for
Basic Usage Scenario of the Second Embodiment 20 example, this means mounting the peripheral device as a mass
The base node software (6) displays on the projector a storage device and using the autorun.inf file stored on the
splash screen-(21) in FIG. 5-showing its readiness to peripheral device.
receive arbitrary media content over its receiver (4). This In many cases however, this auto-run feature will be dis-
splash screen (21) also shows instructions on how to use the abled for security reasons. In that case, we will, if possible and
system, as well as the configuration parameters (see later) to 25 enabled on the computer (C), use the auto-play feature to
reach the base node. These configuration parameters are also show the logo of the connected peripheral device on the
shown in a transparent canvas at the bottom of the central desktop of the computer. The user then needs to double click
display (22). on that logo to start the client software. Ifthe auto-play feature
To avoid user interaction for the configuration of the con- as described above is also not possible or enabled, the user
nection between peripheral device and base unit, a pairing 30 must browse to the file system of the connected peripheral
process is used. This pairing process provides the peripheral device and start the application manually. This means double
device, i.e. the connection unit with networks parameters clicking the client.exe file on Windows, client.app on Mac
needed to set up the local network. As an example, the periph- OS/X or tapping the appropriate application icon on a tablet
eral device can be briefly plugged into the USB port (11) of or any mobile device with touch screen.
the base unit (B). The base unit then optionally does a soft- 35 Third Embodiment: Portable Application Stored on Standard
ware validity check, optionally does a software update of the Solid State Memory Such as a USB Stick
portable application stored on the peripheral device, and In the third embodiment, the portable application is stored
writes the connection parameters on the peripheral device (D) on a solid state memory such as a regular USB memory stick
required for the peripheral device and base unit to find each (FIG. 7).
other to the permanent storage (8). For example, when using 40 With a solid state memory such as a regular USB memory
WiFi, this would be the SSID, WEP/WPA2 and IP address of stick, there is no input device, visual indicator or transmitter
the base unit's receiver, as well as the port number used by the of the kinds described above for the connection unit. This
base node software. means that the system needs to:
A client processing device that wants to have its arbitrary Use the transmitter/receiver from the client processing
media content displayed on the central display connected to 45 device.
the base node (5) connects a peripheral device (D) to its USB Use as input device a key or button on the client processing
port via (2). The peripheral device presents itself to the com- device like a physical key on the keyboard, a special
puter over interface (2) as a composite device comprising a mouse press, a button area on a touch screen, a button
mass storage device and a keypad. This has the major advan- displayed on the screen to be clicked on with a mouse
tage that no specific driver is required, since all these devices 50 pointer.
are natively supported in every personal computer system that Present the visual indicator on the client processing
has a USB port. If autorun is enabled, then the computer will device's display.
automatically execute the client software (7) stored in mass The client processing device then looks like FIG. 8.
storage (8) on the peripheral device. The first user interaction This embodiment provides a peripheral interface such as
mentioned in the general case is then just the connection of 55 the USB interface on any processing device acting as a host
the peripheral device to the USB port. If security measures device such as a computer in a manner that is largely operat-
disabled auto-run, the user needs to explore the mass storage ing system independent. Installation of drivers and/or appli-
on the mass storage of the peripheral device and start the cations onto such a processing device as a computer is not
portable application manually. necessary wherever pre-installed generic drivers are present.
The portable application will use the wireless, e.g. wifi 60 Administrator rights on the processing device such as a com-
interface of the peripheral device (3) to connect to the correct puter are preferably not necessary. To avoid the need for
base node. To know the right base unit to connect to, the administrator rights, this embodiment uses other peripheral
configuration parameters needed to make this connection are device pre-installed drivers such as USB class drivers sup-
stored in the database (12) on the mass storage device (8) ported without any extra installation. This embodiment of the
during the pairing process described earlier. 65 present invention routes at least screen scraped data presented
Once the connection is made, the peripheral device goes by client software running on the processing device for trans-
into connected mode. This means that there is now at least one fer to a communications network via a network connection of
US 8,756,348 B2
23 24
the processing device. The client software is launched from there is often no USB port available
the peripheral device such as the USB device as a portable application distribution is easy and widely accepted
application. through application stores
The first user operation then comprises: Fifth Embodiment: Base Node Software OEM'ed to Projec-
plugging in the solid state device such as a USB memory 5 tor or Display Equipment
stick, In this embodiment, the base node is not realized as a
starting the portable application (if autorun is disabled) separate physical box, but integrated into the processing unit
configuring the transmitter on the client processing device inside a display or projector. All other details are as previously
to connect to the correct base node, using the configu- described.
10 Sixth Embodiment
ration parameters (22) shown on the central display
In this embodiment, the base node is not realized as a
triggering the connection of the portable application with
separate physical box, but integrated into the codec of a video
the base node, for example by interacting with an ele-
conferencing equipment. All other details are as previously
ment on the GUI (18) of the portable application pre- described.
sented on the display of the client processing device. 15 Seventh Embodiment: Remote Meeting Participant
Presenting visual feedback on user actions is in this In this embodiment, one or multiple client operating
embodiment also done using elements in the GUI of the devices are not in the direct vicinity of the base node but on a
display of the client operating device. remote location.
In this embodiment, the advantage of zero footprint is To accommodate this case, the following adaptations are
partly realized by the portable application in the sense that no 20 needed:
software is installed on or copied to the client operating further compression and or scaling of the arbitrary media
device, but there is a configuration change needed to connect content to allow use of low bandwidth connection
the transmitter of the client operating device with the base possibility to communicate connection parameters of the
node, which needs to be undone afterwards. base node to a remote user
Optionally, the portable application can make the configu- 25 connectivity of the base node to the WAN network to which
ration changes to the transmitter for the user. the remote user is connected
Advantages Lost in this Embodiment All other details are as previously described.
Partial loss of zero footprint nature of portable application Eighth Embodiment: Multiple Base Nodes
More complex first user interaction In this embodiment, multiple base nodes are used. This can
More expertise required from user 30 be done for different purposes:
connectivity of multiple central displays
GUI needed on client operating device display, which is
extension of real estate of central display
possibly also shown on central display
connectivity of base nodes in different remote locations
Need to find free key on client operating device when using
Thi provides the advantage that one can present on multiple
physical key for second user action 35 base units from a single peripheral device. This is usefull for
Network interface is blocked from other uses by portable a number of cases:
application personal peripheral device: user can have a personal
Optionally, the last point can be avoided by using the base peripheral device that is paired with multiple meeting
unit as a gateway to the network that the client operating rooms that he regularly uses
device wanted to connect to through its own interface. 40 use in meeting room with multiple base units each control-
Advantages are: ling a different display in the same meeting room
tight control of user connectivity to corporate network The proposal uses a special variant of the peripheral device
through settings on the base unit called a multi base peripheral device. The multi base periph-
keep network connectivity intact even when transmitter is eral device is equiped with a rotating wheel around the circu-
now also used for display purposes 45 lar central "show me" button. This could be a mechanical
Disadvantage is a higher vulnerability of the system rotating multi-position switch or something like the touch
because the display connection is now possible a doorway wheel on the iPod classic.
into the corporate network. The pairing of this multi-base variant of the peripheral
What remains as advantages are device:
the availability of a physical medium to distribute the por- 50 the rotation wheel is put in the position of the correspond-
table application to users ing base unit.
no need to install or copy software to client operating the peripheral device is paired to the base node in the
device regular way
easy way to maintain software updates on the connection the configuration parameters are stored in a permanent
units (here: memory sticks) via the base unit 55 storage location; every position of the rotating wheel has
possibility to write configuration data on the connection a corresponding set of connection parameters (e.g. dif-
unit by the base unit, for example in the form of a ferent rows in a table) each corresponding with a par-
configuration profile that can be read and used by the ticular base
client operating device The connection of the peripheral device is as follows:
Fourth Embodiment: Software Only Client Installed on the 60 multi-base peripheral device Xis plugged into a PC
Client Processing Device rotation wheel on peripheral device X is put in position A
This embodiment is similar to the third embodiment, with peripheral device X reads configuration parameters m
as only difference that the software is copied on the client position A of its internal memory
operating device (FIG. 9). In this case, no plug and play port peripheral device X connects to base node A
such as a USB port is required on the client operating device. 65 base node A indicates connection of multi-base peripheral
This embodiment will typically be used for tablet PC's and device X on central display screen
mobile devices. In that case rotation wheel on peripheral device X is put in position B
US 8,756,348 B2
25 26
peripheral device X reads configuration parameters m Alternative Embodiments
position B of its internal memory In the above embodiments, once the connection is made
peripheral device X connects to base node B between the connection device and a host computer, the
base node B indicates connection of multi-base peripheral peripheral device goes into connected mode. This means that
device X on screen 5 there is at least one channel from the peripheral device to the
continue until correct base is selected with rotation wheel base node. In accordance with any of the embodiments of the
click the peripheral device input device e.g. button to show present invention a plurality of charmels can be set up
content on central display of base node between the connection device and the base node. These
rotating the wheel always first clicks away content from the channels may be logical channels.
base of the last position 10 Some examples for such a multicharmel arrangement may
Ninth Embodiment include the first and one or more of the additional charmels:
FIG.10 shows a peripheral device 47 in accordance with an First charmel is for the Scraped image stream (XDS)
independent embodiment of the present invention including Second channel is for GPU commands (OpenGL, DirectX)
an input device. This embodiment can be used with any of the Third channel is for Mouse pointer coordinates (absolute,
embodiments described above. 15 relative)
The peripheral device is configured as a connection unit Fourth channel is for Mouse pointer icons
and is a physical device in the form of a connector for a plug Fifth charmel is for Image data files (JPEG, PNG,
and play interface of a user processing device as a host com- GIF, ... )
puter such as a USB connection, a flexible data and power Sixth charmel is for Multimedia data files or streams
connection connected to the connector and a base, the base 20 (MPEG2, MPEG4, OGG, H.26x, ... )
having an actuator, e.g. a button configured to be an input Seventh channel is for Audio data files or streams (MP3,
device with the functions as described above. MP4, AAC, WMA, ... )
The base and/or the actuator is preferably large in size, e.g. Eighth channel is for text or Document data files (DOC,
having a surface area between 100 and 14,400 square mm. DOCX, PPT, PPTX, ODT, ODS, PDF, ... )
The base can be square, rectangular, round, hexagonal, oval, 25 Ninth channel is for transmission of a priority value 1, 2,
polygonal in shape or any other ergonomically suitable shape. 3 ... as described above.
The actuator is preferably round but can be square, rectangu- In the above embodiments, a particular method of pairing
lar, hexagonal, oval, polygonal in shape etc. there can be more the peripheral device with the base node has been described.
than one actuator on one base. Any of the embodiments of the present invention may include
The length of the flexible data and power connection, e.g. 30 other pairing mechanisms of which some examples are given
cable is preferably adapted to place the peripheral device below.
(when in its connected in its operating position), especially Some examples for pairing
the base and the actuator, in the region between the boundary Plug in the peripheral device, to a generic peripheral
of the connected user processing device and the ergonomic device port such as a USB port of the base node or
boundary as defined above. In addition the flexible data and 35 other USB enabled device. Pairing info is transmitted
power connection should be adapted so that the base lies flat over the generic peripheral interface such as USB.
on the meeting table independent of the orientation of the The Signal strength of the wireless channel to the base
connector needed to insert the connector into the plug and node is used to identify which base nod is to be used
play interface. The flexible data and power connection can be The Signal strength of the wireless charmel or any other
a cable that is firmly fixed to and integrated into the base. 40 charmel. Example is an NFC/RFID transmitter can be
Alternatively the flexible data and power connection can be a provided underneath the meeting room table. Putting
separate cable that connectors to a suitable connector in the the user processing device such as a laptop and the
base, e.g. a USB connector. peripheral device plugged in on this table automati-
The base preferably includes electronics such as having cally pairs the peripheral device with the base of this
permanent storage for storing the portable application and the 45 meeting room
network configuration parameters, memory, a processing Manual pairing (e.g. by entering IP address, hostname,
engine (e.g. CPU, FPGA), a wireless transmitter/receiver wireless ID (like SSID on WiFi))
such as for WiFi, a plug and play interface such as a USB What is claimed is:
interface, a LED ring as visual indicator. The portable appli- 1. An electronic meeting tool for communicating arbitrary
cation can be stored on the peripheral device, i.e. in the base. 50 media content from users at a meeting comprising:
The visual indicator is for allowing user feedback from the a node configuration arranged to operate a display node of
connection unit of the status of any activity. a communications network, the display node being
Some examples for activation of the actuator which can be coupled to a first display, the node configuration further
used with any of the embodiments of the present inven- being arranged to receive user selected arbitrary media
tion: 55 content and to control display of the user selected arbi-
Sound activated (hand clap, voice recognition, computer trary media content on the first display;
sound, music, ... ) at least one peripheral device configured to communicate
Remote controlled via wireless connected device (IR, the user selected arbitrary media content via the com-
Bluetooth, WiFi, ... ) munications network, wherein the peripheral device is a
Light activated 60 connection unit comprising:
Pressure activated, e.g. depression with a finger or hand. (a) a connector arranged to couple to a port of a process-
Touch activated ing device having a second display, a memory and an
Proximity ('near-touch' on the actuator or bringing the operating system; and
actuator close to some object (b) a transmitter arranged to communicate with the com-
Biometric reader such as Fingerprint reader, Iris scan- 65 munications network,
ner, DNA analyser a program configured to be loaded onto the processing
Keypad, e.g. for entering Keycode e.g. a password device and to run on the operating system of the process-
US 8,756,348 B2
27 28
ing device, said program being arranged to obtain user 12. A method for communicating arbitrary media content
selected arbitrary media content, said program leaving a from users at a meeting comprising:
zero footprint on termination, and operating a display node of a communications network the
an input device enabling the user to carry out a user action display node being coupled to a first display, to rec~ive
that triggers transfer of said user selected arbitrary 5
user selected arbitrary media content and to control dis-
play of the user selected arbitrary media content on the
media content to said transmitter through said port.
first display; and
2. The electronic meeting tool of claim 1, wherein the connecting a peripheral device to a port of a processing
program is stored on the peripheral device. device and communicating the user selected arbitrary
3. The electronic meeting tool of claim 1, wherein the media content via the communications network
10
transmitter is a wireless transmitter or transceiver. loading a program onto the processing device and ~nning
4. The electronic meeting tool of claim 1, wherein the the program on the operating system of the processing
peripheral device is a plug-and-play device. device to obtain user selected arbitrary media content
5. The electronic meeting tool of claim 1, wherein the said program leaving a zero footprint on termination'
and '
program is arranged to screen scrape content of the second 15
display. triggering transfer of said user selected arbitrary media
6. The electronic meeting tool claim 1, wherein the input
content to said transmitter through said port after a user
device is physical actuator coupled to the peripheral device. action on an input device.
7. The electronic meeting tool of claim 6, wherein the
13. The method of claim 12, further comprising configur-
physical actuator has a surface area of between 100 and ing the peripheral device to connect to the communications
20 network by pairing the peripheral device with the display
14,400 square mm.
8. The electronic meeting tool of claim 1, wherein the input
node.
device is a key displayed on the second display. 14. The method of claim 13, wherein the pairing is per-
. 9. The electronic meeting tool of claim 8, wherein the key
formed by plugging the peripheral device into the display
displayed on the second display is not screen scraped by the node.
25 15. The method of claim 12, further comprising setting up
program.
10. The electronic meeting tool of claim 1, wherein the
by means of a pre-installed generic driver of the operating
peripheral device comprises a memory in which executable system, a means for communication between the peripheral
software code is stored for execution on the processing device and the processing device.
device, said executable software code comprising: 16. The method of claim 12, wherein a pre-installed
30 generic driver is selected from a human interface device
a first software code portion for setting up, by means of a
pre-installed generic driver of the operating system, a driver and a mass storage device driver.
means for communication between the peripheral 17. The method of claim 12, further comprising one of:
device and the processing device; presenting the peripheral device to the processing device as
a second software code portion for connecting the process- a human interface device,
35 presenting the peripheral device to the processing device as
ing device to the communications network via the
peripheral device, the peripheral device having a trans- a mass storage device; and
ceiver; presenting the peripheral device to the processing device as
a third software code portion for screen scraping data from a composite device.
the processing device; and 18. The method of claim 12, wherein the program is stored
40 on the peripheral device, and which obtains screen scraped
a fourth software code for routing screen scraped data
between the processing device and the communications data when run on the processing device.
network over the means for communication; wherein the 19. The method of claim 17, wherein a generic communi-
first software code portion is adapted to use a generic cation protocol is used for transferring screen scraped data
communication protocol for transferring the screen between the processing device and the peripheral device.
45 20. The method of claim 12 further comprising displaying
scraped data between the processing device and the
peripheral device. the user selected arbitrary media content on the first display in
11. A non-transitory storage medium storing the first to
accordance with a set of rules.
fourth software code portion of claim 10. * * * * *
Exhibit 2
I 1111111111111111 11111 1111111111 111111111111111 IIIII IIIII IIIIII IIII IIII IIII
US009083769B2
c12) United States Patent (10) Patent No.: US 9,083,769 B2

Beel et al. (45) Date of Patent: Jul. 14, 2015
(54) ELECTRONIC TOOL AND METHODS FOR (58) Field of Classification Search
MEETINGS None
See application file for complete search history.
(71) Applicant: BARCO N.V., Kortrijk (BE)
(56) References Cited
(72) Inventors: Koen Simon Herman Beel, Eke (BE);
Yoav Nir, Kamen (BE); Filip Josephine U.S. PATENT DOCUMENTS
Johan Louwet, Knesselare (BE); Guy
Coen, Aalst (BE) 6,966,035 Bl 11/2005 Suess et al.
8,316,138 B2 11/2012 Chang
(73) Assignee: BARCO N.V., Kortrijk (BE) (Continued)
( *) Notice: Subject to any disclaimer, the term ofthis FOREIGN PATENT DOCUMENTS
patent is extended or adjusted under 35
U.S.C. 154(b) by O days. EP 1187480 Al 3/2002
EP 1246395 Al 10/2002
WO 00/52887 Al 9/2000
(21) Appl. No.: 14/212,170
OTHER PUBLICATIONS
(22) Filed: Mar. 14, 2014
Martin Trautschold, iPhone 4 Made Simple, 2010, Apress, pp. 1-819.
(65) Prior Publication Data (Continued)
US 2014/0201400Al Jul. 17, 2014
Primary Examiner - Scott Sun
Related U.S. Application Data
(74) Attorney, Agent, or Firm - Bacon & Thomas, PLLC
(63) Continuation-in-part of application No. 13/270,659,
filed on Oct. 11, 2011, now Pat. No. 8,756,348, and a (57) ABSTRACT
continuation-in-part of application No. An electronic meeting tool and method for communicating
PCT/EP2012/068166, filed on Sep. 14, 2012, and a arbitrary media content from users at a meeting comprises a
(Continued) node configuration means adapted to operate a display node
of a communications network, the display node being
(51) Int. Cl. coupled to a first display. The node configuration means is
G06F 3/06 (2006.01) adapted to receive user selected arbitrary media content and
H04L29/06 (2006.01) to control display of the user selected arbitrary media content
G06F 13/38 (2006.01) on the first display. A peripheral device adapted to commu-
nicate the user selected arbitrary media content via the com-
(Continued)
munications network is a connection unit comprising a con-
(52) U.S. Cl. nector adapted to couple to a port of a processing device
CPC ................ H04L 65/403 (2013.01); G06F 9/00 having a second display, a memory and an operating system,
(2013.01); G06F 13/14 (2013.01); G06F and a transmitter. A program is adapted to obtain user selected
13/385 (2013.01); H04L 1211813 (2013.01); arbitrary media content, said program leaving a zero footprint
H04L 51100 (2013.01); H04L 65/00 (2013.01); on termination. The user may trigger a transfer of said user
H04L 65/4023 (2013.01); H04L 65/4038 selected arbitrary media content to said transmitter.
(2013.01); H04M 3/567 (2013.01); H04N 5100
(2013.01) 22 Claims, 5 Drawing Sheets

transceiver
Actuator and
Button input device

Visual
indicator
application
..,._ Flexible connection for data

signals and power
- - - USB device interface

US 9,083,769 B2
Page 2
Related U.S. Application Data 2009/0198839 Al 8/2009 Banerjee et al.

2010/0087139 Al 4/2010 Glass
continuation of application No. 13/270,659, filed on 2010/0302130 Al 12/2010 Kikuchi et al.
Oct. 11, 2011, now Pat. No. 8,756,348. 2011/0115689 Al 5/2011 Sugiyama et al.
2012/0331509 Al* 12/2012 Laksono ......................... 725/56
(60) Provisional application No. 61/534,592, filed on Sep. 2013/0050254 Al 2/2013 Tran et al.
14, 2011, provisional application No. 61/235,219, 2013/0067121 Al 3/2013 Beel et al.
filed on Apr. 18, 2012, provisional application No. OTHER PUBLICATIONS
61/534,592, filed on Sep. 14, 2011.
International Search Report (ISR) dated Mar. 6, 2013, for PCT/
(51) Int. Cl. EP2012/068166.
G06F 13/14 (2006.01) International Search Report (ISR) dated Mar. 19, 2013, for PCT/
H04L 12118 (2006.01) EP2012/068167.
H04M3/56 (2006.01) International Search Report (ISR) dated Mar. 4, 2013, for PCT/
G06F 9/00 (2006.01) EP2012/068168.
H04L 12158 (2006.01) International Search Report (ISR) dated Jan. 28, 2013, for PCT/
EP2012/068169.
H04N5/00 (2011.01)
British Search Report dated Aug. 28, 2012, for GB 1206841.7.
G06F 5100 (2006.01) German Search Report dated Nov. 17, 2011, for DE 102011055443.
G06F 13/00 (2006.01) 2.
Jiang et al., "Free Speech: A Novel Wireless Approach for Confer-
(56) References Cited ence Projecting and Cooperating", Lecture Notes in Computer Sci-
ence, vol. 4159, pp. 688-697, 2006. (cited in GB 1206841.7 Search
U.S. PATENT DOCUMENTS Report).
International Preliminary Report on Patentability (IPRP) dated Mar.
2002/0196378 Al 12/2002 Slobodin et al. 27, 2014, for PCT/EP2012/068166.
2004/0263636 Al 12/2004 Cutler et al.
International Preliminary Report on Patentability (IPRP) dated Mar.
2005/0036509 Al 2/2005 Acharya et al.
27, 2014, for PCT/EP2012/068167.
2006/0031779 Al 2/2006 Theurer et al.
2006/0095376 Al 5/2006 Mitchell et al. International Preliminary Report on Patentability (IPRP) dated Mar.
2007/0005809 Al 1/2007 Kobayashi et al. 27, 2014, for PCT/EP2012/068168.
2007/0244970 Al 10/2007 Watanabe et al.
2009/0046139 Al 2/2009 Cutler et al. * cited by examiner
U.S. Patent Jul. 14, 2015 Sheet 1 of 5 US 9,083,769 B2
30
f
. . . . . . . . . . . . . . . . . . . . . . . . . . ______. . n . ca111cr.:1 ................................................. ..
51 40 ~
/ 31 37
39
38 37
3.8
iv1ccting Table
i
Lapel
42
LMkmpho,,, ( ( \ \
50
44 45 52~
'····LJ·······[1~ ! 36 49
Display \Vhiteboard
... Fig. la
43
64
60
Portable Input
48 62 Base node
application Device Program
31 Client
Connector Display/
Processing
Unit Projector
Device
Visual 61
Indicator 63 36 44
Fig. lb
0
Canvas s howin19
i nsllu c!ions
fN the S~'5t~m
Fig. 2
1 Base
_
---(20)
GUI
.... .... Unit
B
Base node
Software
Fig. 3
Dongle
,~
Mass (
8 ') ,---------4 g
Storage - , Butto?i-''
~\l~~oe '26 )
.
'wi
I LED ('..___..,]
Fig. 4
I .-r-. I /....--..~
1 GUI ( 18) 1 - ( 17 )
I ,____, 1 ICO n -.,_,
/ Run-time exerution ---. \

1 context dient sofmare ,,--,.....\
~ (RAM (25 I
..... --
- - - - - - - - - - --- ... ,___~-~
Fig. 5
@
Canvas soo,~ing
instructions
fm ihesystem
Fig. 6
,.......~~~~~-.............,."•___...~.....-~~~-~-............,
.....
· USB USB stick
) interface
Mass (
8
Storage ·
Fig.7
-,.........-~~-~~-;;c,F-'"~~~~~~........,
. -- ._..~
1JlliFi
Client operating device 1/F
1' Run-time exerution ',

1 mntext dient software ,,.....,
____________
' .... (RAM {25)
__....____...,
Fig. 8
WiFi
Client operating device 1/F
1
GUI (w')
-~
:1 .icon {17)
...____
------ ------
_, Run-time execution ..__,
1 Portable
1 context dient software r>
\ (RAM 1_25)
-- - - - - - - - - - - ___ ...___....
Fig. 9

transceiver
Actuator and
Button input device

Visual
indicator
application
Flexible connection for data

signals and power
USB device interface
Fig. 10
US 9,083,769 B2
1 2
ELECTRONIC TOOL AND METHODS FOR the projects on which they are collaborating or communicat-
MEETINGS ing. Studies of business processes also reveal that approxi-
mately 80% of the "workload" associated with a project or
CROSS REFERENCE process happens in preparation for a meeting. In other words,
5 many people view the "live" meeting as a milestone or dead-
This application is a continuation-in-part application line by which they can pace and measure their productivity
claiming the benefit of U.S. patent application Ser. No. and that of their colleagues. Unfortunately, for many infor-
13/270,659, filed Oct. 11, 2011, which claims the benefit of mation managers, being in perpetual meetings has reduced
U.S. provisional application 61/534,592, filed Sep. 14, 2011, their ability to prepare adequately for the next meeting, per-
and this application is a continuation-in-part application 10 petuating a vicious and negative cycle.
claiming the benefit of PCT application PCT/EP2012/ However, Marc Al-Hames et al. report in "Audio-Visual
068166, filed Sep. 14, 2012, which claims the benefit of U.S. Processing in Meetings: Seven Questions and Current AMI
provisional application 61/534,592, filed Sep. 14, 2011, U.S. Answers", that although large parts of working days are con-
patent application Ser. No. 13/270,659, filed Oct. 11, 2011, sumed by meetings and conferences, unfortunately a lot of
and U.S. provisional application 61/635,219, filed Apr. 18, 15 them are neither efficient, nor especially successful. They
2012, the entirety of said applications being incorporated report a study in which people were asked to select emotion
herein by reference. terms that they thought would be frequently experienced in a
The present invention relates to electronic tools for meet- meeting. The top answer-mentioned from more than two
ings including methods or devices for providing connection third of the participants-was "boring"; furthermore nearly
to a communications network, to networks or methods of 20 one third mentioned "annoyed" as a frequently perceived
operating the network, methods or devices for use in display- emotion.
ing media content as well as software for performing any of The conclusion is that despite the plethora of electronic
these methods. aids to meetings, fundamental problems in handling meetings
have not been solved. In fact organising and conducting meet-
TECHNICAL BACKGROUND 25 ings in a business context involves a large number of factors.
Participation
Tools for Collaboration A lack of efficiency of meetings is addressed in the article
Allowing ad hoc groups of persons to communicate with "Mood indicators on electronic meeting tools" IBM, IP.com
each other is one of the fundamental aspects of collaboration, number: IPCOMOOOOI 171 ID, Publication Date: Mar. 12,
problem solving, negotiation, teaching and education, etc. To 30 2003. This article addresses the issue that the lack of direct
assist in communication, there has been an explosion of elec- feedback makes meetings clumsy, inefficient and often
tronic communication tools such as electronic conferencing unproductive. It proposes a "mood indicator" as well as an "I
tools, e.g. synchronous and asynchronous conferencing, want to ask a question" indicator which allow the presenter to
online chat, Instant Messaging, audio conferencing, video- choose an appropriate moment to pause, change track or field
conferencing, data conferencing, application sharing, remote 35 a question. It is argued that interrupting a presenter in full flow
desktop sharing, electronic meeting systems, collaborative can be awkward; however, sometimes it is difficult to get an
management (coordination) tools, project management sys- opportunity to ask a question or make a comment when many
tems, knowledge management systems, and social software different people are trying to make their voices heard. In a
systems. similar vein, U.S. Pat. No. 6,966,035 suggests displaying a
One classic approach is the lecture or seminar often involv- 40 "murmur frame" for a participant to express a view. To
ing a presentation using presentation software. To a large increase user participation, US 2010/0087139 discloses a
extent the traditional single person presentation or lecture has system for sending a selection to another computer, and US
been maintained with the audience being in a rather passive 2006/0095376 discloses a system for secure voting.
mode as far as determining, constructing, augmenting or Commenting, voting or selecting requires that a central
modifying the information to be presented is concerned. 45 authority provides the information that is to be selected or
As with other business processes, meetings are going digi- commented or voted on. Hence, these proposals still leave a
tal. Increasingly, people are using computer technology alone central figure such as the presenter in a dominating position
and in conjunction with broadband networks to support their and the other members of the meeting are largely an audience
meeting objectives prior to and during an actual meeting. For with limited selection or voting or participation rights.
example, e-mail is used to pass around files for people to read 50 A further problem with meetings is that someone is usually
prior to a meeting. late or has to leave early. With the person arriving late one has
Collaborative workspaces in corporate networks and on the to decide if the meeting is interrupted and a summary of the
Internet offer geographically distributed collaborators a vir- proceedings so faris given. For the person leaving early (often
tual repository for documents related to a project or a meet- a senior person), subsequent discussions can go missing. If
ing. Electronic meeting support systems, such as interactive 55 there is a notes taker, this provides a personal summary of the
network-connected white boards and videoconferencing meeting-but not an objective one.
appliances, are available for the benefit of those who share the Presents systems do not provide an optimal solution.
same room as well as those who are in remote locations. Legal and Security Issues
The AMIDA Final Public Report describes the overall A legal requirement of a meeting is that presentations,
methodology behind the development of meeting support 60 comments and submissions need to be completely reproduc-
technologies. It reports that numerous studies confirm that ible-in some circumstances, e.g. in a share holders' meet-
meetings dominate the way people work. Namely, according ing, the events in the meeting should be subject to total recall.
to a study conducted by MCI Worldcom in 2003 a business Computer-supported collaborative work technologies, par-
person participates in 60 meetings per month. People meet in ticularly those which capture human verbal and non-verbal
groups for a multitude of reasons. They interact in numerous 65 communications (audio and video interaction) in addition to
predictable and unpredictable ways and the results of their text and graphics generated during a meeting, promise to have
interactions are as varied as the people who participate and a long term impact on how people will prepare for and behave
US 9,083,769 B2
3 4
during and following meetings. In addition, connecting to a cated and if this is not done correctly, telecommunication
network brings the danger of virus, malware or spyware trans- software that has to pass through a firewall may be blocked. In
fer in either direction, and there is danger of copying of order to solve problems associated with firewalls it may be
confidential information. necessary to open ports or identify or even add programs in an
Practical Difficulties 5 exception list. If, besides a network (hardware) firewall and
Scalability and Ease of Use an operating system firewall, there is any software based
There are even more fundamental problems with using third-party firewall like Zonealarm, CA Internet Security
electronic tools in meetings. If two persons want to make two Suite or McAfee Firewall, then it is necessary to follow that
presentations then usually either both presentations must be software developer's documentation to place programs on a
placed on one machine or there is a need to swap between the 10 safe list or adding exceptions to the firewall rules. Such activ-
presenters' machines. To bring the display content of a com- ity is beyond the usual user. Fussing with computer settings,
puter to a projector, the most common ways are to use a cable or having to call for IT support wastes valuable meeting time
that connects the display adapter of the graphics card to the and takes the dynamism out of the meeting.
video input of the projector [method 1] or to use a software The advantage of method 3 is that the computer does not
that captures the display contents and sends it over a wired or 15 need to use its own processing power to bring the display
wireless network to a remote base unit connected to the pro- content in a form that is easily transported over a network.
jector [method 2]. This is often called "remote desktop" and This advantage becomes less relevant as computers grow in
is mostly used for remote administration or remote IT assis- processing power. A drawback of method 3 is that the same
tance purposes. problems often encountered with method 1 of connecting to
Less common but also practiced methods are to use a special 20 the display adapter remain. Another drawback is that the
device connected to the display adapter of the graphics card, special device referred to requires significant processing
that captures, encodes and streams the display content over a power, which means that this device will consume much
wired or wireless network [method 3]. Method 1 has several power and will require a separate power supply, be relatively
practical problems and disadvantages. In meetings where big and certainly be relatively expensive.
people want to contribute content from their own computers, 25 An alternative method in the making today is to use the
e.g. to project images on a display, typically a video cable well-known USB interface of the computer for extracting the
such as a VGA cable is used to connect each PC one at a time display content of the computer. US 2009/0198839 discloses
to the projector. This is not only not scalable but also can be such a pluggable cable arrangement. US 2011/0115689 dis-
and often is quite a cumbersome process that typically wastes closes a similar USB solution for wireless connection to a
valuable meeting time and takes the dynamism out of the 30 projector. Accordingly connecting a projector to a computer
meeting. Connection can be made more difficult and time using the standard USB port might become commonplace
consuming for example if the computer has to be rebooted for with time. However, this usually requires special drivers and
it to detect the projector or when the format of the PC differs even special hardware in the computer. Connecting a projec-
from the format of the projector. In addition changing format tor to a computer using the standard USB port hence might
can leave the computer with a new format that is not compat- 35 become commonplace-but even when that happens there
ible with its own screen so that on reboot of the PC alone, will be a mix of new and legacy machines for several years.
nothing is displayed on the computer screen. Without a vis- Conclusion
ible screen image the necessary re-configuration can be dif- The following problems remain for holding a face-to-face
ficult. These issues are aggravated by a number of elements: meeting using advanced electronic tools at the present time:
The use of many different video adapters, such as VGA, 40 Complexity of the networking infrastructure.
DVI-A, DVI-D, DVI-I. DP, HDMI, thunderbolt, ... High demands on technical expertise of users in current
Reach depends on cable length: too long leaves a tangled systems that are supposed to be designed to support
cable "salad" in the meeting room, too short reduces everyday use by the non-expert user.
flexibility, often necessitating people to move around in Barriers to the use of complicated technology in meetings.
the meeting room when they want to present something. 45 Great variety of possible collaborative software solu-
Cable connection is either point to point or requires tedious tions-none of which seems to solve the fundamental
and extensive cabling and the use of complex and expen- problems of holding successful meetings.
sive video switches. Meetings being boring or annoying for members of the
It is often difficult and time consuming to find the right meeting.
display resolution and refresh rate that both the com- 50 Complexity of firewalls and other security measures
puter and the display or projector support. employed in corporate networks.
Known technical solutions are expensive and not 100% Lack of, or restriction of participation by members of a
reliable. Method 2 also has many drawbacks. If the connec- meeting.
tion is made to a corporate LAN there is a danger of virus, Time taken to prepare presentations for meetings.
malware or spyware transfer in either direction, there is dan- 55 Need to record events in the proper time sequence at meet-
ger of copying of confidential information, and there is the ings without burdening a meeting more than necessary.
difficulty of making the connection, e.g. entry of a user code Although some tools solve some of these problems effec-
and password, as well the administration of such passwords tively, no electronic meeting tool solves all of them.
and user codes. In business contexts, visitors to meeting
rooms typically do find technical difficulty with such means 60 SUMMARY OF THE INVENTION
to connect to a central projector or display in the meeting
room. An object of the present invention is to provide network
Additional problems can occur with firewalls and proxies. solutions including electronic tools for meetings as well as
Typically a visitor to a meeting will bring a computer such as devices for providing connection to a communications net-
a laptop that is set up for a different corporate networking 65 work, to methods of operating the network, methods of dis-
environment and hence has different or incompatible net- playing media content as well as software for performing any
working settings. The setting up of a firewall can be compli- of these methods or for implementing such systems. There is
US 9,083,769 B2
5 6
also a need to capture what is actually shown or said in a e.g. an LED ring, for streaming the screen scraped video
meeting and not merely what might have been shown or said. content to the network and hence to a base unit and a
An aspect the present invention provides an electronic display,
meeting tool for communicating arbitrary media content from A mass storage device used to store the application,
users at a meeting comprising: a node configuration means 5 An audio device that acts as a virtual sound card to a client
adapted to operate a display node of a communications net- PC over USB, using a generic driver such as a UACl or
work, the display node being coupled to a first display, the UAC2 device driver.
node configuration means being adapted to receive user Embodiments of the present invention are not limited to
selected arbitrary media content and to control display of the application sharing but make use of screen scraping which is
10 able to capture all material in a neutral manner rather than
user selected arbitrary media content on the first display; and
being limited by proprietary applications. Further the screen
at least one peripheral device adapted to communicate the
scraper application is zero footprint on termination rather
user selected arbitrary media content via the communications
than being fully installed on the processing device. Embodi-
network, wherein the peripheral device is a connection unit ments of the present invention can provide arbitrary "full
comprising: 15 content" to the meeting room and participants can display in
(a) a connector adapted to couple to a port of a processing real-time,
device having a second display, a memory and an oper- The real-time content is shown on a central display rather
ating system: and than being broadcast to individual participants or archived.
(b) a transmitter for communicating with the communica- Embodiments of the present invention "auto compose"
tions network, a program adapted to be loaded onto the 20 arbitrary user data on a central display or screen so that full
processing device and to run on the operating system of real-time content that is provided by multiple meeting par-
the processing device, said program being adapted to ticipants who intentionally share this content in order to make
obtain user selected arbitrary media content, said pro- the meeting more effective and efficient,
gram leaving a zero footprint on termination, and an Embodiments of the present invention implement a prin-
input device to allow the user to carry out a user action 25 ciple of "democratic screen sharing", in which the meeting
that triggers transfer of said user selected arbitrary participants decide themselves on a peer-to-peer basis which
media content to said transmitter through said port. content to share when and where. In particular in some
Obtaining user selected arbitrary media content is prefer- embodiments a participant can obtain unilateral access to the
ably not obtained by application sharing but by the process of display device, i.e. without agreement of other participants.
screen scrapping. Although software packages that provide 30 Peer-to-peer data sharing differs from systems in which the
screen scraping require installation on the target device, or at content to be displayed is determined by a presenter or meet-
least require the installation of dedicated and/or custom driv- ing director. The user determines where his content is routed
ers, embodiments of the present invention use software stored to, and can do so without any software configuration on the
on the peripheral device which allows screen scraping when user processing device.
run on the processing device but leaves a zero footprint when 35 Another aspect the present invention provides a method for
terminated. Embodiments of the present invention can screen connecting a processing device to a communications net-
scrape full HD videos at 20 fps without requiring any instal- work, the processing device having a memory, a display and
lation of a program on the processing device nor requiring an operating system with at least one pre-installed generic
configuring the processing device such as a PC that they run driver providing a generic communications protocol for com-
on for the connectivity to the network hence meeting "zero 40 munication between processing device and a standard class of
footprint" requirements. peripheral devices, the method comprising the steps of:
The program adapted to be loaded onto the processing a) coupling a peripheral device to the processing device, the
device and to run on the operating system of the processing peripheral device having a transceiver;
device and being adapted to obtain user selected arbitrary b) setting up, by means of the pre-installed generic driver of
media content can be stored on the peripheral device. The 45 the operating system, a means for communication between
transmitter can be a wireless transmitter or transceiver. The the peripheral device and the processing device;
peripheral device can be a plug-and-play device. The program c) coupling the processing device to a communications net-
can be adapted to screen scrape content of the second display. work via the peripheral device;
The input device can be physical actuator coupled to the d) routing screen scraped data between the processing device
peripheral device. The physical actuator preferably has a 50 and the communication network via the means for com-
surface area of between 100 and 14,400 square mm. Alterna- munication, wherein the generic communication protocol
tively, the input device can be a key displayed on the second is used for transferring the screen scraped data between the
display. The key displayed on the second display can be one processing device and the peripheral device.
not screen scraped by the program. The routing of the screen scraped data can be to a defined
On the peripheral device a mass storage device is provided 55 network node such as a display node without user entry of
that stores the software to be run on the processing device. configuration details. Thus the routing can be dedicated to a
The mass storage device can be logically closed once the specific network node such as a display node, base station etc.
software has been read and loaded and is running from RAM This is achieved by pairing of the peripheral device to the
in the processing device. Also provided on the peripheral relevant node before the communication starts.
device is a further device such as an HID (human interface 60 In accordance with embodiments of the present invention
device) to capture user input and provide user feedback. In users start an application from the peripheral device such as a
embodiments of the present invention, the peripheral device USB dongle, thus making the connection in a 3 step process:
contains multiple internal logical devices that are combined: (1) connect, e.g. plug in the peripheral device to the process-
An HID (human interface device) used for capturing user ing device, (2) start the screen scraping application, (3) per-
input (e.g. following a user action such as pressing or 65 form a user action such as click on a button on the peripheral
activating a button) and providing user feedback, e.g. by device to go allow content to be displayed on the central
an optical indicator such as a light ring around the button screen or display. To achieve step 2 Autorun or AutoPlay can
US 9,083,769 B2
7 8
be used with some Windows operating systems, but there are interface device and wherein the pre-installed generic driver
many different variants based on the OS version and which is a human interface device driver. The first software code
patches have been installed. Furthermore, this mechanism is portion can be adapted to present the peripheral device to the
generally considered a security hazard, which is why most IT processing device as a mass storage device and wherein the
departments will disable Autorun/Autoplay. Other OS pro- 5 pre-installed generic driver is a mass storage device driver.
viders have disabled this function, e.g. Apple removed a simi- The first software code portion can be adapted to present the
lar functionality entirely from its OS/X since Snow Leopard. peripheral device to the processing device as a composite
In an embodiment of the present invention a very small ser- device and wherein pre-installed generic drivers drive differ-
vice-also called daemon on some OS's-is provided that ent device interfaces independently.
requires installation on the processing device such as a laptop. 1o The executable software code can comprise fifth code for
This service is pre-installed on the processing device. The providing a means for connecting to the communications
installation is required only once on every processing device network including a base node. The third code can be for
such as a laptop. The role ofthis is to provide a permanently providing means for capturing video frame buffers of the
running service that continuously monitors if a peripheral processing device.
device according to the present invention has been offered up 15 The executable software code can comprise sixth code for
for connection to the processing device. When such a periph- providing a means for encoding, compressing and optionally
eral device is connected, the service will detect this and start encrypting the screen scraped data and sending the screen
the client application software residing in the mass storage scraped data the communication network. The executable
area of the peripheral device. Once the service is installed, software code can comprise seventh code for providing a
connectivity with the peripheral device becomes a 2 step 20 means for handling the peripheral device. The executable
process: connect, e.g. plug in the peripheral device to the software code can comprise eighth code for providing means
processing device, and (2) perform a user action such as click for initiating connection to the base node. The executable
on a button on the peripheral device to allow content to be software code can comprise ninth code for receiving inputs
displayed on the central screen or display. The application from an input device on the peripheral device. The executable
loaded from the processing device still leaves a zero footprint 25 software code can comprise tenth code for providing a means
on termination for sending state changes to the visual indicator on the periph-
Step b) can comprise presenting the peripheral device to eral device. The executable software code can comprise elev-
the processing device as a human interface device and enth code for providing a means for sending state changes to
wherein the pre-installed generic driver is a human interface the visual indicator on the peripheral device. The executable
device driver. Alternatively or additionally step b) can com- 30 software code can comprise twelfth code for providing a
prise presenting the peripheral device to the processing means for presenting to the user a GUI. The executable soft-
device as a mass storage device and wherein the pre-installed ware code can comprise thirteenth code for presenting a GUI
generic driver is a mass storage device driver. for administration of the said executable software code when
Alternatively, or additionally step b) comprises presenting executed as a portable application. The executable software
the peripheral device to the processing device as a composite 35 code can comprise fourteenth code for providing a means for
device and wherein pre-installed generic drivers drive differ- displaying and activating a key on the display of the client
ent device interfaces independently. processing device for allowing a user to input the start the
A client application can be stored on the peripheral device transfer of data from the processing device to the base node.
which when run on the processing device obtains the screen In another aspect the present invention provides a periph-
scraped data. Such a client application can be a portable 40 eral device for providing communication connectivity to a
application and can leave a zero footprint on termination. processing device which is provided with memory, a display
In another aspect the present invention provides a periph- and an operating system with at least one pre-installed
eral device for providing communication connectivity to a generic driver providing a generic communication protocol
processing device which is provided with memory, a display for communication between the processing device and a stan-
and an operating system with at least one pre-installed 45 dard class of peripheral devices, the peripheral device com-
generic driver providing a generic communication protocol prising a memory in which executable software code is stored
for communication between the processing device and a stan- for execution on the processing device, said executable soft-
dard class of peripheral devices, the peripheral device com- ware code comprising:
prising a memory in which executable software code is stored a first software code portion for setting up, by means of the
for execution on the processing device, said executable soft- 50 pre-installed generic driver of the operating system, a
ware code comprising: a first software code portion for setting means for communication between the peripheral device
up, by means of the pre-installed generic driver of the oper- and the processing device;
ating system, a means for communication between the a second software code portion for connecting the processing
peripheral device and the processing device; device to a communications network via the peripheral
a second software code portion for connecting the processing 55 device, the peripheral device having a transceiver; and
device to a communications network via the peripheral a third processing software code for routing data between the
device, the peripheral device having a transceiver; processing device and the communications network over
a third software code portion for screen scraping data from the the means for communication; wherein the first software
processing device; and a fourth software code for routing code portion is adapted to use the generic communication
screen scraped data between the processing device and the 60 protocol for transferring the data between the processing
communications network over the means for communica- device and the peripheral device, and an input device
tion; wherein the first software code portion is adapted to coupled to the peripheral device, the input device being
use the generic communication protocol for transferring adapted to react to a user action to trigger the transfer of the
the screen scraped data between the processing device and data from the processing device to the peripheral device.
the peripheral device. 65 The first software code portion can be adapted to present
The first software code portion can be adapted to present the peripheral device to the processing device as a human
the peripheral device to the processing device as a human interface device and wherein the pre-installed generic driver
US 9,083,769 B2
9 10
is a human interface device driver. The first software code means for a GUI for administration purposes. The executable
portion can be adapted to present the peripheral device to the software code can comprise seventh code for providing a
processing device as a mass storage device and wherein the means for publishing its presence over the network using the
pre-installed generic driver is a mass storage device driver. zeroconf protocol. The executable software code can com-
The first software code portion can be adapted to present the 5 prise eighth code for providing a means for accepting and
peripheral device to the processing device as a composite installing software updates. The executable software code can
device and wherein pre-installed generic drivers drive differ- comprise ninth code for providing a means for providing
ent device interfaces independently. facilities for pairing of connection units to the processing
The input device is preferably a physical actuator coupled device. The executable software code can comprise tenth
to the peripheral device. The physical actuator preferably has 10 code for providing a means for auto-composing of different
a surface area of between 100 and 14,400 square mm. The incoming arbitrary media streams and rendering of compos-
input device can be for example a key for display on the ited image on display. The executable software code can
display. The executable software code can comprise fourth comprise eleventh code for providing a means for receiving,
code for providing a means for connecting to the communi- decrypting and decoding incoming arbitrary media content.
cations network including a base node. The executable soft- 15 The executable software code can comprise twelfth code for
ware code can comprise fifth code for providing a means for scaling of incoming arbitrary media streams. The executable
capturing video frame buffers of the processing device. The software code can comprise thirteenth code for providing a
executable software code can comprise sixth code for provid- means for displaying incoming arbitrary media content in
ing a means for encoding, compressing and optionally accordance with a set of rules.
encrypting the video frames and sending them over a secure 20 The present invention also provides a method for commu-
link to the base node. The executable software code can nicating arbitrary media content from users at a meeting
comprise seventh code for providing a means for handling the comprising:
peripheral device. The executable software code can com- operating a display node of a communications network, the
prise eighth code for providing a means for initiating connec- display node being coupled to a first display, to receive user
tion to the base node. The executable software code can 25 selected arbitrary media content and to control display of
comprises ninth code for receive inputs from an input device the user selected arbitrary media content on the first dis-
on the peripheral device. The executable software code can play; and connecting a peripheral device to a port of a
comprise tenth code for providing a means for sending state processing device and communicating the user selected
changes to the visual indicator on the peripheral device. The arbitrary media content via the communications network,
executable software code can comprise eleventh code for 30 loading a program onto the processing device and running the
providing a means for presenting the user a GUI. The execut- program on the operating system of the processing device
able software code can comprise twelfth code for presenting to obtain user selected arbitrary media content, said pro-
GUI for administration of the executable software code when gram leaving a zero footprint on termination, and trigger-
executed as a portable application. The executable software ing transfer of said user selected arbitrary media content to
code can comprise thirteenth code for providing a means for 35 said transmitter through said port after a user action on an
displaying and activating a key on the display of the process- input device. The present invention also provides a periph-
ing device for allowing a user input to start the transfer of data eral device comprising:
from the processing device to the base node. abase
In another aspect of the invention a peripheral device is a connector for connection to a plug and play port of a host
provided for providing communication connectivity to a pro- 40 processing device,
cessing device which is provided with memory, a display and a flexible connection between the base and the connector for
an operating system with at least one pre-installed generic transferring data signals and power,
driver providing a generic communication protocol for com- an actuator on the base for actuating a signal and for trans-
munication between the processing device and a standard ferring the signal to the connector for transfer to the port,
class of peripheral devices, the peripheral device comprising 45 wherein the base has electronics comprising permanent
a memory in which executable software code is stored for storage for storing a portable application, a processing
execution on the processing device, said executable software engine, a transceiver and a visual indicator. The present
code comprising: invention also provides a method for providing communi-
a first software code portion for setting up, by means of the cation connectivity from a processing device,
pre-installed generic driver of the operating system, a 50 setting up a communications network between a base node of
means for communication between the peripheral device the communications network and a peripheral device
and the processing device; coupled to the processing device;
a second software code portion for connecting the processing transferring media content between the processing device and
device to a communications network via the peripheral the peripheral device, transmitting the media content from
device, the peripheral device having a transceiver; 55 the peripheral device to the communications network,
a third software code portion for receiving media content receiving media content from the communications network at
from the network and for displaying the media content on the base node and displaying the media content on a display
the display in accordance with a set of rules; wherein the in accordance with a set of rules.Any of the above software
first software code portion is adapted to use the generic code stored on a non-transitory storage medium.
communication protocol for transferring the media content 60 Definitions
between the peripheral device and the processing device. The term "unilateral electronic access to the display
The executable software code can comprise fourth code for device" by a participant, means that the displaying process is
providing a means for correctly configuring a receiver as an obtained by the act ion of only one participant involved in the
access point. The executable software code can comprise fifth meeting, without requiring the agreement of another or the
code for providing a means for listening for output of con- 65 others. The term "unilateral" implies that the data for display
nection units trying to connect on a specific port. The execut- is allowed to override or replace any data displayed on the
able software code can comprise sixth code for providing a screen by the same or another participant of the meeting.
US 9,083,769 B2
11 12
"Plug and play" is a term used to describe the characteristic the program has exited, and files created by the user can
of a computer bus, or device specification, which facilitates be saved directly to the same removable media as the
the discovery of a hardware component in a system, without application is stored on. A portable application does not
the need for physical device configuration, or user interven- leave its files or settings on the host computer on which
tion in resolving resource conflicts. Plug and play devices can 5 it runs. For example, the application does not write to the
be added to a bus of a computing system (while running or Windows registry or store its configuration files (such as
when shut down), and the newly added device and possibly an INI file) in the user's profile; instead, it stores its
the rest of the computing system is automatically configured configuration files in the program's directory. Another
to make the newly added device work, both from hardware requirement, since file paths will often differ on chang-
and from software perspective. Plug and play interfaces 10 ing computers due to variation in Windows drive letter
include for example (not an exhaustive list): Firewire (IEEE- assignments, is the need for applications to store them in
1394), PCI, Mini PCI, PCI Express, Mini PCI Express, PCM- a relative format. Preferably, such a program does not
CIA, PC Card, Universal Serial Bus (USB), SDIO cards. require a launcher program to copy necessary settings
"Auto-configuration" is the automatic configuration of and files to the host computer when the application starts
devices without manual intervention, without setting any 15 and move them back to the application's directory when
switches or jumpers, and without any need for software con- it closes as this may leave a residue on the hard drive in
figuration. An example of auto-configuring devices: USB case of power failure.
devices. Examples of auto-configuring protocols: DHCP, "Electronic meeting systems" (EMS) need to be distin-
Zeroconf, Bonjour. guished on the one hand from classic groupware, on the other
A plug and play device has auto-configuration software by 20 from web conferencing systems. In reality, there is some
default to make it plug and play. Example: USB devices are overlap between minor features of products of the named
made to be plug and play by including the correct auto- categories. The main difference from groupware is the inten-
configuration software (e.g. host driver, host stack, applica- sity of collaboration. EMS should be distinguished from sys-
tion software). tems with which it is possible to show the contents of an
Autoconfiguration can also refer to a software alone and is 25 individual computer screen on a remote display with multiple
not restricted to a physical device. "Hot swapping and hot users at the same time.
plugging" are terms used to describe the functions of replac- "Groupware" supports collaboration within groups where
ing computer system components without shutting down the the individual contributions remain identifiable. In contrast,
system. More specifically, hot swapping describes replacing EMS enable the group to cooperatively produce a result for
components without significant interruption to the system, 30 which the group is responsible as a whole. In a business
while hot plugging describes the addition of components that process, groupware and electronic meeting systems comple-
would expand the system without significant interruption to ment each other: Groupware supports teams when research-
the operation of the system. A well-known example of this ing and creating documents in the run up to an EMS session
functionality is the Universal Serial Bus (USB) that allows or when implementing the results of such a session. "Web
users to add or remove peripheral components such as a 35 conferencing systems" and "electronic meeting systems"
mouse, keyboard, or printer. Other examples are eSATA, complement each other in the online meeting or workshop:
PCie, Fire Wire, for example. EMS extends the web conferencing system by providing
A "portable application" (portable app ), sometimes also interactive tools for producing and documenting group
called standalone, is a computer software program designed results. On the other hand, "web conferencing systems"
to run without installation on the target machine. This type of 40 complement EMS with the screen sharing and voice confer-
application is stored on a removable storage device such as a encing functionality required in synchronous online meetings
CD. USB flash drive, flash card, or floppy disk-storing its and not present in EMS.
program files, configuration information and data on the stor- "Data conferencing" refers to a communication session
age medium alone. It is a program that can be stored on an among two or more participants sharing computer data in real
electronic device such as a USB flash drive, iPod, memory 45 time. Interaction and presentation devices such as a screen,
card, portable hard drive or other portable electronic device keyboard, mouse, camera, etc. can be shared. It is a term used
and runs on a computer or other processing device coupled to to distinguish from video conferencing and audio conferenc-
the electronic device without making permanent configura- ing. The data can include screen, documents, graphics, draw-
tion changes to the host computer. All such programs have a ings and applications that can be seen by the participants of
zero-footprint, meaning all temporary files, registry entries, 50 the meeting.
and any other changes to the machine exist only while the "Application sharing" is an element of remote access, fall-
program is running. To be considered a portable application, ing under the collaborative software umbrella, that enables
for purpose of this invention, a software program must: two or more users to access a shared application or document
Not require any kind of formal installation onto a comput- from their respective computers simultaneously in real time.
er's permanent storage device to be executed, and can be 55 Generally, the shared application or document will be running
stored on a removable storage device such as USB flash on a host computer, and remote access to the shared content
drive, iPod, memory card, portable hard drive or other will be provided to other users by the host user. Application
portable electronic storage device thus enabling it to be sharing should be distinguished from systems in which col-
used on multiple computers. laboration on the applications between different users is not
Settings are stored with, and can be preferably carried 60 possible but the contents of individual computer screens can
around with, the software (i.e., they are written to the be projected onto a remote display with multiple users at the
electronic device such as a USB drive). Settings are not same time.
stored to the registry or any other central system data- The term "arbitrary media content" refers to the fact that a
base of the computer. user may generate, create or select any media content that is
Leaves a zero (or near-zero) "footprint" on any PC it is run 65 appropriate to display, i.e. on an ad hoc basis. This differs
on after being used, i.e., all temporary files/registry set- from client voting on, or selecting of media content that is
tings should be either avoided or at least removed once displayed by another in a meeting or presentation. This term
US 9,083,769 B2
13 14
refers to client oriented, distributed rights and privileges for FIG. 10 shows an embodiment of a peripheral device in
the display of content rather than a central presenter providing accordance with an embodiment of the present invention.
content which is presented to the members of the meeting.
"Screen scraping" in our sense refers to reading the video DETAILED DESCRIPTION OF THE
frame buffers and processing them, rather than just rendering 5 EMBODIMENTS OF THE PRESENT
them on a display. Screen scraping for presentations is INVENTION
described in US2002/0196378 to Slobodin et al which is
included herein by reference. The present invention will be described with respect to
"Auto composition" or "auto layout" refers to the auto- particular embodiments and with reference to certain draw-
matic nature in which multiple graphics/video sources are IO ings but the invention is not limited thereto but only by the
rendered on a central display, without user intervention and in claims. The drawings described are only schematic and are
a way that a user would intuitively expect it to happen. non-limiting.
"Wireless" and "wireless communication network" can be Furthermore, the terms first, second, third and the like in
any network that does not use cable links between nodes, e.g. 15 the description and in the claims, are used for distinguishing
uses RF, optical or InfraRed for communication purposes, between similar elements and not necessarily for describing a
such as IrDA, diffuse infra-red, WLAN, WiMax, WiFi, WiFi sequential or chronological order. The terms are interchange-
Direct, Bluetooth or any other wireless communication net- able under appropriate circumstances and the embodiments
work known to the person skilled in the art such as optical of the invention can operate in other sequences than described
networks like LiFi. 20 or illustrated herein. Moreover, the terms top, bottom, over,
"Computer" generally refers to a processing device, i.e. under and the like in the description and the claims are used
having a processing engine capable of various types of digital for descriptive purposes and not necessarily for describing
processing, such as rendering graphics images for display. A relative positions. The terms so used are interchangeable
computer can be in the form of a work station, a personal under appropriate circumstances and the embodiments of the
computer, a laptop, a palm top, a PDA, a smartphone, a tablet 25 invention described herein can operate in other orientations
etc. Generally a computer has memory such as volatile RAM. than described or illustrated herein. The term "comprising",
Non-volatile memory such as a hard disc, optical disk or solid used in the claims, should not be interpreted as being
state memory can be included in the computer or can be a restricted to the means listed thereafter; it does not exclude
peripheral device. Currently most computers are electronic other elements or steps. It needs to be interpreted as specify-
but the term "computer" also includes optics based comput- 3o ing the presence of the stated features, integers, steps or
ing devices. components as referred to, but does not preclude the presence
The term "pre-installed generic driver" is intended to mean or addition of one or more other features, integers, steps or
a driver which is installed on a processing device such as a components, or groups thereof. Thus, the scope of the expres-
computer as a standard driver, e.g. is installed with the instal- 35 sion "a device comprising means A and B" should not be
lation of the operating system. Such a driver is standard for limited to devices consisting only of components A and B. It
the operating system and can drive a standard class of periph- means that with respect to the present invention, the only
eral devices coupled to or connected to the processing device. relevant components of the device are A and B. Similarly, it is
The installation of a specific driver for such a peripheral to be noticed that the term "coupled", also used in the descrip-
device is not required. Such a generic driver can be a human 40 tion or claims, should not be interpreted as being restricted to
interface driver (HID) or a mass storage device driver, which direct connections only. Thus, the scope of the expression "a
has predetermined software components configured for driv- device A coupled to a device B" should not be limited to
ing mass storage, a CD-ROM, a keyboard etc. or combina- devices or systems wherein an output of device A is directly
tions of these. Such devices can be readable and writable connected to an input of device B. It means that there exists a
computer peripheral memory devices such as USB memory 45 path between an output of A and an input of B which may be
sticks, flash memories, external hard drives, or more. a path including other devices or means.
Elements or parts of the described devices may comprise
BRIEF DESCRIPTIONS OF THE DRAWINGS logic encoded in media for performing any kind of informa-
tion processing. Logic may comprise software encoded in a
FIG. la shows a meeting room that can be used with 50 disk or other computer-readable medium and/or instructions
embodiments of the present invention. FIG. lb shows a com- encoded in an application specific integrated circuit (ASIC),
bination of a client processing device, a connection unit, a field programmable gate array (FPGA), or other processor or
base node and a display in accordance with an embodiment of hardware. References to software can encompass any type of
the present invention. programs in any language executable directly or indirectly by
FIG. 2 shows a screen display in accordance with an 55 a processor.
embodiment of the present invention. References to logic, hardware, processor or circuitry can
FIGS. 3 to 5 show a base node and a peripheral device and encompass any kind oflogic or analog circuitry, integrated to
a client processing device in accordance with embodiments of any degree, and not limited to general purpose processors,
the present invention. digital signal processors, ASICs, FPGAs, discrete compo-
FIG. 6 shows a display in accordance with an embodiment 60 nents or transistor logic gates and so on.
of the present invention. Embodiments of the present invention provide solutions to
FIG. 7 shows a peripheral device in accordance with an three major problems with meetings: a) the time taken to
embodiment of the present invention. prepare for a meeting. This is mainly achieved by allowing
FIG. 8 shows a client processing device in accordance with "on-the-fly" presentation of any displayable information.
an embodiment of the present invention. 65 This information does not have to be linked into any particular
FIG. 9 shows a further client processing device in accor- presentation software, nor to be compatible with any such
dance with an embodiment of the present invention. presentation software,
US 9,083,769 B2
15 16
b) the time taken to conduct the meeting using electronic base node 36. A whiteboard 45 can optionally be provided
meeting tools. This is achieved by reducing the time to that can be optionally coupled to the display 44 and/or the
connect computers to the display or projection system. base node 36, e.g. when the whiteboard can record electroni-
c) the time taken to reflect and review and document the cally what is written on it. Optionally, a camera 35 may be
meeting afterwards. This is achieved by providing the pos- 5 provided to record the entries on the whiteboard 45. The
sibility ofrecording the course of the meeting in the same camera 35 may have a third connection unit 52 for connecting
time sequence that it was carried out as well as be able to the camera 35 to the network 50 so that the data from the
store all data presented and who presented it. whiteboard can be recorded and stored or transmitted to other
First Embodiment networks via router 42. The connection unit 52 may have an
FIG. la is a schematic representation of a generic meeting 10 input device 53 as described above for the connection unit 47.
room 30 with a meeting table that can be used with embodi- Optional equipment can be cameras 39, 40, 41 for record-
ments of the present invention. Participants 37 having some ing the progress of the meeting. These cameras can be linked
form of processing device 31 such as a laptop computer, a by a network 51, e.g. a cable network to the router 42 and/or
tablet, a PDA etc. Each of the processing devices 31 can be a the base node 36. Another optional item is a microphone or
host device and has a first connection unit 47 to which it is 15 microphones 38 that can be used to transfer audio, e.g. to the
coupled. The first connection unit 47 provides access to a processing devices 31 and to loud speakers (not shown)
network 50 which in this case is a wireless network, but could attached to the base node 36 or part of the display 44.
be a wired network. The network can be a shared resource Any or all of the outputs of the processing devices 31, the
network. Each connection unit 47 may be coupled to an input cameras, the whiteboard, etc. can be recorded and stored
device 48 which will be described in more detail later. A user 20 digitally, e.g. in node 36 or elsewhere to provide a complete
37 will typically at a distance from the processing device 37 record with correct time sequence. Summarising the above,
which is ergonomically satisfactory. This ergonomic bound- the present invention provides an electronic meeting tool for
ary is typically an area of about 1000 sq cm to 4000 sq cm. communicating arbitrary media content between different
This ergonomic boundary will typically have the user as one users 37 (with their own processing devices 31, e.g. PC,
side of the boundary and the comfortable reach of the arms 25 mobile phone, or tablet) and one display or projector or mul-
will determine an area on the left and right of the processing tiple displays or projectors 44 in the meeting room 30.
device which falls within the ergonomic boundary and the far Referring to FIGS. la and lb embodiments of the present
edge of the boundary of the processing device (normally invention comprise a base or display node 36 being a process-
delimited by a display screen) will determine the other side of ing device, e.g. a host computer adapted to receive user
the ergonomic boundary. The area defined by the ergonomic 30 selected arbitrary media content, the base node 36 being
boundary will overlap or include the processing device 31 coupled to a central display 44 which can be a fixed format
itself. The processing device will also have an outer physical display and/or a projector or similar. The arbitrary media
boundary. The input device 48 is preferably arranged to oper- content can be provided from any of the user processing
ate outside the boundary of the processing device 31 but devices 31. The base node 36 can be adapted to display the
within the ergonomic boundary. Preferably the input device is 35 received user selected arbitrary media content in accordance
arranged to function when it is flat on the table. The input with a set of rules, e.g. FIFO, automatically, on request or
device preferably has an size of activation area of between 1 approval, forced to display, in accordance with a priority etc.
and 144 square cm. In other embodiments of the present Optionally the base node 36 is adapted to force display of the
invention a wireless memory card can be provided to enable received user selected arbitrary media content, i.e. to allow
a second Wi-Fi link on a processing device such as a laptop or 40 participation in the meeting by an individual user displaying
tablet. The wireless memory card stores data and media and own selected content on display 44 independently of the
fits into the laptop just like a regular SDHC card. The wireless person who is nominally responsible for giving a presentation
memory card preferably has built-in Wi-Fi that effortlessly or chairing the meeting. Forcing the display can also be con-
transfers data, photos and videos to another device or com- sidered as a rule. The phrase "unilateral electronic access to
puter. For instance an Eye-Fi card (www.eye.fi) can be used to 45 the display device" defines this kind of rule as "unilateral"
enable the latter, means that the displaying process is obtained by the act ion of
Preferably the network 50 is a local area network, (e.g. a only one participant involved in the meeting, without requir-
shared resources network) i.e. preferably local to the meeting ing the agreement o another or the others. The term "unilat-
room for security reasons but the network 50 may have access eral" implies that the data for display is allowed to override or
to other local or wide area networks such as 51 or to a larger 50 replace any data displayed on the screen by the same or
corporate network or the internet 43, for example via a router another participant of the meeting. The meeting tool can also
42. Another node of the network 50 is the base or display node be adapted to allow a priority setting. This means that a user
36. This node 36 may optionally be a wireless access point. can set a priority setting for the media to be displayed. A
The base node 36 may also be a processing device or host priority of "1" for example can be interpreted by the base
computer and may be coupled to a second connection unit 49 55 node as a forced display, a priority "2" can be interpreted by
that provides access to the network 50 thus linking all of the the base node as display as soon as possible, priority "3" can
processing devices 31, 36 together. The connection unit may be interpreted by the base node as place in queue and display
have an input device as described above. Alternatively, net- as the time comes etc. Setting and using priorities for display
work connections installed on the base node 36 can be used. are also considered to be working to rules. To execute the
Audio equipment 46 may be provided, e.g. a telephone that 60 rules, the base node 36 may have a decision module. The base
allows other members of the meeting to call in from remote node 36 may be a host computer having a processing engine
destinations. such as a microprocessor and a memory. Preferably, the base
The display node 36 is coupled to and adapted to allow node 36 is adapted to treat media content passed to the base
display of media on some kind of display 44. The display node 36 from any or all of the connection units 47 in an equal
node is in embodiments of the present invention a base node 65 manner. The base node 36 may be adapted to auto compose
of the communications network 50. The display 44 may be a the media content on the central display 44 connected to it,
projector and/or screen, the projector being coupled to the e.g. from one or more processing devices 31.
US 9,083,769 B2
17 18
An independent aspect of the present invention is at least the portable application 60 is stored on each connection unit
one connection unit 47, (optionally 49 for receiving or camera 47 and optionally 49. Preferably the portable application 60 is
connection unit 52) adapted to communicate the user selected adapted to "screen scrape" content of the client display of the
arbitrary media content to said base node 36. Preferably the client processing device 31. Optionally the portable applica-
connection units 47 and/or optionally 49 are physical plug- 5 tion 60 when run on a processing device 31 is adapted to
and-play devices. An example of a connection unit is shown "screen scrape" content of the client display of this client
schematically in FIG. 10. processing device 31 and to transmit it via a connection unit
The connection unit 47 (or optionally connection unit 52) 47. Optionally the portable application 60 when run on the
may be integrated into a user processing device 31 e.g. as an processing device is adapted to "screen scrape" content of the
internal peripheral device or may preferably be an external 10
client display of the client processing device 31 and to trans-
peripheral device comprising a connector adapted to couple
mit it via a network interface of the processing device 31, for
to a port of a user processing device 31. The processing device
example if the connection unit 47 has no transmitter or it is not
31 may have a client display, a processing engine such as a
microprocessor, a memory and an operating system. The functioning.
optional connection unit 49 may integrated into the base node 15 The connection unit 47 for communicating with said base
36, e.g. as an internal peripheral device or may be an external node 36 has a network interface e.g. comprising a transmitter
peripheral device comprising a connector adapted to couple 62. The transmitter 62 is preferably a transceiver. Optionally
to a port of the base node 36. The connection unit 49 may be the transmitter/receiver can be a wireless transmitter/receiver.
fully integrated into the base node 36, e.g. is an internal The base node 36 for communicating with the connection
network interface of the base node 36. The base node 36 may 20 unit 47 has a receiver 63 which can be included in the con-
have a processing engine such as a microprocessor, a memory nection unit 49 or integrated into the base node 36. The
and an operating system. receiver is preferably a transceiver. Optionally the transmit-
In alternative embodiments of the present invention, the ter/receiver can be a wireless transmitter/receiver.
peripheral device can be coupled wirelessly to the processing The input device 48 allows a user interaction with the
device, and paired with the processing device such as a tablet 25 connection unit 47. Preferably the input device 48 is physical
orlaptopthroughNear-FieldCommunication(NFC).Inother actuator coupled to the connection unit 47. The user action
embodiments of the present invention, the pairing of the applied to the input device 48 generates a signal that can
peripheral device can be performed additionally by providing trigger transfer of data from the processing device 31 (to
means for receiving biometric data such as a microphone which the connection unit 47 is coupled) to the network 50.
(voice) or a camera (face or iris) or a finger swipe (fingerprint) 30 Preferably the input device 48 has an activating surface that is
to the peripheral device. Then the peripheral device can be between 100 and 14,400 square mm. Optionally the input
personalized, or paired, by means of voice or face recogni- device 48 can be a key displayed on the client display 1 of a
tion, respectively. The term voice recognition refers to finding client processing device 31. This key can be activated, e.g. by
the identity of "who" is speaking, rather than what they are use of a pointing device such as a mouse trigger transfer of
saying. Recognizing the speaker by voice recognition can 35 data from the processing device 31 to the network 50.
simplify the task of translating speech in systems that have The connection unit 47 is preferably provided with a visual
been trained on specific person's voices or it can be used to indicator 61, e.g. for allowing user feedback from the con-
authenticate or verify the identity of a speaker as part of a nection unit 47 of the status of any activity. The system also
security process. "Voice recognition" means "recognizing by can include a server program 64 adapted to be loaded onto the
voice", something humans do all the time over the phone. As 40 base node 36, said program 64 being adapted to receive arbi-
soon as someone familiar says "hello" the listener can iden- trary media content from one or a plurality of client process-
tify them by the sound of their voice alone. ing devices 31 through said connection units 47, (optionally
The user processing devices 31, the connection units 47, 49), and to show this plurality of arbitrary media content
(optionally 49, 52) and the base node 36 co-operate to form a streams on one or a plurality of displays 44. The server pro-
communication network 50 for linking between at least one of 45 gram 64 may be adapted to allow display in accordance with
the plurality of processing devices 31, 36, 35 and the central one or more rules, e.g. FIFO, automatically, on request,
display device 44. The communication network 50 is adapted forced, in accordance with a priority etc. The forcing rule can
to receive arbitrary media content from at least one of the be described as "unilateral electronic access to the display
plurality of processing devices 31 and to transmit the arbitrary device" as "unilateral" means that the displaying process is
media content of at least one of the plurality of processing 50 obtained by the action of only one participant involved in the
devices to the central display device 44. meeting, without requiring the agreement of another or the
In some embodiments the storage means of the peripheral others. The term "unilateral" implies that the data for display
device can be adapted to record or share information. For is allowed to override or replace any data displayed on the
instance, the peripheral device can be adapted to further com- screen by the same or another participant of the meeting. To
prise a private communication channel (e.g. to enable chat- 55 execute the rules, the server program 64 may have a decision
ting), which can communication with a private communica- module. Preferably, the server program 64 is adapted to treat
tion channel of another participant of the meeting. media content passed to it from any or all of the connection
An independent aspect of the present invention is a por- units 47, 52 in an equal manner. The server program 64 may
table application 60 adapted to be loaded onto a client pro- be adapted to auto compose the media content on the central
cessing device 31 and to be run on the operating system of the 60 display 44.
client processing device 31. The portable application 60 runs The server program 64 may be a portable application
as a process on the client processing device 31 that is adapted adapted to be loaded onto the base node 36 and to be run on
to deliver an arbitrary media content from the client process- the operating system of the base node 36. The portable appli-
ing device 31 to the communication network 50 in response to cation 64 runs a process on the base node 36 that is adapted to
a user action applied to an input device 48, the process leaving 65 display an arbitrary media content received from the client
a zero footprint on the processing device 31 on termination. processing device 31 via the communication network 50, the
The network 50 can be a shared resource network. Optionally process leaving a zero footprint on the base node 36 on
US 9,083,769 B2
19 20
termination. Optionally the portable application 64 is stored termination, e.g. disconnecting the electronic device, system
on each connection unit 49 and optionally 47 and can be crash, no trace is left. This is generally termed "zero foot-
installed therefrom. print".
Meetings in which visual information is presented on a The present invention has the advantage of scalability. It
display or projector commonly suffer from a monopoly 5 can provide a display system for use by a plurality of users in
effect: one single presenter determines the display contents meetings. Every user in the meeting thus can have a client
and thereby has a disproportionate power to influence the processing device 31 for coupling to a connection unit 47. A
meeting dynamics and thereby its outcome. Embodiments of first user action connects the client processing device 31 to the
the present invention solve this problem by allowing multiple base node 36, e.g. by inserting a connection unit 47 into the
individuals to simultaneously show their information. The 10 relevant interface connector on the processing device 31, e.g.
present invention provides according to some embodiments a a USB interface. A second user action comprising activating
method to override all currently displayed material. In a sense a button or key on the input device (e.g. by depressing it) then
the method of the present invention transforms visual com- starts the process of transmitting arbitrary media content from
munication into something akin to talking, i.e. full-duplex the client processing device 31 to the base node 36. This
and with the option to shout and interrupt. 15 process preferably includes screen scraping data from the
The system may also include a central display device 44 processing device. Using screen scraping avoids special pro-
and optionally a whiteboard 45 or other display means such as grams being installed on the base node 36 to carry out graphi-
a printer. The display 44 being adapted to receive user cal commands sent from the processing device 31. When the
selected arbitrary media content, and may be adapted to allow base node 36 receives the plurality of arbitrary media content,
display of the received user selected arbitrary media content 20 it can allow auto composition of this media content on the
in accordance with one or more rules, e.g. FIFO, automatic, central display connected to it.
forced, on request or approval, in accordance with a priority In some embodiments, the button or key can be virtual
etc. The forcing rule can be described as "unilateral electronic button which is displayed on the screen instead of a button or
access to the display device" as "unilateral" means that the key on the input device, which for instance can be the periph-
displaying process is obtained by the action of only one 25 era! device. Preferably, when the process of transmitting arbi-
participant involved in the meeting, without requiring the trary media content has been activated, the screen scraping
agreement of another or the others. The term "unilateral" data from the processing device does not scrape the virtual
implies that the data for display is allowed to override or button. The latter can be enable for instance by positioning the
replace any data displayed on the screen by the same or virtual button on a second layer which is not scraped.
another participant of the meeting. 30 The present invention will now be described further with
Optionally, one of the connection units 47 can be adapted reference to certain more specific embodiments.
to be a master connection unit. Such a master connection unit The present invention in some embodiments provides a
may be adapted to instruct the base node when media content system and/or a method to which in one aspect can override
from a client processing device 31 may be displayed or which all currently displayed material when arbitrary material is
of the processing devices may be allowed to send content for 35 presented on a display device from more than one source
display. processing devices such as a laptop, PDA, smartphone, com-
In embodiments of the present invention, at least one por- puter, tablet etc. The present invention in one aspect controls
table application is used, e.g. for the client software on a client the display of visual communication and information by a
processing device 31 or optionally on the base node 36. In method akin to talking, i.e. full-duplex and with the option to
these embodiments, one of the pre-installed generic drivers of 40 interrupt or to obtain unilateral electronic access to a display
the operating system on the relevant computer device 31, 36 device.
is exploited for setting up communication from the computer One embodiment the present invention can be imple-
device 31, 36 to the network 50 via the connection unit 47, mented through a connectable peripheral device e.g. a USB
(optionally 49). The generic driver is used in connection with compatible device, such that when the peripheral device is
the connection unit 47, (optionally 49) operating as a periph- 45 connected to a processing device that is used to provide arbi-
eral device but the use can go beyond that of the standard class trary information such as text, video, pictures etc., each indi-
of peripheral devices for which the generic driver is intended. vidual user with a processing device can to gain access to the
In some embodiments the connection unit 47, (optionally 49) display, e.g. screen. By being present at the meeting a user can
operated as a peripheral device communicates with the rel- pair the peripheral device to a processing device by inserting
evant processing device 31, 36 by using a generic communi- 50 the peripheral device. The user can also pair the peripheral
cation protocol provided by the pre-installed generic driver. device to a base node or base unit that controls the display in
Pre-installed USB drivers are examples. the meeting room and which is connectable to the peripheral
Preferably the setting up of the communication of network device via a communications network such as a wired or
50 using connection unit 47, (optionally 49) does not alter or wireless communications network. The network is a shared
affect the networking capability of the relevant processing 55 resources communications network as different devices and
device 31, 3 6. For example, ifa browser is started on the client participants can transmit data over the network. To achieve
processing device 31, this browser can use the standard net- this, the peripheral device has a transceiver capable of trans-
work interfaces on the processing device 31. This means that mitting the arbitrary data from the processing device to the
transfer of data via the connection unit 47 (optionally 49) is display via the base node. In one option the information
independent of transfer of data over the network interfaces of 60 displayed on the local display of the processing device is
processing device 31 or 36. This has the advantage that each screen scraped and transmitted. To allow this the peripheral
user can carry out processing such as searching on the internet device can include a portable application that is able to
to gather data independently of the transfer of data to be execute on the processing device leaving a zero-footprint on
displayed during a meeting, or receive emails etc. termination. Although a physically connectable peripheral
The use of a portable application has the advantage that any 65 device is convenient, the peripheral device could also be
modification to settings in the register or generally in the coupled to the processing device via a wireless connection,
operating system can be avoided, so that upon any form of e.g. via the Bluetooth protocol. For meetings with remote
US 9,083,769 B2
21 22
participants it is not possible to rely on the same hardware The base node 36 receives the plurality of arbitrary media
connectable peripheral device to provide access from a content coming from one or more connection units 47, and
remote location to the display in the meeting room directly. auto composes this media content for rendering on the central
Typically, at home or in a hotel, the participant only has a display.
phone and internet access on a laptop or some other kind of 5 The visual indicator 61 on the connection unit 47 indicates
portable computing device. Remote participants lack context to the user and to other participants in the meeting that media
(e.g. non-verbal communications) and have less than ideal content is being sent by that connection unit 47 to the base
audio/video connections and consequently suffer from a node 36 for display. Repeating the second user interaction on
power-asymmetry. Typically, remote participants also have the input device 48 of a connection unit 47 decouples the
10 media content from that connection unit 47 from the base
no way of 'pushing' their contents on screen, since the meet-
node 36. The base node 36 removes that media content from
ing is controlled by a meeting organiser or director who
the composed image on the central display and recomposes
orchestrates the sequence of presentations. One of the key
the remaining content on the central display. The content on
advantages of the present invention is to provide remote col- the central display/projector is auto arranged as shown in
laboration while maintaining a kind of 'situational aware- 15 FIG. 2. When user 1 adds content, his/her display will be
ness'. This means that what you see has a straightforward scaled to fill the available central display canvas as much as
relationship with your internal mental map. This allows keep- possible, but without affecting the aspect ratio. When user 2
ing track of multiple information flows and being able to adds in, his content is added to the side of the first image.
correlate that quickly with any other information, e.g. with a When user 3 adds his content, the arrangement is a suitable
search carried out on the local computing device. 20 one such as triangle wise. Adding user 4, the image becomes
In another aspect of the present invention confusion and a 2 by 2 tiling, which is the maximum available. When an
frustration is avoided by: additional user attempts to add content, he will be blocked.
1. retaining aspect ratio of any image that is sent from any When a user initiates action to remove his/her content, his/her
location to the display in the meeting room or displays in media content is removed from the central display and one
meeting rooms (e.g. a long thing remains a long thing) 25 moves backward in the composition sequence shown in FIG.
2. not overlapping images and/or windows on any of the 2.
display devices in the meeting rooms (e.g. you never have Base Node Software
to guess or remember what's hidden) The base node software has one or more of the following
3. showing the same arrangement of images on each screen features:
(everyone sees the same things and can refer to them), this 30 First code for providing a means or a method step for
means that the topological arrangement of images on each correctly configuring the receiver of the base node.
screen of multiple screens is the same, Second code for providing a means or a method step for
4. maximizing the use of screen real-estate (e.g. the images listening for output of connection units trying to connect
presented do not have borders containing no useful infor- on a specific port.
mation), while preferably no allowing overlapping of the 35 Optionally, third code for providing a means or a method
images step for a GU for administration purposes, offered for
5. allowing local manipulation of zoom and pan but allowing example over a web interface.
to return to the default layout of item 3 above Optionally, fourth code for providing a means or a method
6. arranging the images on each display taking into account step for publishing its presence over the network using
the local display characteristics, such as any of resolution, 40 the zeroconf protocol.
pixel density, aspect ratio, Optionally, fifth code for providing a means or a method
7. optionally also allowing an ongoing audio connection to be step for accepting and installing software updates of the
heard by all participants, e.g. that verbal communications base node as well as for the portable application software
will be used to alter the contents of the screen. for the connection units.
With reference to FIG. 2, the base node software (6) run- 45 Sixth code for providing a means or a method step for
ning on a base node 36 can be adapted to display on the central providing facilities for pairing of connection units to the
display a splash screen (21) showing its readiness to receive base node.
arbitrary media content over its receiver. This splash screen Seventh code for providing a means or a method step for
(21) can also show instructions on how to use the system, as auto-composing of different incoming arbitrary media
well as the configuration parameters (see later) to reach the 50 streams and rendering of composited image on display
base node 36. These configuration parameters are also shown or projector screen.
in a transparent canvas at the bottom of the central display Eighth code for providing a means or a method step for
(22). receiving, decrypting and decoding incoming arbitrary
A client processing device 31 that wants to have its arbi- media content.
trary media content displayed on the central display con- 55 Optionally ninth code for providing a means or a method
nected to the base node 36 is connected to a connection unit step for scaling of incoming arbitrary media streams
47. The portable application 60 will be executed on the client Optionally tenth code for providing a means for display-
processing device 31 as a host device. A first user interaction ing incoming arbitrary media content in accordance with
creates a connection between the portable application 60 and a set of one or more rules.
the base node 36 using the transmitter in the connection unit 60 Any of the above code may be stored on a non-transitory
47 and the receiver in the base node 36. This user action can machine readable storage medium such as an optical disk, a
be a connection of the connection unit 47 to the processing magnetic disk, magnetic tape, solid state memory, USB mass
device 31. A second user interaction, this time on the input storage device etc.
device 48, activates screen scraping by the portable applica- Portable Application for the Client Processing Device
tion of the arbitrary media content from the client processing 65 The portable application comprises an algorithm for screen
device display, which is then sent over the connector unit 47 scraping. Screen scraping algorithms include VNC and RDP
to the base node. or similar. The algorithm may include a combination of alga-
US 9,083,769 B2
23 24
rithms such as VNC and RDP that are optimized for different device when the connection unit is removed. It also implies
content, e.g. static text or video. The portable application has that the portable application will run on client processing
one or more of the following features: devices where the user does not have the necessary access
Eleventh code for providing a means or a method step for rights to install software.
connecting to a network including the base node. The portable application is designed in such a way that
Twelfth code for providing a means or a method step for No specific drivers need to be installed on the client pro-
capturing video frame buffers of the client processing cessing device.
device, i.e. computer (C), also called screen scraping. Pre-installed drivers are used, e.g. for classes of peripheral
Thirteenth code for providing a means or a method step for devices.
encoding, compressing and optionally encrypting these 10
It is independent from vendor specific graphics hardware.
video frames and sending them over a secure link to the
It runs on at least one and preferably on a variety of differ-
base node. Only changed areas such as rectangles or
ent client processing devices, including Windows, Mac
triangles of the screen (or any other suitable geometrical
shape) need to be transferred, and different types of OS/X, Linux, Android, iOS and many others.
rectangles or triangles are encoded in different ways 15 Advantages
(e.g. RLE, JPEG, ... ) to optimise performance. The present application has one or more of the following
Fourteenth code for providing a means or a method step for advantages:
handling the connection unit. No need for a master role in the meeting
Fifteenth code for providing a means or a method step for Standard plug and play connectivity of connection units to
initiating connection to base node. 20 base node
Sixteenth code for receive inputs from the input device on Simple and well known user actions are employed
the connection unit. Own networking facilities of client processing devices not
Seventeenth code for providing a means or a method step blocked
for sending state changes to the visual indicator on the No configuration changes on the client processing device
connection unit. 25 Input devices are easily accessible; e.g. large size
Optionally, eighteenth code for providing a means or a Program updates of portable application and server pro-
method step for presenting the user a GUI (18). gram can be performed locally
Optionally, nineteenth code for presenting GUI for admin- Portable applications are used, no installation, multi-plat-
istration of the portable application. form, no vendor specifics
Optionally, twentieth code for providing a means or a 30 Particular implementation of screen scraping done by por-
method step for displaying and activating a key on the
table application avoids vendor specific graphics
display of the client processing device for allowing a
devices
user input to start the transfer of data from the client
Standard drivers are used so no need to install extra drivers
device to the base node.
Embodiments of the present invention provide a frame 35 No configuration changes on the client processing devices
grabber. A frame grabber, known in the prior art, is an elec- Zero footprint applications on client processing devices-
tronic device that captures individual, digital still frames from nothing to clear up or adjust or reset
an analog video signal or a digital video stream. It is usually Own networking facilities of client processing devices not
employed as a component of a computer vision system, in blocked-No configuration changes on the user com-
which video frames are captured in digital form and then 40 puters
displayed, stored or transmitted in raw or compressed digital Low virus, malware and spyware risk
form. In recent years, connections via USB, Ethernet and The portable application may be stored on a non-transitory
IEEE 1394 ("Fire Wire") interfaces have become prevalent. machine readable storage medium such as an optical disk, a
The frame grabber of the present invention, enables HDMI or magnetic disk, magnetic tape, solid state memory, nand Flash
Display Port capture instead via USB. The frame grabber 45 etc.
preferably functions as follows: Second Embodiment
Connect to the base unit using a TCP/IP socket interface. In the second embodiment, referring to FIGS. 2 to 5, the
Capture the video frame buffers of the computer, base node is a separate physical processing device called base
Encode, compress and encrypt these video frames and unit (B), comprising permanent storage, memory, a process-
stream them over a secure link to the base unit. Only 50 ing engine, a wireless access point (4), a plug and play inter-
changed rectangles of the screen are transferred, and face such as a USB port (11), a graphics display output
different types of rectangles are encoded in different adapter (5) like VGA/DP/DVI/HDMI, and optionally an
ways (e.g. RLE, JPEG, ... ) audio output adapter (27). An input device having an actuator
Present the user a GUI such as a button 13 and a visual indicator 14 are optional.
Any of the above code may be stored on a non-transitory 55 The connection unit is a physical device in the form of an
machine readable storage medium such as an optical disk, a external peripheral device (shown in the drawings as a
magnetic disk, magnetic tape, solid state memory, NAND "dongle" D) comprising permanent storage storing the por-
Flash, etc. table application (7) and configuration parameters (12),
In this embodiment the portable application stored on the memory, a processing engine (e.g. CPU, FPGA), a wireless
connection unit, and is executed in an execution context on 60 transmitter such as WiFi (3) or other wireless transmitters
the client processing device. The portable application does such as LiFi, a plug and play interface such as a USB interface
not need to be copied to or installed on the computer. It can be (2), a button as input device (9), an LED ring as visual indi-
executed directly from the connection unit. It will only be cator (10). The portable application is stored on the peripheral
copied temporarily into an execution context on the client device (7). The client processing device is host device, for
processing device. There are also no changes in configuration 65 example a computer or laptop comprising a display, a plug
required or settings in the client processing device. This and play interface such as a USB port (2), memory, and a
means that nothing will remain on the client processing processing engine such as a microprocessor.
US 9,083,769 B2
25 26
The system thus comprises: other to the permanent storage (8). For example, when using
an external peripheral device (D) that has a plug and play WiFi, this could be the SSID, WEP/WPA2 keys and IP
interface such as a USB interface (2) on one end and a address and port number of the base units receiver, as well as
communications interface such as a wireless interface the port number used by the base node software, but not all of
configured as client (3) on the other end. 5 these are necessarily needed to be exchanged.
a base unit (B) that has a communications interface such as
A client processing device that wants to have its arbitrary
a wireless interface configured as access point on one
end (4) and a video card adapter (5) like VGA, DVI, DP media content displayed on the central display connected to
or HDMI on the other end. the base node (5) connects a peripheral device (D) to its USB
a portable application (7) stored on the peripheral device 10 port via (2). The peripheral device presents itself to the com-
(D) but executed on the client processing device (C) puter over interface (2) as a composite device comprising a
a base node software ( 6) stored and executed on the base mass storage device and a keypad. This has the major advan-
unit (B) tage that no specific driver is required, since all these devices
The external peripheral device (D) also preferably has any are natively supported in every personal computer system that
one or any combination of: 15 has a USB port. If autorun is enabled, then the computer will
a large button as actuator for the input device (9) allowing automatically execute the client software (7) stored in mass
user interaction with the peripheral device. The button storage (8) on the peripheral device. The first user interaction
preferably has an actuation surface area of between 100 mentioned in the general case is then just the connection of
and 14,400 square mm. the peripheral device to the USB port. If security measures
visual indication such as a LED (10) allowing user feed- 20 disabled auto-run, the user needs to explore the mass storage
back from the peripheral device. The user feedback can on the mass storage of the peripheral device and start the
be in the form of a light ring. portable application manually.
An advantage of embodiments of the present invention is to
provide data transfer to the peripheral device via a peripheral The portable application will use the wireless, e.g. WiFi or
interface such as a USB interface on any processing device 25 LiFi interface of the peripheral device (3) to connect to the
such as a computer in a manner that is largely operating correct base node. To know the right base unit to connect to,
system independent and without leaving a footprint (Zero- the configuration parameters needed to make this connection
Footprint ). Installation of drivers and/or applications onto are stored in the database (12) on the mass storage device (8)
such a processing device as a computer is not necessary during the pairing process described earlier.
wherever pre-installed generic drivers are present. Adminis- 30 Once the connection is made, the peripheral device goes
trator rights on the processing device such as a computer are into connected mode. This means that there is now at least one
preferably not necessary. To avoid the need for administrator channel from the peripheral device to the base unit. The
rights, embodiments of the present invention use other content is not shown yet. The LED (10) on the peripheral
peripheral device pre-installed drivers such as USB class
device now turns white to give a visual indication of this new
drivers supported without any extra installation. Embodi- 35
state.
ments of the present invention route at least screen scraped
data presented by client software running on the processing When the user at the computer (C) wants to show her
device for transfer to a communications network via a periph- content, she presses the button (9). When the button was
eral device such as a USB device. This bypasses any network previously in state "connected" (see FIG. 6), it will check the
interface of the processing device C (and hence many fire- 40 state of the base unit (P). If the base unit is not in state "full",
walls) but only for the specific client software. Other appli- the peripheral device will send the screen scraped arbitrary
cations are not affected and can make use of the standard media content to the base unit (B), which will add the media
network interfaces, i.e. packets from/to the TCP/IP stack are content to the composition on the central display. The periph-
transferred to a network device as normal. The client software eral device LED (10) now turns red to indicate "showing"
is launched from the peripheral device such as a USB com- 45 state (FIG. 6).
posite device or storage device as a portable application, The button (9) acts as a toggle. When the user presses the
which can avoid that any traces are left on the host OS. button again, that computer displays content will be removed
Basic Usage Scenario of the Second Embodiment from the projector. The LED (10) goes back to white.
The base node software (6) displays on the projector a
splash screen-(21) in FIG. 5-showing its readiness to 50 Use of the auto-run feature is optional if possible and
receive arbitrary media content over its receiver (4). This enabled on the computer (C) to start the client software (7) as
splash screen (21) also shows instructions on how to use the soon as the peripheral device is plugged in. On Windows for
system, as well as the configuration parameters (see later) to example, this means mounting the peripheral device as a mass
reach the base node. These configuration parameters can also storage device and using the autorun.inf file stored on the
be shown in a transparent canvas at the bottom of the central 55 peripheral device.
display (22). In many cases however, this auto-run feature will be dis-
To avoid user interaction for the configuration of the con- abled for security reasons. In that case, we will, if possible and
nection between peripheral device and base unit, a pairing enabled on the computer (C), use the auto-play feature to
process is used. This pairing process provides the peripheral show the logo of the connected peripheral device on the
device, i.e. the connection unit with networks parameters 60 desktop of the computer. The user then needs to double click
needed to set up the local network. As an example, the periph- on that logo to start the client software. Ifthe auto-play feature
eral device can be briefly plugged into the USB port (11) of as described above is also not possible or enabled, the user
the base unit (B). The base unit then optionally does a soft- must browse to the file system of the connected peripheral
ware validity check, optionally does a software update of the device and start the application manually. This means double
portable application stored on the peripheral device, and 65 clicking the client.exe file on Windows, client, app on Mac
writes the connection parameters on the peripheral device (D) OS/X or tapping the appropriate application icon on a tablet
required for the peripheral device and base unit to find each or any mobile device with touch screen.
US 9,083,769 B2
27 28
Third Embodiment: Portable Application Stored on Standard Need to find free key on client operating device when using
Solid State Memory Such as a USB Stick. physical key for second user action
In the third embodiment, the portable application is stored Network interface is blocked from other uses by portable
on a solid state memory such as a regular USB memory stick application Optionally, the last point can be avoided by
(FIG. 7). using the base unit as a gateway to the network that the
With a solid state memory such as a regular USB memory client operating device wanted to connect to through its
stick, there is no input device, visual indicator or transmitter own interface.
of the kinds described above for the connection unit. This Advantages are:
means that the system needs to: tight control of user connectivity to corporate network
10
Use the transmitter/receiver from the client processing through settings on the base unit
device. keep network connectivity intact even when transmitter is
Use as input device a key or button on the client processing now also used for display purposes
device like a physical key on the keyboard, a special Disadvantage is a higher vulnerability of the system
mouse press, a button area on a touch screen, a button 15 because the display connection is now possible a doorway
displayed on the screen to be clicked on with a mouse into the corporate network.
pointer. What remains as advantages are
Present the visual indicator on the client processing the availability of a physical medium to distribute the por-
device's display. table application to users-no need to install or copy
The client processing device then looks like FIG. 8. 20 software to client operating device
This embodiment provides a peripheral interface such as easy way to maintain software updates on the connection
the USB interface on any processing device acting as a host units (here: memory sticks) via the base unit
device such as a computer in a manner that is largely operat- possibility to write configuration data on the connection
ing system independent. Installation of drivers and/or appli- unit by the base unit, for example in the form of a
cations onto such a processing device as a computer is not 25 configuration profile that can be read and used by the
necessary wherever pre-installed generic drivers are present. client operating device
Administrator rights on the processing device such as a com- Fourth Embodiment: Software Only Client Installed on the
puter are preferably not necessary. To avoid the need for Client Processing Device.
administrator rights, this embodiment uses other peripheral This embodiment is similar to the third embodiment, with
device pre-installed drivers such as USB class drivers sup- 30 as only difference that the software is copied on the client
ported without any extra installation. This embodiment of the
operating device (FIG. 9). In this case, no plug and play port
present invention routes at least screen scraped data presented
such as a USB port is required on the client operating device.
by client software running on the processing device for trans-
This embodiment will typically be used for tablet PC's and
fer to a communications network via a network connection of
the processing device. The client software is launched from 35 mobile devices. In that case
the peripheral device such as the USB device as a portable there is often no USB port available
application. application distribution is easy and widely accepted
The first user operation then comprises: through application stores
plugging in the solid state device such as a USB memory Fifth Embodiment: Base Node Software OEM'ed to Projec-
stick, starting the portable application (if autorun is dis- 40 tor or Display Equipment
abled) In this embodiment, the base node is not realized as a
configuring the transmitter, such as the wired or wireless separate physical box, but integrated into the processing unit
network interface, on the client processing device to inside a display or projector. All other details are as previously
connect to the correct base node, using the configuration described.
parameters (22) shown on the central display 45 Sixth Embodiment
triggering the connection of the portable application with In this embodiment, the base node is not realized as a
the base node, for example by interacting with an ele- separate physical box, but integrated into the codec of a video
ment on the GUI (18) of the portable application pre- conferencing equipment. All other details are as previously
sented on the display of the client processing device. described.
Presenting visual feedback on user actions is in this 50 Seventh Embodiment: Remote Meeting Participant
embodiment also done using elements in the GUI of the In this embodiment, one or multiple client operating
display of the client operating device. devices are not in the direct vicinity of the base node but on a
In this embodiment, the advantage of zero footprint is remote location. To accommodate this case, the following
partly realized by the portable application in the sense that no adaptations are needed:
software is installed on or copied to the client operating 55 further compression and or scaling of the arbitrary media
device, but there is a configuration change needed to connect content to allow use of low bandwidth connection
the transmitter of the client operating device with the base possibility to communicate connection parameters of the
node, which needs to be undone afterwards. base node to a remote user
Optionally, the portable application can make the configu- connectivity of the base node to the WAN network to which
ration changes to the transmitter for the user in the back- 60 the remote user is connected
ground. All other details are as previously described.
Advantages lost in this embodiment Eighth Embodiment: Multiple Base Nodes
Partial loss of zero footprint nature of portable application In this embodiment, multiple base nodes are used. This can
More complex first user interaction be done for different purposes:
More expertise required from user 65 connectivity of multiple central displays
GUI needed on client operating device display, which is extension of real estate of central display
possibly also shown on central display connectivity of base nodes in different remote locations
US 9,083,769 B2
29 30
This provides the advantage that one can present on mul- of the connected user processing device and the ergonomic
tiple base units from a single peripheral device. This is useful boundary as defined above. In addition the flexible data and
for a number of cases: power connection should be adapted so that the base lies flat
personal peripheral device: user can have a personal on the meeting table independent of the orientation of the
peripheral device that is paired with multiple meeting 5 connector needed to insert the connector into the plug and
rooms that he regularly uses play interface.
use in meeting room with multiple base units each control- The base preferably includes electronics such as having
ling a different display in the same meeting room permanent storage for storing the portable application and the
The proposal uses a special variant of the peripheral device network configuration parameters, memory, a processing
called a multi base peripheral device. The multi base periph- 10
engine (e.g. CPU, FPGA), a wireless transmitter/receiver
eral device is equipped with a rotating wheel around the
such as for WiFi or LiFi, a plug and play interface such as a
circular central "show me" button. This could be a mechani-
USB interface, a LED ring as visual indicator. The visual
cal rotating multi-position switch or something like the touch
wheel on the iPod classic. indicator can be used for the LiFi interface. The portable
The pairing of this multi-base variant of the peripheral 15 application can be stored on the peripheral device, i.e. in the
device: base. The visual indicator is for allowing user feedback from
the rotation wheel is put in the position of the correspond- the connection unit of the status of any activity.
ing base unit. Some examples for activation of the actuator which can be
the peripheral device is paired to the base node in the used with any of the embodiments of the present invention:
regular way 20 Sound activated (hand clap, voice recognition, computer
the configuration parameters are stored in a permanent sound, music, ... )
storage location; every position of the rotating wheel has Remote controlled via wireless connected device (IR,
a corresponding set of connection parameters (e.g. dif- Bluetooth, WiFi, ... )
ferent rows in a table) each corresponding with a par- Light activated
ticular base 25 Pressure activated, e.g. depression with a finger or hand,
The connection of the peripheral device is as follows: Touch activated
multi-base peripheral device Xis plugged into a PC Proximity ('near-touch' on the actuator or bringing the
rotation wheel on peripheral device X is put in position A actuator close to some object
peripheral device X reads configuration parameters m Biometric reader such as Fingerprint reader, Iris scanner,
position A of its internal memory 30 DNA analyser
peripheral device X connects to base node A Keypad, e.g. for entering Keycode e.g. a password
base node A indicates connection of multi-base peripheral Alternative Embodiments
device X on central display screen In the above embodiments, once the connection is made
rotation wheel on peripheral device X is put in position B between the connection device and a host computer, the
peripheral device X reads configuration parameters m 35 peripheral device goes into connected mode. This means that
position B of its internal memory there is at least one channel from the peripheral device to the
peripheral device X connects to base node B base node. In accordance with any of the embodiments of the
base node B indicates connection of multi-base peripheral present invention a plurality of channels can be set up
device X on screen between the connection device and the base node. These
continue until correct base is selected with rotation wheel 40 channels may be logical channels.
click the peripheral device input device e.g. button to show Some examples for such a multichannel arrangement may
content on central display of base node include the first and one or more of the additional channels:
rotating the wheel always first clicks away content from the First channel is for the Scraped image stream (XDS)
base of the last position Second channel is for GPU commands (OpenGL, DirectX)
Ninth Embodiment 45 Third channel is for Mouse pointer coordinates (absolute,
FIG.10 shows a peripheral device 47 in accordance with an relative)
independent embodiment of the present invention including Fourth channel is for Mouse pointer icons
an input device. This embodiment can be used with any of the Fifth channel is for Image data files (JPEG, PNG,
embodiments described above. The peripheral device is con- GIF, ... )
figured as a connection unit and is a physical device in the 50 Sixth channel is for Multimedia data files or streams
form of a connector for a plug and play interface of a user (MPEG2, MPEG4, OGG, H.26x, ... )
processing device as a host computer such as a USB connec- Seventh channel is for Audio data files or streams (MP3,
tion, a flexible data and power connection connected to the MP4, AAC, WMA, ... )
connector and a base, the base having an actuator, e.g. a Eighth channel is for text or Document data files (DOC,
button configured to be an input device with the functions as 55 DOCX, PPT, PPTX, ODT, ODS, PDF, ... )
described above. Ninth channel is for transmission of a priority value 1, 2,
The base and/or the actuator is preferably large in size, e.g. 3 ... as described above.
having a surface area between 100 and 14,400 square mm. In the above embodiments, a particular method of pairing
The base can be square, rectangular, round, hexagonal, oval, the peripheral device with the base node has been described.
polygonal in shape or any other ergonomically suitable shape. 60 Any of the embodiments of the present invention may include
The actuator is preferably round but can be square, rectangu- other pairing mechanisms of which some examples are given
lar, hexagonal, oval, polygonal in shape etc. there can be more below.
than one actuator on one base. Some examples for pairing
The length of the flexible data and power connection, e.g. Plug in the peripheral device, to a generic peripheral
cable is preferably adapted to place the peripheral device 65 device port such as a USB port of the base node or
(when in its connected in its operating position), especially other USB enabled device. Pairing info is transmitted
the base and the actuator, in the region between the boundary over the generic peripheral interface such as USB.
US 9,083,769 B2
31 32
The Signal strength of the wireless channel to the base a third processing software code for routing data between
node is used to identify which base nod is to be used the processing device and the communications network
The Signal strength of the wireless channel or any other over the means for communication;
channel. Example is an NFC/RFID transmitter can be wherein the first software code portion is adapted to use the
provided underneath the meeting room table. Putting 5 generic communication protocol for transferring the
the user processing device such as a laptop and the data between the processing device and the peripheral
peripheral device plugged in on this table automati- device, and
cally pairs the peripheral device with the base of this an input device coupled to the peripheral device, the input
meeting room device being adapted to react to a user action to trigger
Manual pairing (e.g. by entering IP address, hostname, 10 the transfer of the data from the processing device to the
wireless ID (like SSID on WiFi)). peripheral device.
We claim: 8. The peripheral device of claim 7, wherein the first soft-
1. A method for connecting a processing device to a com- ware code portion is adapted to present the peripheral device
munications network, the processing device having a to the processing device as a human interface device and
memory, a display and an operating system with at least one wherein the pre-installed generic driver is a human interface
pre-installed generic driver providing a generic communica- 15 device driver.
tions protocol for communication between processing device 9. The peripheral device of claim 7, wherein the first soft-
and a standard class of peripheral devices, the method com- ware code portion is adapted to present the peripheral device
prising the steps of: to the processing device as a mass storage device and wherein
a) coupling a peripheral device to the processing device, the pre-installed generic driver is a mass storage device driver.
the peripheral device having a transceiver; 20 10. The peripheral device of claim 7, wherein the first
b) setting up, by means of the pre-installed generic driverof software code portion is adapted to present the peripheral
the operating system, a means for communication device to the processing device as a composite device and
between the peripheral device and the processing wherein pre-installed generic drivers drive different device
device; interfaces independently.
c) coupling the processing device to a communications 25 11. The peripheral device of claim 7 wherein the input
network via the peripheral device; device is physical actuator coupled to the peripheral device.
d) ro~ting screen scraped data between the processing 12. The peripheral device of claim 7 wherein the input
device and the communication network via the means device is a key for display on the display.
13. The peripheral device of claim 7 wherein said execut-
for communication, wherein the generic communication
protocol is used for transferring the screen scraped data
between the processing device and the peripheral 30
device.
:~:n~
ing a
0
/ot;'ti~~~~:;~~h~~~~~:~a~fod:s
base node.
~~~~~i~~~~~d~
2. The method of claim 1 wherein Step b) comprises pre- 14. The peripheral device of claim 7 wherein said execut-
senting the peripheral device to the processing device as a able software code comprises fifth code for providing a means
h~man_ interface d~vice and wherein the pre-installed generic for capturing video frame buffers of the processing device.
dnver 1s a human mterface device driver. 35 15. The peripheral device of claim 14 wherein said execut-
3. The method of claim 1 wherein Step b) comprises pre- able software code comprises sixth code for providing a
senting the peripheral device to the processing device as a means for encoding, compressing and optionally encrypting
mass storage device and wherein the pre-installed generic the video frames and sending them over a secure link to the
driver is a mass storage device driver. base node.
4. The method of claim 1 wherein Step b) comprises pre- 40 16. The peripheral device of claim 7 wherein said execut-
senting the peripheral device to the processing device as a able software code comprises seventh code for providing a
composite device and wherein pre-installed generic drivers means for handling the peripheral device.
drive different device interfaces independently. 17. The peripheral device of claim 15 wherein said execut-
5. The method of any of claims 1 to 4 wherein a client able software code comprises eighth code for providing a
application is stored on the peripheral device which when run 45 means for initiating connection to the base node.
on the processing device obtains the screen scraped data. 18. The peripheral device of claim 7 wherein said execut-
6. The method of claim 5 wherein the client application is able software code comprises ninth code for receive inputs
a portable application. from an input device on the peripheral device.
7. A peripheral device for providing communication con- 19. The peripheral device of claim 7 wherein said execut-
nectivity to a processing device which is provided with 50 able software code comprises tenth code for providing a
memory, a display and an operating system with at least one means for sending state changes to the visual indicator on the
pre-installed generic driver providing a generic communica- peripheral device.
tio°: protocol for communication between the processing 20. The peripheral device of claim 7 wherein said execut-
device and a standard class of peripheral devices, the periph- able software code comprises eleventh code for providing a
eral device comprising a memory in which executable soft- means for presenting the user a GUI.
w':11"e code is stored for execution on the processing device, 55 21. The peripheral device of claim 7 wherein said execut-
said executable software code comprising: able software code comprises twelfth code for presenting
a first software code portion for setting up, by means of the GUI for administration of the executable software code when
pre-installed generic driver of the operating system, a executed as a portable application.
means for communication between the peripheral 22. The peripheral device of claim 13 wherein said execut-
60 able software code comprises thirteenth code for providing a
device and the processing device;
a second software code portion for connecting the process- means for displaying and activating a key on the display of the
ing device to a communications network via the periph- processing device for allowing a user input to start the transfer
eral device, the peripheral device having a transceiver; of data from the processing device to the base node.
and * * * * *
UNITED STATES PATENT AND TRADEMARK OFFICE

CERTIFICATE OF CORRECTION
PATENT NO. : 9,083,769 B2 Page 1 of 1
APPLICATION NO. : 14/212170
DATED : July 14, 2015
INVENTOR(S) : Koen Simon Herman Beel et al.
It is certified that error appears in the above-identified patent and that said Letters Patent is hereby corrected as shown below:
On the title page:
In the Related U.S. Application Data item (60) for provisional application No. 61/235,219, please
delete "61/235,219" and replace with--61/635,219--
Signed and Sealed this

Fifth Day of January, 2016
Michelle K. Lee
Director of the United States Patent and Trademark Office
Exhibit 3
I 1111111111111111 11111 1111111111 111111111111111 IIIII IIIII IIIIII IIII IIII IIII
US009083769Cl
c12) EX PARTE REEXAMINATION CERTIFICATE (11479th)

United States Patent (10) Number: us 9,083,769 Cl
Beel et al. (45) Certificate Issued: Mar. 15, 2019
(54) ELECTRONIC TOOL AND METHODS FOR (52) U.S. CI.

MEETINGS CPC .......... H04L 41122 (2013.01); G06F 3104842
(2013.01); G06F 9100 (2013.01); G06F
(71) Applicant: BARCO N.V., Kortrijk (BE) 131102 (2013.01); G06F 13114 (2013.01);
G06F 131385 (2013.01); H04L 1211813
(72) Inventors: Koen Simon Herman Beel, Eke (BE); (2013.01); H04L 1211822 (2013.01); H04L
Yoav Nir, Komen (BE); Filip 51100 (2013.01); H04L 65100 (2013.01);
Josephine Johan Louwet, Knesselare H04L 651403 (2013.01); H04L 6514023
(BE); Guy Coen, Aalst (BE) (2013.01); H04L 6514038 (2013.01); H04M
31567 (2013.01); H04N 5100 (2013.01); H04N
(73) Assignee: BARCO N.V., Kortrijk (BE) 7/142 (2013.01)
(58) Field of Classification Search
Reexamination Request: None
No. 90/014,088, Feb. 9, 2018 See application file for complete search history.
Reexamination Certificate for: (56) References Cited

Patent No.: 9,083,769
Issued: Jul. 14, 2015 To view the complete listing of prior art documents cited
Appl. No.: 14/212,170 during the proceeding for Reexamination Control Number
Filed: Mar. 14, 2014 90/014,088, please refer to the USPTO's public Patent
Application Information Retrieval (PAIR) system under the
Certificate of Correction issued Jan. 5, 2016 Display References tab.
Primary Examiner - B. James Peikari

(63) Continuation-in-part of application No. 13/270,659, (57) ABSTRACT
filed on Oct. 11, 2011, now Pat. No. 8,756,348, and An electronic meeting tool and method for communicating
(Continued) arbitrary media content from users at a meeting comprises a
node configuration means adapted to operate a display node
(51) Int. Cl. of a communications network, the display node being
G06F 3106 (2006.01) coupled to a first display. The node configuration means is
G06F 13114 (2006.01) adapted to receive user selected arbitrary media content and
G06F 13138 (2006.01) to control display of the user selected arbitrary media
H04L29/06 (2006.01) content on the first display. A peripheral device adapted to
H04L 12118 (2006.01) communicate the user selected arbitrary media content via
H04N5/00 (2011.01) the communications network is a connection unit compris-
H04L 12158 (2006.01) ing a connector adapted to couple to a port of a processing
G06F 9100 (2006.01) device having a second display, a memory and an operating
H04M 3156 (2006.01) system, and a transmitter. A program is adapted to obtain
G06F 5100 (2006.01) user selected arbitrary media content, said program leaving
G06F 13100 (2006.01) a zero footprint on termination. The user may trigger a
H04L 12124 (2006.01) transfer of said user selected arbitrary media content to said
(Continued) transmitter.

transceiver
:\1.:tualor anJ
Button input device
interna1 ma\,
\'i,ual
device storing
indicator
application
Jlcxihle c01111ectin11 fnr· lbta

,ignals and power
- - - USB device interface

US 9,083,769 Cl
Page 2

a continuation-in-part of application No. PCT/
EP2012/068166, filed on Sep. 14, 2012, and a con-
tinuation of application No. 13/270,659, filed on Oct.
11, 2011, now Pat. No. 8,756,348.
(60) Provisional application No. 61/534,592, filed on Sep.
14, 2011, provisional application No. 61/635,219,
filed on Apr. 18, 2012.
(51) Int. Cl.

G06F 13/10 (2006.01)
G06F 3/0484 (2013.01)
H04N 7/14 (2006.01)
US 9,083,769 Cl
1 2
EXPARTE memory, a display and an operating system with at least one
pre-installed generic driver providing a generic communi-
REEXAMINATION CERTIFICATE cation protocol for communication between the processing
device and a standard class of peripheral devices, the periph-
THE PATENT IS HEREBY AMENDED AS
eral device comprising a memory in which executable
INDICATED BELOW.
software code is stored for execution on the processing
Matter enclosed in heavy brackets [ ] appeared in the device, said executable software code comprising:
patent, but has been deleted and is no longer a part of the a first software code portion for setting up, by means of
patent; matter printed in italics indicates additions made the pre-installed generic driver of the operating system,
10
to the patent. a means for communication between the peripheral
device and the processing device;
AS A RESULT OF REEXAMINATION, IT HAS BEEN a second software code portion for connecting the pro-
DETERMINED THAT: cessing device to a communications network via the
15
peripheral device, the peripheral device having a wire-
Claims 11 and 12 are cancelled. less transceiver; and
Claims 1 and 7 are determined to be patentable as a third processing software code for routing data between
amended. the processing device and the communications network
Claims 2-6, 8-10 and 13-22, dependent on an amended over the means for communication;
claim, are determined to be patentable. 20 wherein the first software code portion is adapted to use
New claims 23-25 are added and determined to be the generic communication protocol for transferring the
patentable. data between the processing device and the peripheral
1. A method for connecting a processing device to a device, and
communications network, the processing device having a an [input device coupled to] actuator on the peripheral
memory, a display and an operating system with at least one 25 device, the [input device] actuator being [adapted to
pre-installed generic driver providing a generic communi- react to] arranged in a way to enable a user action of
cations protocol for communication between processing actuating the actuator to trigger the execution of the
device and a standard class of peripheral devices, the method third processing software code to trigger the processing
comprising the steps of: device to transfer [of] the data from the processing
a) coupling a peripheral device to the processing device, 30 device to the wireless transceiver of the peripheral
the peripheral device having a wireless transceiver and
device via the means for communication and to trans-
an actuator on the peripheral device;
mit the data from the wireless transceiver ofthe periph-
b) setting up, by means of the pre-installed generic driver
eral device to the communications network.
of the operating system, a means for communication
between the peripheral device and the processing 35 23. The peripheral device of claim 7, further comprising
device; a connector arranged to couple to a port of the processing
c) coupling the processing device to a communications device, said connector comprising a flexible data and power
network via the peripheral device; connector, wherein the flexible data and power connector is
configured in a way such that, when the peripheral device is
d) routing screen scraped data on the processing device
between the processing device and the [communica- 40 connected to the processing device in an operating position,
tion] communications network via the means for com- the peripheral device is in a region between an outside edge
munication, wherein the generic communication pro- ofthe processing device and an ergonomic boundary of4000
tocol is used for transferring the screen scraped data square cm, and wherein the actuator has a surface area
[between] from the processing device [and] to the between 100 and 14,400 square mm.
peripheral device by applying a user action by actuat- 45 2 4. The peripheral device ofclaim 2 3, wherein the periph-
ing the actuator to trigger the processing device to eral device is configured in a way such that the communi-
transfer the screen scraped data from the processing cations network is set up between the peripheral device
device to the wireless transceiver of the peripheral coupled to the processing device and the communications
device so that the screen scraped data is transmitted to network without altering or affecting networking capabili-
the communications network via the wireless trans- 50 ties of the processing device.
ceiver. 25. The peripheral device of claim 24, wherein the actua-
7. A peripheral device for providing communication con-
tor is a single button on the peripheral device.
nectivity to a processing device which is provided with * * * * *
Exhibit 4
I 1111111111111111 11111 1111111111 11111 111111111111111 IIIII IIIIII IIII IIII IIII
US008756348Cl
c12) EX PARTE REEXAMINATION CERTIFICATE (11519th)

United States Patent (10) Number: us 8,756,348 Cl
Beel et al. (45) Certificate Issued: May 24, 2019
(54) ELECTRONIC TOOL AND METHODS FOR 1211813 (2013.01); H04L 65/4023 (2013.01);
MEETINGS H04L 65/4038 (2013.01); H04M 3/567
(2013.01)
(75) Inventors: Koen Simon Herman Beel, Lochristi (58) Field of Classification Search
(BE); Yoav Nir, Rekkem (BE); Filip CPC .......... G06F 13/38; H04L 29/06; H04L 29/08
Josephine Johan Louwet, Knesselare USPC .................................... 710/20; 709/206, 221
(BE); Guy Coen, Aalst (BE) See application file for complete search history.
(73) Assignee: BARCO N.V., Belgie (BE) (56) References Cited
Reexamination Request: To view the complete listing of prior art documents cited
No. 90/014,087, Feb. 9, 2018 during the proceeding for Reexamination Control Number
90/014,087, please refer to the USPTO's public Patent
Reexamination Certificate for: Application Information Retrieval (PAIR) system under the
Patent No.: 8,756,348 Display References tab.
Issued: Jun. 17, 2014
Appl. No.: 13/270,659 Primary Examiner - Christopher E. Lee
Filed: Oct. 11, 2011
(57) ABSTRACT
An electronic meeting tool for communicating arbitrary
(60) Provisional application No. 61/534,592, filed on Sep. media content from users at a meeting includes a node
14, 2011. configuration operating a display node of a communications
network that is coupled to a display. The node configuration
(51) Int. Cl. receives user selected arbitrary media content and controls
G06F 13/38 (2006.01) display of the user selected arbitrary media content on the
G06F 3/00 (2006.01) display. At least one peripheral device communicates the
G06F 13/10 (2006.01) user selected arbitrary media content via the communica-
H04L 12118 (2006.01) tions network. The peripheral device is a connection unit
H04L 29106 (2006.01) including a connector that couples to a port of a processing
G06F 9/445 (2018.01) device having a second display, a memory and an operating
G06F 3/16 (2006.01) system; and a transmitter communicating with the commu-
H04M 3/56 (2006.01) nications network. A program is provided to run on the
(52) U.S. Cl. operating system of the processing device and obtains user
CPC .............. G06F 13/102 (2013.01); G06F 3/16 selected arbitrary media content, while leaving a zero foot-
(2013.01); G06F 9/44505 (2013.01); H04L print on termination.
64
60 !~ 48 62
''-----., Portable Input ./ Base node
application Device / / Program
I I
/
4/
31
----------
-----, Client
Processing
Device - Connector
Unit
/
Transmitter ·-· ·- Base Node
Display/
Projector
I
Visual - - 61
Indicator 63 36 44
US 8,756,348 Cl
1 2
EXPARTE a wireless transmitter arranged to communicate with
the communications network, and an actuator on the
REEXAMINATION CERTIFICATE peripheral device,
loading a program onto the processing device and running
THE PATENT IS HEREBY AMENDED AS the program on the operating system of the processing
INDICATED BELOW. device to obtain user selected arbitrary media content,
said program leaving a zero footprint on termination,
Matter enclosed in heavy brackets [ ] appeared in the and
patent, but has been deleted and is no longer a part of the triggering transfer of said user selected arbitrary media
patent; matter printed in italics indicates additions made
10 content to said wireless transmitter of the peripheral
to the patent. device through said port after a user action on [an input
device] the actuator of the peripheral device,
AS A RESULT OF REEXAMINATION, IT HAS BEEN
wherein the triggering comprises actuating the actuator
DETERMINED THAT:
on the peripheral device to send a signal to the pro-
Claims 3 and 6-9 are cancelled. 15 cessing device to trigger the processing device to
transfer said user selected arbitrary media content to
Claims 1 and 12 are determined to be patentable as said wireless transmitter through said port to transmit
amended. said user selected arbitrary media content to the dis-
Claims 2, 4, 5, 10, 11 and 13-20, dependent on an play node via the communications network.
amended claim, are determined to be patentable. 20 21. The electronic meeting tool of claim 5, wherein the
New claims 21-26 are added and determined to be connector of the peripheral device further comprises a
patentable. flexible data and power connector, wherein the flexible data
1. An electronic meeting tool for communicating arbitrary and power connector is configured in a way such that, when
media content from users at a meeting comprising: the peripheral device is connected to the processing device
a node configuration arranged to operate a display node of 25 in an operating position, the peripheral device is in a region
a communications network, the display node being between an outside edge of the processing device and an
coupled to a first display, the node configuration further ergonomic boundary of 4000 square cm, and wherein the
being arranged to receive user selected arbitrary media actuator has a surface area between 100 and 14,400 square
content and to control display of the user selected mm.
arbitrary media content on the first display; 30 22. The electronic meeting tool of claim 21, wherein the
at least one peripheral device configured to communicate electronic meeting tool is configured in a way such that the
the user selected arbitrary media content via the com- communications network is set up between the at least one
munications network, wherein the peripheral device is peripheral device coupled to the processing device and the
a connection unit comprising: node configuration without altering or affecting networking
(a) a connector arranged to couple to a port of a 35 capabilities of the processing device.
processing device having a second display, a 23. The electronic meeting tool of claim 22, wherein the
memory and an operating system; [and] actuator is a single button on the at least one peripheral
(b) a wireless transmitter arranged to communicate device.
with the communications network; 24. The electronic meeting tool of claim 1, wherein said
(c) an actuator on the peripheral device, wherein said 40 transfer ofsaid user selected arbitrary media content to said
actuator is arranged in a way to enable the user to wireless transmitter through said port to the node configu-
carry out a user action by actuating the actuator to ration via the communications network comprising auto-
trigger the processing device to transfer said user matically transferring said user selected arbitrary media
selected arbitrary media content to said wireless content to the node configuration to force the displaying of
transmitter through said port to transmit said user 45 the user selected arbitrary media content on the first display.
selected arbitrary media content to the node con- 25. The electronic meeting tool of claim 1, further com-
figuration via the communications network; and prising
a program configured to be loaded onto the processing a second external peripheral device configured to com-
device and to run on the operating system of the municate a second user selected arbitrary media con-
processing device, said program being arranged to 50 tent via the communications network, wherein the sec-
obtain user selected arbitrary media content, said pro- ond external peripheral device is a second connection
gram leaving a zero footprint on termination[, and unit comprising:
an input device enabling the user to carry out a user action (a) a second connector configured to couple to a second
that triggers transfer of said user selected arbitrary port of a second processing device having a second
media content to said transmitter through said port]. 55 display, a second memory, and a second operating
12. A method for communicating arbitrary media content system;
from users at a meeting comprising: (b) a second wireless transmitter configured to com-
operating a display node of a communications network, municate with the communications network;
the display node being coupled to a first display, to (c) a second actuator on the second external peripheral
receive user selected arbitrary media content and to 60 device, wherein said second actuator is configured to
control display of the user selected arbitrary media enable the second user to carry out a second user
content on the first display; and action by actuating the second actuator to trigger a
connecting a peripheral device to a port of a processing second transfer of said second user selected arbi-
device and communicating the user selected arbitrary trary media content to said second wireless trans-
media content via the communications network, 65 mitter through said second port to transmit said
wherein the peripheral device comprises a connector second user selected arbitrary media content to the
arranged to couple to the port ofthe processing device, node configuration via the communications network,
US 8,756,348 Cl
3 4
wherein the second actuator is a second single
button on the second external peripheral device; and
a second software code configured to be loaded from the
second external peripheral device onto the second
processing device and to run on the second operating
system of the second processing device, said second
software code being configured to obtain the second
user selected arbitrary media content, said second
software code configured to display said second user
selected arbitrary media content when the second 10
single button is pushed, and said second software code
leaving a zero footprint on termination.
26. The electronic meeting tool of claim 25, wherein said
operating system is different from said second operating
system. 15
* * * * *
Exhibit 5
I 1111111111111111 111111111111111 IIIII IIIII 11111 11111111111111111 II IIIII IIII
US00D699241S
c12) United States Design Patent (10) Patent No.: US D699,241 S

Moors et al. (45) Date of Patent: ** Feb. 11, 2014
(54) PERIPHERAL DEVICE FOR COMPUTERS D368,097 S * 3/1996 Heberling et al ............ D14/242
D369,355 S * 4/1996 Li ................................ D14/188
(75) Inventors: Bert Moors, Kortrijk (BE); Steven
D379,993 S * 6/1997 Devitt et al. ................. D14/240
D384,057 S * 9/1997 Lee et al. ..................... D14/135
Vindevogel, Zwevegem (BE); Tom D394,266 S * 5/1998 Hogenbirk ................... D14/240
Dewaele, Kapellen (BE); Simon De D407,076 S * 3/1999 Renk ............................ D14/301
Smet, Kontich (BE); Timothy Macken, D412,160 S * 7/1999 Nelson ......................... D14/435
Diest (BE)
D412,940 S * 8/1999 Kato et al. ................... D21/324
D413,021 S * 8/1999 Wheatley et al ............. D14/240
D420,362 S * 2/2000 Pedraza et al. ............... D14/242
(73) Assignee: Barco NV, Kortrijk (BE) D429,244 S * 8/2000 Hu ............................... D14/348
D446,209 S * 8/2001 Rickford et al .............. D14/357
(**) Term: 14 Years D453,019 S * 1/2002 Oba ............................. D14/348
D464,958 S * 10/2002 Coker et al .................. D14/240
(21) Appl. No.: 29/421,093 D469,026 S * 1/2003 Hoofnagle et al. ............ D 10/78
D486,819 S * 2/2004 Wilson ......................... D14/240
(22) Filed: May 21, 2012 (Continued)
OTHER PUBLICATIONS
(30) Foreign Application Priority Data
GadgetBB News Blog>> 2008 >>August>> 27, [online] Aug. 27,
Nov. 21, 2011 (EP) .......................... 001303101-0001 2008 [retrieved on Nov. 25, 2008]. Retrieved from the Internet
Nov. 21, 2011 (EP) .......................... 001303101-0002 <URL: http://www.gadgetbb.com/2008/08/27/page/2/>. *
Nov. 21, 2011 (EP) .......................... 001303101-0003
Nov. 21, 2011 (EP) .......................... 001303101-0004 Primary Examiner - Karen E Kearney
Nov. 21, 2011 (EP) .......................... 001303101-0005 (74) Attorney, Agent, or Firm - Bacon & Thomas, PLLC
Nov. 21, 2011 (EP) .......................... 001303101-0006
Nov. 21, 2011 (EP) .......................... 001303101-0007 (57) CLAIM
(51) LOC (10) Cl. ................................................ 14-02 The ornamental design for a peripheral device for computers,
(52) U.S. Cl. as shown and described.
USPC ......................................................... D14/356 DESCRIPTION
( 58) Field of Classification Search
USPC ........ D14/300-302, 314, 348-370, 383-385, FIG. 1 is an upper perspective view of a first embodiment of
D14/435,496, 125,135, 155,240-242, our design;
D14/299; D31273; D91432; Dl0/65, 75, 78; FIG. 2 is a rear elevation view thereof;
D13/103, 119,162,184,199; FIG. 3 is a bottom plan view thereof;
361/679.31-679.45; 312/223.2 FIG. 4 is a front elevation view thereof;
See application file for complete search history. FIG. 5 is a left side elevational view of the body of the device,
the right side being a mirror image thereof; the left elevational
(56) References Cited view of the cable is shown, the right side elevational view is a
U.S. PATENT DOCUMENTS mirror image of the left side; and,
FIG. 6 is top plan view thereof.
D274,048 S * 5/1984 Wong et al. ............... D10/106.1
D307,274 S * 4/1990 Sasaki et al .................. D14/243 1 Claim, 6 Drawing Sheets
US D699,241 S
Page 2
(56) References Cited D537,445 s * 2/2007 Bousfield ..................... D14/383

D544,881 s * 6/2007 Yang et al. ................... D14/496
U.S. PATENT DOCUMENTS 7,298,583 B2 * 11/2007 Miyazaki et al. .......... 360/99.23
7,441,256 B2 * 10/2008 Choi et al. .................... 720/648
s Asaka et al. ................. D579,871 s * 11/2008 Hsiau ........................... D13/133
D487,430 * 3/2004 D13/182
D580,932 s * 11/2008 Tzou et al. ................... D14/356
D487,460 s * 3/2004 Lee .............................. D14/368
s Arakaki et al. .............. D585,060 s * 1/2009 Han ............................. D14/358
D491,953 * 6/2004 D14/453
D597,535 s * 8/2009 Brennwald .................. D14/240
D512,061 s * 11/2005 Sato et al. .................... D14/363
s Sato et al. .................... D598,436 s * 8/2009 Tseng .......................... D14/240
D514,564 * 2/2006 D14/363
D514,570 s * 2/2006 Ohta ............................ D14/384
D530,325 s * 10/2006 Kerila et al. ................. D14/356 * cited by examiner
U.S. Patent Feb.11,2014 Sheet 1 of 6 US D699,241 S
FIG. I
FIG. 2
FIG. 3
FIG. 4

FIG. 6

Exhibit 6

US Patent No. 9,083,769
Accused Product: LauncherPlus
Representative Claim 1 Exemplary Evidence of Infringement

1[pre] A method for connecting The Accused Product comprises a method for connecting a processing device to a communications
a processing device to a network, the processing device having a memory, a display and an operating system with at least
communications network, the one pre-installed generic driver providing a generic communications protocol for communication
processing device having a between processing device and a standard class of peripheral devices.
memory, a display and an
operating system with at least Connecting a processing device to a communications network:
one pre-installed generic driver
providing a generic See, e.g.,
communications protocol for
communication between The plug -and-pray LauncrierPlus ensures tnat meeting participants' Iap1op computers Wlre1ess1y connec1 within seconds to the NovoEnterpnse main unn tor your presentations.
Jus1 slmpllfy chc collaboration In any conference room.
processing device and a

standard class of peripheral https://www.vivitekusa.com/productdetail/LauncherPlus/#
devices, the method comprising
the steps of: The processing device having a memory:
See e.g.,
Windows 7 / 8 / 10 (32 bits and 64 bits). Mac 10.7+,

OS support
10 S 7. 0 and above, Android 4.0 , Chromebook 37+
~ '., ... ..
https://www.vivitekusa.com/forcedown?file_path=_gendownloads/21dea44f-0039-4816-9966-
9bc517574be2/&file_name=DS_NovoEN_050718_V2.pdf1

1
By way of example, the Windows 10 operating system requires at least 1GB RAM (memory). See https://www.microsoft.com/en-
us/windows/windows-10-specifications#primaryR2
-1-
US Patent No. 9,083,769 || Accused Product: LauncherPlus

The processing device having a […] display:
Windows 7 / 8 / 10 (32 bits and 64 bits). Mac: 10.7+,

OS support
IOS 7_0 and above, Android 4.0 . Chromebook 37+
The processing device having […] an operating system:
See, e.g.,
COMPATI.BLE WITH WlttOOWS AND MAC OS

Odlgne(IH•V11~.lttftMll'J L • 1 1 ~ 1 t ~IJl!lt•GI
WftOg.,1,.-J ;Mill l,Ut cp«fil!if"9 ,y1r,rm1 TM~INt ... lnfflll"i! INl~IIU
IO(Olltoof.le ii!~U~ ll'tk <lc'fl(t
https://www.vivitekusa.com/productdetail/LauncherPlus/
And see:
Windows 7 / 8 / 10 (32 bits and 64 bits), Mac: 10_7+,

OS support
iOS 7_0 and above, Android 4_0 . Chromebook 37+
9bc517574be2/&file_name=DS_NovoEN_050718_V2.pdf

2
By way of example, the Windows 10 operating system requires a display that is at least 800x600 pixels. See
https://www.microsoft.com/en-us/windows/windows-10-specifications#primaryR2
-2-

[…] with at least one pre-installed generic driver providing a generic communications protocol for
communication between processing device and a standard class of peripheral devices:
See e.g.,
The pli.,g-aM,f)lay Ll~Plul l!ftlllfK 1ti.a1 ~ Plllidpanb" llpllOf) CCWl'.fl"Jlen 'lflltetietMj CONlecl tflllCWI MCDMI ID lhe NowlErde,prlte n-, unit kit 'tf'NI pr8MUUOl"lt
N:11 ~~ the ~ a t k l n In ~111 conlierence room
DIRECT CONNECTIVITY
B"1Ml'I\Yrpi~La~Pfulh'lltlallli~ll"IIUS8.11MBCMffWJliifl
a ialll"dl. ,11(1-hr;,c; 1111'-.,;1i;:i;inntd:lon101hloll N~n1ICl'psiso unll w11hoUt
1mptcungt1w1.ecur\'lyd ll'leircarl)O(Jiliinetwaf\.
https://www.vivitekusa.com/productdetail/LauncherPlus/#
And see:
TRULY PLUG-N-PLAY WITH LAUNCHERPLUS*

For added convenleocc and vcnatlht)', NovoE.nterprl,c can be enh:lnced
\\tth L:;nmch~Prus, a drlvl!f-lrtt, ph.19-n.play-to-dlspla.y solutlon comp3tlble
whh both Windows and Mac. compute!'S.
·Launehel"Prus; sold separately
https://www.vivitekusa.com/productdetail/NovoEnterprise/
-3-

And see:

OS support
10S 7_0 and above, Android 4.0 . Chromebook 37+
1[a] coupling a peripheral The Accused Product comprises coupling a peripheral device to the processing device, the
device to the processing device, peripheral device having a wireless transceiver and an actuator on the peripheral device.
the peripheral device having a
wireless transceiver and an Coupling a peripheral device to the processing device:
actuator on the peripheral
device; See, e.g.,
Thi ~)'l"""""'~"'"""•""'"'91!1UII;~' li!PIOPCOffl'l,ll«l ..-•t!leMtrconNa•1U'WnN00110ttDU.Nowofl'l!e,1l"M'"4'1ft\jllfllOf~,rfllfl'ltlillOIII
>iill llffijllll1 lhl ailt&IICJIIO'I In ar,r conftctra l'OOffl
DIRE.CT CONNECTIVI TY
!yMT,pty pll.qglnQUund'lelPIIJS.-.0 •lilfll.0p'WlolUS8 ,uwnc.i
•ct11ea. ldohotwi!e.lePconnedlcrltotttelf No'dtltetpnt,eunt
l~ltlll9eCUr11)'ollhelroorpor.ill'MtwOI"-
..,ltall
nt.,o11t1'1

3
By way of example, “Windows operating systems include native support for USB host controllers, hubs, and devices and systems
that comply with the official USB specification.” See https://docs.microsoft.com/en-us/windows-hardware/drivers/usbcon/ (emphasis
added).
-4-

[…] the peripheral device having a wireless transceiver […] on the peripheral device:
See, e.g.:
OperaUng System Compa!Jble wi th Windows & Mac OS

Wifi Embedded WIFI
LauncherPlus
70x70x14 mm/ 60g
Dimension & Weight
2.76 x 2.76 x 0.5 5 inches/ 0.13 lbs
And see:
FCC- ederal Communicaoon Commissioo (USA)

Thls device conralns the fo lowJrig wlrele-:ss device arid un.derwent tl:1e
cenlficaliori process of FCC Part 15 Subpart B I CISPR 22 ET Docket o. 95-19
urider tl:1e re-:specllve CC ID Below:
• FCCID: Hi79ES SQL300
Th.@ FCC ID is Indicated as lhe labiel affixed ori lh@ bottom side at your device.
https://www.vivitekusa.com/forcedown?file_path=_gendownloads/e6dcc47a-cdbd-4dc8-a9d6-
a24d6594bb9b/&file_name=LauncherPlus%20QG_Vivitek_EN%20(0928).pdf
-5-

[…] the peripheral device having […] an actuator on the peripheral device:
See, e.g.,
l
® After the launcherPlus has found lhe Novo Pro. the main button on the
LauncheIPlus l,ghts up red. Prm.s lhe butloo Ill begin pres1mUng.
1[b] setting up, by means of the The Accused Product comprises setting up, by means of the pre-installed generic driver of the
pre-installed generic driver of operating system, a means for communication between the peripheral device and the processing
the operating system, a means device.
for communication between the
peripheral device and the See, e.g.,
processing device;
TRULY PLUG-N..PLAY WlTH LAUNCHERPLUS•

For aooed c c n ~ .and YetUllllty NcwoEnterp,tN can be ennanced
,-,-.1.a~F'lu• •~r-'rN. ~)'•lo.<llaplayDIOon~;t,,,e
IMIJIDQlhY.lndoWl~Milc~lcfl
-6-

And see:
-- -- --
OS support
- ." '" ..
And see:
~~- ·:::r - ..... _..._ ....... ~~,
I L e;-Plus
Oper~t,ng S.,,Slk!-m
WI!,
,.,.....,,.,., . ~ u , ............
Compatible w!ll \'{indcw-s & Mac OS
E:mtieoded WIR
1D<70A1•1 mm/ 600

4
added).
-7-

And see:
The plug-and-play LauncherPlus ensures that meeting participants' laptop computers wireless ly connect within seconds to the NovoEnterprise main unit for you r presentations
Just simplify the collaboration in any conference room .
USB
DIRECT CONNECTIVITY
By simply plugging LauncherPlus into a laptop via USB, users can establish
a direct. ad-hoc wireless connection to their NovoEnterprise unit, without
Impacting the security or their corporate network.
And see:
Compatible w ith v irtually all com pute rs, tab lets, and othe r smart devices,
NovoEnterprise ca n be e nh anced w ith the Launche rPlus accessory or
instant screen mirroring from t he press of a butto n.
-8-

And see:
The plug-and-play Launcher Plus ensu res that meet ing participant s' laptop computers wi relessly connect w it hin secon ds t o t he Novo Ent erprise
main unit. The Launche rPlus is a USB device t hat plugs directly into the laptop and t hanks to it s em bedded Wi Fi, it strea m s laptop content
effortlessly t o the big screen. The LauncherPlus is especially co nvenient for visit ing guests, or w hen co lleagues from other offices are on site.
Further more, as it is driver-free, no trace or residue is left on laptops after t hey disconnect.
https://www.ravepubs.com/vivitek-novoenterprice-launcherplus-additions-wireless-
collaboration-system/
1[c] coupling the processing The Accused Product comprises coupling the processing device to a communications network via
device to a communications the peripheral device.
network via the peripheral
device; See, e.g.,
Triit plug-and-pt.y Uiundlcrptui. c:m;u1ei. lhitl metlm!J pl111\1C:1piimts' lapeop c:cmputcrs v.11ck.•uly connCN:1 wllhlfl secofl01. 10 the NovoE.nltupn:»Ct ma111 unil fOf you, PfC!rt:nl•~nt
JU$t \lmpllf't tne CQll<1b0fation WI .Jny conier~ce room
DIRECT CONNECTIVITY
Br :lilfflpl)' ph,gi,1nv Li1unc:ht1Plus inco a laptop Yt• OSB Ul.e-15 CtHI e-stabkti
a 01rea .)Cl noc V1olreJe$$ c.onneaion to 1ne1, No~oen1i,pr15e un11 'li\ilMut
•
lmp•cUng the a.etvrlty of the C:Ofporatc network
-9-

And see:
What is LauncherPlus? Basic device specifications

Launche rP lus is a USB modu le that allows for the
w ireless trans fer of images from a Windows or Mac
computer to the NovoPro or Novo Enterprise
system . This is in turn connected via HDMI to a
display, which cou ld be a monitor or a projector.
Compared with the Launcher mode l (without Plus),
the new version comes with a bu ilt-in Wi-F i module
that allows for a direct connection between
Launche rPlus and NovoEnterprise or NovoPro, Launc herPlus
w ithout the need to use a module bui lt into the
Model QL300
laptop. Th is allows the user to be connected to the
Novo Pro and another Wi-F i network at the same Support
Operating Windows 7 / 8 / 10 (32 bit s and
time. This improves connection speed, and 64 bi ts), Mac 10. 7 and above
System
there fore the qual ity and smoothness of the
Wifi em beded Wifi
displayed materi al.
Dimensions
7 0 x 70 x 14 mm
(L X W X H)
Weight 60 g
https://novoconnect.eu/knowledge/collaboration-blog/launcherplus-quick-unboxing-tests/
1[d] routing screen scraped data The Accused Product comprises routing screen scraped data on the processing device between the
on the processing device processing device and the communications network via the means for communication, wherein the
between the processing device generic communication protocol is used for transferring the screen scraped data from the
and the communications processing device to the peripheral device by applying a user action by actuating the actuator to
network via the means for trigger the processing device to transfer the screen scraped data from the processing device to the
communication, wherein the wireless transceiver of the peripheral device so that the screen scraped data is transmitted to the
generic communication protocol communications network via the wireless transceiver.
is used for transferring the
screen scraped data from the Routing screen scraped data on the processing device between the processing device and the
processing device to the communications network via the means for communication:
peripheral device by applying a
user action by actuating the See, e.g.:
actuator to trigger the
processing device to transfer the
- 10 -

screen scraped data from the
processing device to the
wireless transceiver of the
peripheral device so that the
screen scraped data is
transmitted to the
communications network via the
wireless transceiver.
•
LAUNCHERPLUS PLUG-N-PLAY SCREEN MIRROR ING"
The optional LauncherPlus accessory allows users to instantly share their
screen across their NovoPro-connected display with a single button press -
no software drivers required _Compatible with both Windows and Mac
computers, LauncherPlus connects via USS to offer truly plug-n-play
functionality.
• LauncherPlus sold separately.
http://novopro.vivitekusa.com/
And see:
Q) Your computer's screen Is shown on the dlspJay.
- 11 -

[…] wherein the generic communication protocol is used for transferring the screen scraped data
from the processing device to the peripheral device:
See, e.g.,
Thoe- pli,g..11na pl:lly La11nc~1us !'nsu,n ina1 ~eung p,mc1panu· lap,op computers 11,1,elHS'Y connec• Wlfl'lln s«ell(li lO tile MovoCllterprtse- l'l&ln 11nM for your pre.se11111i,on,
JliHol hlTl,Ol,fy U'IC COll.tl0(1UOf'l II\ 11\j C.On!C:rCflC.C (ootf\
IJIREC T CONNECTlVITY
av ,amptJ pll,igguMJ LJHJntnerPm,: •uo ,!I L,citOJ:1 v" USS u,.er, can es.ts.l!a,,l'I
ii Clir«l ,il(l-l'!OC 'illll'tJH$ C.CMC~IOh to 11'1Clr NOvoEnt«Pf!K UM '1'11.1~1
lmpael1n!ill tlle see.i1~r of 11\el, Q.lfpo101c nctworl
And see:
TRULY PLUG-N-PLAY WITH LAUNCHERPLUS•

r=or added 1corwenlence and venaUllty, NovoEnterprfsc can be enhanced
~th La1.1ncherPfus, a drh,.et.lree, ph.19-n..play.to-dbplay solution comp.11lble
whh both Windows and Mae computers.
•Launchef Prus; .sold separ.nely
- 12 -

And see:

OS support
[…] by applying a user action by actuating the actuator to trigger the processing device to transfer
the screen scraped data from the processing device to the wireless transceiver of the peripheral
device so that the screen scraped data is transmitted to the communications network via the
wireless transceiver.
See, e.g.,
::::Il• ..,__ _ _ _ _ _ _ _ _ _ _ _ _ _ __,.
@ Afier th@ Laum:tl@rPlus has found lhe NovoPro, lllfl main button on the
LlluncherPtus lights up red _ Press lhe button. I.CJ begin presenting_

5
added).
- 13 -

And see:
=- 111.. !11.
.=.~
'I T•
® Press any comer button on the LauncherPlus to project your computer's

screen onto the corresponding quadrant of the display.
And see:
The plug-and-play Lau ncherPlus ensures tihat meeting1partic ipants' laptop computers wire less ly
connect with in seconds to the NovoEnterprise mai n unit The LauncherPlus is a USB device
t hat plugs direct1ly into the l aptop and thanks to its embedded Wifi , it streams laptop content
effortlessly to the big screen _ Th e Launche rP lus is especially conve nient for vis iting guests, or
when colleagues from other offices are on site_
https://vivitek.co.uk/company/press-releases/vivitek-launches-novoenterprise-and-launcherplus-
as-the-supreme-choice-for-wireless-collaboration/
- 14 -

And see:

Launche rP lus is a USB modu le that allows for the
w ireless trans fer of images from a Windows or Mac
computer to the NovoPro or Novo Enterprise
system . This is in turn connected via HDMI to a
display, which cou ld be a mon itor or a projector.
Compared with the Launcher mode l (without Plus),
the new version comes with a bu ilt-in Wi-F i modu le
that allows for a direct connection between
Launche rPlus and NovoEnterprise or NovoPro, Launc herPlus
w ithout the need to use a module built into the
Model QL300
Novo Pro and another Wi-F i network at the same Support
Opera t ing Windows 7 / 8 / 10 (32 bits and
time. This improves connection speed, and 64 bits), Mac 10. 7 and above
System
there fore the qual ity and smoothness of the
Wi f i embeded Wifi
displayed materi al.
Dimensions
70 x 70 x 14 mm
(L X W X H)
Weight 60 g
And see:
The plug-and-p lay LauncherPlus ensures t hat meet ing participants' lapt op co m put ers wire:lessly co nn ect within seconds t o th e
NovoEnt erprise main unit e Launchei:Plu s is a USB device t hat lugs directl y int o t he laf:!t op and t ha nks t o its beJ:ided-Wi.Ei
it st reams lapto p content effort less ly t o t he big sc reen. The Launcher Plus is especially co nvenient for ~isit ing gu ests, o r when
colleagues from other offic es: are on sit e. Furt her mor e, as it 1is d river-free, no t race or res idue is left on lapt ops after t hey
disconnect.
collaboration-system/.
- 15 -
Exhibit 7
U.S. Patent No. 8,756,348
Accused Product: LauncherPlus

1[pre] An electronic meeting tool The Accused Product comprises an electronic meeting tool for communicating arbitrary media
for communicating arbitrary content from users at a meeting.
media content from users at a
meeting comprising See, e.g.:
The plug-and-play LauncherPlus ensures that meeting participants' laptop computers wireless ly connect within seconds to the NovoEnterprise main unlt for your presentations.
Just simplify the collaboration in any conrerence room .
USB
DIRECT CONNECTIVITY
a direct , ad-hoc wireless connection to their NovoEnterprise unit, without
impacting the security or the ir corporate network.
-1-
U.S. Patent No. 8,756,348 || Accused Product: LauncherPlus

1[a] a node configuration The Accused Product comprises a node configuration arranged to operate a display node of a
arranged to operate a display communications network, the display node being coupled to a first display, the node
node of a communications configuration further being arranged to receive user selected arbitrary media content and to
network, the display node being control display of the user selected arbitrary media content on the first display.
coupled to a first display, the
node configuration further being A node configuration arranged to operate a display node of a communications network, the
arranged to receive user selected display node being coupled to a first display:
arbitrary media content and to
control display of the user See, e.g.:
selected arbitrary media content
on the first display The plug-and-play LauncherPlus ensures that meeting participants' laptop computers wireless ly connect withi n seconds to the NovoEnterprise main unit for your presentations.
DIRECT CONNECTIVITY
a direct, ad-hoc wireless connection to their NovoEnterprise unit, without
impacti ng the security of the ir corporate network .
And see:
-2-
HDMI connector on NovoEnterprise

unit for connection to a display.
[…] the node configuration further being arranged to receive user selected arbitrary media content
and to control display of the user selected arbitrary media content on the first display:
See, e.g.,:
l
® Afu!r th@ Laum:tunPlus has foond lhB NovoPra, lh@ main button on the
LauncherPtus lights up md. Press lhB button. I.Cl begin prnsenllng.
-3-

And see:
r • •
(!) Your computer's screen is shown on lhe display.

And see:
The plug-and-play LauncherPlus ensures t:hat meet1ing participants' laptop computers wire lessl y
connect within seconds to the NovoEnterprise main unit. The LauncherPlus is a USB device
that plug1s directly into the laptop and thanks to its embedded WiFi , it streams laptop content
effortlessly to the big screen . The LauncherPius is especially convenient for vis iting guests, or
when colleag1ues from other offices are on site.
-4-

And see:

Launche r Plus is a USB m odu le tha t allows fo r the
w ireless t ransf er of images from a Windows o r Mac
co m pute r t o the NovoP ro or Novo Enter pr ise
system. This is in turn connected via HDMI to a
d isplay, which could be a mon itor o r a proj ecto r.
Compar ed w ith the Launcher m ode l (wit hout Plus),
the new vers ion comes with a bu ilt-in Wi-Fi modu le
that allows for a d irect connec t ion between
Launche r Plus and NovoEnte r pr ise o r NovoPro, La unc herPlus
w ithout the need t o use a module bui lt int o the
Model QL300
lap t op. This allows t he user to be connect ed t o the
Novo Pro and ano t her Wi-Fi networ k at t he same Support
Windows 7 / 8 / 10 (32 bits and
Operating
t ime. Th is improves connec t ion speed, and 64 bits) , Mac 10 . 7 and above
System
the refore the qual ity and smoothn ess of the
W iFi embeded WiFi
d isplayed ma t eri al.
Dimensions
70 x 70 x 14 mm
(L X W X H)
We ig ht 60 g
And see:
Specifications
I
MODEL t>lAME NE3000U50L2
W 802.11 ll•'c}'n, 2.~GH2J%Hz
_An_1en_na_ _ _ _ _ _ _ _ _E.:_i _
em_a_ up_to_3_00_Mb__p,_ _ _ _ _ _ _ _ _ __
12_r_2R____
..
............... _ -
https://www.vivitekusa.com/forcedown?file_path=_gendownloads/21dea44f-0039-4816-
9966-9bc517574be2/&file_name=DS_NovoEN_050718_V2.pdf
-5-

1[b] at least one peripheral device The Accused Product comprises at least one peripheral device configured to communicate the
configured to communicate the user selected arbitrary media content via the communications network, wherein the peripheral
user selected arbitrary media device is a connection unit comprising a connector arranged to couple to a port of a processing
content via the communications device having a second display, a memory and an operating system.
network, wherein the peripheral
device is a connection unit At least one peripheral device configured to communicate the user selected arbitrary media
comprising: content via the communications network:
(a) a connector arranged to
couple to a port of a See, e.g.,
processing device having
a second display, a The plug-and-play LauncherPlus ensures that meeting participants' laptop computers wireless ly connect withi n seconds to the NovoEnterprise main unit for your presentations.
memory and an operating Just simplify the collaboration in any conference room .
system;
(b) a wireless transmitter
arranged to communicate
with the communications
network;
(c) an actuator on the
peripheral device, wherein
said actuator is arranged
in a way to enable the
user to carry out a user
action by actuating the
actuator to trigger the DIRECT CONNECTIVITY
processing device to By simply plugging LauncherPlus into a laptop via USB, users can establish
a direct, ad-hoc wireless connection to their NovoEnterprise unit, without
transfer said user selected impacti ng the security of the ir corporate network .
arbitrary media content to

said wireless transmitter https://www.vivitekusa.com/productdetail/LauncherPlus/#
through said port to
transmit said user selected
arbitrary media content to
the node configuration via
-6-

the communications And see:
network
https://fccid.io/H79ESSQL300/Internal-Photos/Internal-Photos-3403542
wherein the peripheral device is a connection unit comprising a connector arranged to couple to
a port of a processing device having a second display, a memory and an operating system
See, e.g.,
COMPATIBLE W1TH WINDOWS AND MAC OS

0~1g11C'O ~ ~ IIM'C-n.ilt ~"~iOIY- L;nmdlc1Pl115 G ,u:11y <=l>lnP'il'IDlt Y<Cn
Wl!»O'A., ano Mac OpeB ·ng sy,ttms T"" enaoie.s all mee-tlng ~ruetpants
to co11.moci11tc rC-1tllr'Cll~U Of tltclt OC~fCC-
-7-

And see:

OS support
And see:
TRULY PLUG-N-PLAY WITH LAUNCHERPLUS•

For added convtinlence and -..en.atlllt)', NCt\'GEnt&rpl~ can ba l!nh.inced
~th L:.1unch~Pl'-us, a drl\le1Jree, plug.n.pLay.to-dl5,pl.ay solution comp::ulble
wilh both Windows and Mac. computer'S.

1
By way of example, the Windows 10 requires at least a 600x800 pixel display, 1GB RAM (memory), and is an operating system.
See https://www.microsoft.com/en-us/windows/windows-10-specifications#primaryR2
-8-

[…] wherein the peripheral device is a connection unit comprising […] a wireless transmitter
arranged to communicate with the communications network:
See, e.g.:
Operaung System Compal.Ible with Windows & Mac OS

Wifi Embedded WIFI
LauncherPJus
70x70x14 mm/ 60g
Dimension & Weight
2.76 x 2.76 x 0.55 inches/ 0.13 lbs
And see:
FCC - Fedei"al Communu::aoon Comm1ss1on tUSA)

This device contains the fa lowlng wirele-ss device and un.dei:went itle
csl1ificalion process of FCC Part 15 Subpart B I C SPR 22 ET Docket No. 95-19
under itle r~peclive CC ID Below:
• FCCID: H79ESSQL300
Th@ FCC ID is indicated as Ille laoeJaffixed on 111@ bottom side ol your device.
-9-

[…] wherein the peripheral device is a connection unit comprising […] an actuator on the
peripheral device, wherein said actuator is arranged in a way to enable the user to carry out a user
action by actuating the actuator to trigger the processing device to transfer said user selected
arbitrary media content to said wireless transmitter through said port to transmit said user selected
arbitrary media content to the node configuration via the communications network.
See, e.g.,
l l
® Alier the LaunctierPlus has found lhe NovcPrc, lhe main button on the
L.au:nchBrP us ltghts up rnd. Press lhe buttoo o begin presenting.
- 10 -

And see:
. .:;, .b_J_
·-
~ I
JI
@ Press arry comer button ori th@ Launcl1erPlus Lo project your computer's
screen onto 111@ oorrespondlng quadrant oftlw!- display.
And see:
. . .
Compatible w ith virtually all compute rs, tab lets, and ,o the r smart devices,
NovoEnterprise ca n be e nh anced w ith the Launche rPlus accessory or
instant screen mirroring from t he press ,of a butto n.
- 11 -

And see:
The plug-anid-play LauncherPlus ensures t1hat meeting participants' laptop computers wirelessly
connect with in seconds to the NovoEnterprise main unit The LauncherPlus is a lJSB device
that plugs directly into the laptop and thanks to its embedded WiFi , it streams laptop content
effortlessly to the big screen . The LauncherPlus is especially conven ient for vis iting guests, or
when col leag1ues from other offices are on site.
And see:

Launche rPlus is a USB modu le that a llows for the
w ireless t ransfer of images from a Windows o r Mac
compute r to the NovoPro or NovoEnter pr ise
system. This is in turn connected via HDMI to a
d isp lay, which could be a mon itor or a projector.
Compared w ith the Launcher m ode l (without Plus),
the new vers ion comes with a bu ilt-in Wi-F i modu le
that al lows for a d irect connect ion between
Launche rPlus and NovoEnte rprise or NovoPro, LauncherPlus
w ithout the need to use a module bui lt into the
Model QL300
Novo Pro and another Wi-F i networ k at the same Support
Windows 7 / 8 / 10 (32 bits an d
Op era ti ng
t ime. Th is im proves connect ion speed, and 64 bits ), Mac 10. 7 and above
System
therefore the quality and smoothness of the
W iFi embeded W iFi
d isp layed material.
Dimensions
(L X W X H)
70 x 70 x 14 mm
We ig ht 60 g
- 12 -

1[d] a program configured to be The Accused Product comprises a program configured to be loaded onto the processing device
loaded onto the processing device and to run on the operating system of the processing device, said program being arranged to
and to run on the operating obtain user selected arbitrary media content, said program leaving a zero footprint on termination.
system of the processing device,
said program being arranged to Program configured to be loaded onto the processing device and to run on the operating system
obtain user selected arbitrary of the processing device, said program being arranged to obtain user selected arbitrary media
media content, said program content:
leaving a zero footprint on
termination. See, e.g.,
.. -·::,· ~ ................. ,....,.... ~,
I Lainehe!Plus
Operal,ng Sy:,~m
WIii
l""lil......,_..,...__..__. lit....__.._ ..
Compatible wlh Windov,s & Mac 05
l:rnoeddet! Wlf'l
1ClJ<70A 4 ffilT1 / 6CJ(I
And see:
- 13 -

The plug-and~play LauncherPlus ensures that meeting participants' laptop computers wireless ly connect withi n seconds to the NovoEnterprise main unit for your presentations.
DIRECT CONNECTIVITY
By simply plugging Launche rP lus into a laptop via USB, users can establish
a direct, ad-hoc wireless connection to thei r NovoEnterprise unit, without
impacting the security of the ir corporate network.
And see:
Compatible w ith virtually all computers, tablets, and othe r smart devices,
NovoEnterprise ca n be enhanced w ith the Launche rPlus accessory or
instant screen mirroring {mm t he press of a button.
- 14 -

[…] said program leaves a zero footprint on termination.
See, e.g.,:
The plug-an d-play Launcher Plus ensu res that meet ing participants' laptop comput ers w irelessly connect w it hin seco nds t o t he Novo Ent erprise
ma in u nit. The Launche rPlus is a USB device t hat plugs directly into th e lapt op and t hanks t o its embedd ed Wi Fi, it strea m s lapt op content
effortl essly to t he big screen. The LauncherPlus is especially convenient for visit ing guests, or w hen co ll eagues from oth er offices are on sit e.
Further more, as it is driver-free, no t race or residue is left on laptops after t hey disco nn ect.
collaboration-system/
- 15 -
JS-CAND 44 (Rev. 06/17) Case 3:19-cv-03250 Document 1-8 Filed 06/10/19 Page 1 of 2
CIVIL COVER SHEET
The JS-CAND 44 civil cover sheet and the information contained herein neither replace nor supplement the filing and service of pleadings or other papers as required by law,
except as provided by local rules of court. This form, approved in its original form by the Judicial Conference of the United States in September 1974, is required for the Clerk of
Court to initiate the civil docket sheet. (SEE INSTRUCTIONS ON NEXT PAGE OF THIS FORM.)
I. (a) PLAINTIFFS DEFENDANTS
Barco NV and Barco, Inc. Vivitek Corporation and Delta Electronics, Inc.
(b) County of Residence of First Listed Plaintiff Belgium County of Residence of First Listed Defendant
(EXCEPT IN U.S. PLAINTIFF CASES) (IN U.S. PLAINTIFF CASES ONLY)
NOTE: IN LAND CONDEMNATION CASES, USE THE LOCATION OF
THE TRACT OF LAND INVOLVED.
(c) Attorneys (Firm Name, Address, and Telephone Number) Attorneys (If Known)
K&L Gates LLP
Twelfth Floor, 1 Park Plaza, Irvine, CA 92614
(949) 253-0900
II. BASIS OF JURISDICTION (Place an “X” in One Box Only) III. CITIZENSHIP OF PRINCIPAL PARTIES (Place an “X” in One Box for Plaintiff
(For Diversity Cases Only) and One Box for Defendant)
PTF DEF PTF DEF
1 U.S. Government Plaintiff 3 Federal Question Citizen of This State 1 1 Incorporated or Principal Place 4 4
(U.S. Government Not a Party)
of Business In This State
Citizen of Another State 2 2 Incorporated and Principal Place 5 5
2 U.S. Government Defendant 4 Diversity of Business In Another State
(Indicate Citizenship of Parties in Item III)
Citizen or Subject of a 3 3 Foreign Nation 6 6
Foreign Country
IV. NATURE OF SUIT (Place an “X” in One Box Only)

I CONTRACT TORTS FORFEITURE/PENALTY BANKRUPTCY OTHER STATUTES I
110 Insurance PERSONAL INJURY PERSONAL INJURY 625 Drug Related Seizure of 422 Appeal 28 USC § 158 375 False Claims Act
120 Marine Property 21 USC § 881 423 Withdrawal 28 USC 376 Qui Tam (31 USC
310 Airplane 365 Personal Injury – Product
130 Miller Act Liability 690 Other § 157 § 3729(a))
315 Airplane Product Liability
140 Negotiable Instrument 367 Health Care/ 400 State Reapportionment
320 Assault, Libel & Slander LABOR PROPERTY RIGHTS
150 Recovery of Pharmaceutical Personal 410 Antitrust
330 Federal Employers’ 710 Fair Labor Standards Act 820 Copyrights
Overpayment Of Injury Product Liability 430 Banks and Banking
Liability 720 Labor/Management 830 Patent
Veteran’s Benefits 368 Asbestos Personal Injury 450 Commerce
340 Marine Relations 835 Patent─Abbreviated New
151 Medicare Act Product Liability
345 Marine Product Liability 740 Railway Labor Act Drug Application 460 Deportation
152 Recovery of Defaulted PERSONAL PROPERTY 470 Racketeer Influenced &
350 Motor Vehicle 751 Family and Medical 840 Trademark
Student Loans (Excludes 370 Other Fraud Corrupt Organizations
355 Motor Vehicle Product Leave Act
Veterans) 371 Truth in Lending SOCIAL SECURITY
Liability 790 Other Labor Litigation 480 Consumer Credit
153 Recovery of 380 Other Personal Property 861 HIA (1395ff)
360 Other Personal Injury 791 Employee Retirement 490 Cable/Sat TV
Overpayment Damage Income Security Act 862 Black Lung (923) 850 Securities/Commodities/
of Veteran’s Benefits 362 Personal Injury -Medical
Malpractice 385 Property Damage Product 863 DIWC/DIWW (405(g)) Exchange
160 Stockholders’ Suits Liability IMMIGRATION
864 SSID Title XVI 890 Other Statutory Actions
190 Other Contract 462 Naturalization
CIVIL RIGHTS PRISONER PETITIONS 865 RSI (405(g)) 891 Agricultural Acts
195 Contract Product Liability Application
440 Other Civil Rights HABEAS CORPUS 893 Environmental Matters
196 Franchise 465 Other Immigration FEDERAL TAX SUITS
441 Voting 463 Alien Detainee Actions 895 Freedom of Information
870 Taxes (U.S. Plaintiff or
I REAL PROPERTY 442 Employment Act
510 Motions to Vacate Defendant)
210 Land Condemnation Sentence 896 Arbitration
443 Housing/ 871 IRS–Third Party 26 USC
220 Foreclosure Accommodations 530 General § 7609 899 Administrative Procedure
445 Amer. w/Disabilities– Act/Review or Appeal of
230 Rent Lease & Ejectment 535 Death Penalty
Employment Agency Decision
240 Torts to Land OTHER
446 Amer. w/Disabilities–Other 950 Constitutionality of State
245 Tort Product Liability 540 Mandamus & Other Statutes
290 All Other Real Property 448 Education
550 Civil Rights
555 Prison Condition
560 Civil Detainee–
Conditions of
Confinement
V. ORIGIN (Place an “X” in One Box Only)

1 Original 2 Removed from 3 Remanded from 4 Reinstated or 5 Transferred from 6 Multidistrict 8 Multidistrict
Proceeding State Court Appellate Court Reopened Another District (specify) Litigation–Transfer Litigation–Direct File
VI. CAUSE OF Cite the U.S. Civil Statute under which you are filing (Do not cite jurisdictional statutes unless diversity):
35 U.S.C. § 271 et seq.
ACTION
Brief description of cause:
Original Complaint for Patent Infringement
VII. REQUESTED IN CHECK IF THIS IS A CLASS ACTION DEMAND $ CHECK YES only if demanded in complaint:
COMPLAINT: UNDER RULE 23, Fed. R. Civ. P. JURY DEMAND: Yes No
VIII. RELATED CASE(S), JUDGE DOCKET NUMBER

IF ANY (See instructions):
IX. DIVISIONAL ASSIGNMENT (Civil Local Rule 3-2)
(Place an “X” in One Box Only) SAN FRANCISCO/OAKLAND SAN JOSE EUREKA-MCKINLEYVILLE
DATE 06/10/2019 SIGNATURE OF ATTORNEY OF RECORD /s/ Caitlin Blanche
Print Save As... Reset

JS-CAND 44 (rev. 07/16) Case 3:19-cv-03250 Document 1-8 Filed 06/10/19 Page 2 of 2
INSTRUCTIONS FOR ATTORNEYS COMPLETING CIVIL COVER SHEET FORM JS-CAND 44
Authority For Civil Cover Sheet. The JS-CAND 44 civil cover sheet and the information contained herein neither replaces nor supplements the filings and
service of pleading or other papers as required by law, except as provided by local rules of court. This form, approved in its original form by the Judicial
Conference of the United States in September 1974, is required for the Clerk of Court to initiate the civil docket sheet. Consequently, a civil cover sheet is
submitted to the Clerk of Court for each civil complaint filed. The attorney filing a case should complete the form as follows:
I. a) Plaintiffs-Defendants. Enter names (last, first, middle initial) of plaintiff and defendant. If the plaintiff or defendant is a government agency, use
only the full name or standard abbreviations. If the plaintiff or defendant is an official within a government agency, identify first the agency and
then the official, giving both name and title.
b) County of Residence. For each civil case filed, except U.S. plaintiff cases, enter the name of the county where the first listed plaintiff resides at the
time of filing. In U.S. plaintiff cases, enter the name of the county in which the first listed defendant resides at the time of filing. (NOTE: In land
condemnation cases, the county of residence of the “defendant” is the location of the tract of land involved.)
c) Attorneys. Enter the firm name, address, telephone number, and attorney of record. If there are several attorneys, list them on an attachment, noting
in this section “(see attachment).”
II. Jurisdiction. The basis of jurisdiction is set forth under Federal Rule of Civil Procedure 8(a), which requires that jurisdictions be shown in
pleadings. Place an “X” in one of the boxes. If there is more than one basis of jurisdiction, precedence is given in the order shown below.
(1) United States plaintiff. Jurisdiction based on 28 USC §§ 1345 and 1348. Suits by agencies and officers of the United States are included here.
(2) United States defendant. When the plaintiff is suing the United States, its officers or agencies, place an “X” in this box.
(3) Federal question. This refers to suits under 28 USC § 1331, where jurisdiction arises under the Constitution of the United States, an amendment
to the Constitution, an act of Congress or a treaty of the United States. In cases where the U.S. is a party, the U.S. plaintiff or defendant code
takes precedence, and box 1 or 2 should be marked.
(4) Diversity of citizenship. This refers to suits under 28 USC § 1332, where parties are citizens of different states. When Box 4 is checked, the
citizenship of the different parties must be checked. (See Section III below; NOTE: federal question actions take precedence over diversity
cases.)
III. Residence (citizenship) of Principal Parties. This section of the JS-CAND 44 is to be completed if diversity of citizenship was indicated above.
Mark this section for each principal party.
IV. Nature of Suit. Place an “X” in the appropriate box. If the nature of suit cannot be determined, be sure the cause of action, in Section VI below, is
sufficient to enable the deputy clerk or the statistical clerk(s) in the Administrative Office to determine the nature of suit. If the cause fits more than
one nature of suit, select the most definitive.
V. Origin. Place an “X” in one of the six boxes.
(1) Original Proceedings. Cases originating in the United States district courts.
(2) Removed from State Court. Proceedings initiated in state courts may be removed to the district courts under Title 28 USC § 1441. When the
petition for removal is granted, check this box.
(3) Remanded from Appellate Court. Check this box for cases remanded to the district court for further action. Use the date of remand as the filing
date.
(4) Reinstated or Reopened. Check this box for cases reinstated or reopened in the district court. Use the reopening date as the filing date.
(5) Transferred from Another District. For cases transferred under Title 28 USC § 1404(a). Do not use this for within district transfers or
multidistrict litigation transfers.
(6) Multidistrict Litigation Transfer. Check this box when a multidistrict case is transferred into the district under authority of Title 28 USC
§ 1407. When this box is checked, do not check (5) above.
(8) Multidistrict Litigation Direct File. Check this box when a multidistrict litigation case is filed in the same district as the Master MDL docket.
Please note that there is no Origin Code 7. Origin Code 7 was used for historical records and is no longer relevant due to changes in statute.
VI. Cause of Action. Report the civil statute directly related to the cause of action and give a brief description of the cause. Do not cite jurisdictional
statutes unless diversity. Example: U.S. Civil Statute: 47 USC § 553. Brief Description: Unauthorized reception of cable service.
VII. Requested in Complaint. Class Action. Place an “X” in this box if you are filing a class action under Federal Rule of Civil Procedure 23.
Demand. In this space enter the actual dollar amount being demanded or indicate other demand, such as a preliminary injunction.
Jury Demand. Check the appropriate box to indicate whether or not a jury is being demanded.
VIII. Related Cases. This section of the JS-CAND 44 is used to identify related pending cases, if any. If there are related pending cases, insert the docket
numbers and the corresponding judge names for such cases.
IX. Divisional Assignment. If the Nature of Suit is under Property Rights or Prisoner Petitions or the matter is a Securities Class Action, leave this
section blank. For all other cases, identify the divisional venue according to Civil Local Rule 3-2: “the county in which a substantial part of the
events or omissions which give rise to the claim occurred or in which a substantial part of the property that is the subject of the action is situated.”
Date and Attorney Signature. Date and sign the civil cover sheet.

Barco v. Vivitek - Complaint

Diunggah oleh

Informasi Dokumen

Judul Asli

Hak Cipta

Format Tersedia

Bagikan dokumen Ini

Bagikan atau Tanam Dokumen

Opsi Berbagi

Apakah menurut Anda dokumen ini bermanfaat?

Apakah konten ini tidak pantas?

Hak Cipta:

Format Tersedia

Barco v. Vivitek - Complaint

Diunggah oleh

Hak Cipta:

Format Tersedia

Case 3:19-cv-03250 Document 1 Filed 06/10/19 Page 1 of 16

Caitlin Comstock Blanche (SBN 254109)

8 UNITED STATES DISTRICT COURT FOR THE

9 NORTHERN DISTRICT OF CALIFORNIA

11 BARCO NV and BARCO, INC. Civil Action No.

13 v. ORIGINAL COMPLAINT FOR PATENT

22 Products v Solutions v Programs ..,

23 Home I Products / ProJector

1 JURISDICTION AND VENUE

5 .,_ Flexible con nect ion for data

7 USB device interface

12 and correct copy of the D’241 Patent is attached at Exhibit 5.

13 37. The D’241 Patent is presumed valid under 35 U.S.C. § 282(a).

17 and includes exemplary Figure 6 as shown below:

28 See, e.g., D’241 Patent, Fig. 6.

1 DEFENDANTS’ INFRINGING ACTIVITY

10 See id. (rotated from original).

14 review and investigation.

15 49. Defendants had continued exposure to Barco’s wireless presentation technology

17 events and trade shows worldwide.

20 marketing, and sale of the Accused Product.

24 and selling the Accused Product without license or authorization in Europe.

27 intellectual property rights.

1 COUNT I: DEFENDANTS’ INFRINGEMENT OF THE ’348 PATENT

1 PRAYER FOR RELIEF

c12) United States Patent (IO) Patent No.: US 8,756,348 B2

Related U.S. Application Data Primary Examiner - Scott Sun

U.S. Patent Jun.17,2014 Sheet 1 of 5 US 8,756,348 B2

U.S. Patent Jun.17,2014 Sheet 2 of 5 US 8,756,348 B2

U.S. Patent Jun.17,2014 Sheet 3 of 5 US 8,756,348 B2

,,.. Run-time- exe-cution '\

U.S. Patent Jun.17,2014 Sheet 4 of 5 US 8,756,348 B2

1/ Run-lime exerution ',

U.S. Patent Jun.17,2014 Sheet 5 of 5 US 8,756,348 B2

' - ·R- t· - - - ut•· - - -.. \

----=-- Internal WiFi antenna's

internal mass storage

Flexible connection for data

USB device interface

c12) United States Patent (10) Patent No.: US 9,083,769 B2

Internal WiFi antenna's

internal mass storage

..,._ Flexible connection for data

- - - USB device interface

Related U.S. Application Data 2009/0198839 Al 8/2009 Banerjee et al.

U.S. Patent Jul. 14, 2015 Sheet 1 of 5 US 9,083,769 B2

U.S. Patent Jul. 14, 2015 Sheet 2 of 5 US 9,083,769 B2

U.S. Patent Jul. 14, 2015 Sheet 3 of 5 US 9,083,769 B2

/ Run-time exerution ---. \

U.S. Patent Jul. 14, 2015 Sheet 4 of 5 US 9,083,769 B2

1' Run-time exerution ',

U.S. Patent Jul. 14, 2015 Sheet 5 of 5 US 9,083,769 B2

Internal WiFi antenna's

internal mass storage

Flexible connection for data

USB device interface

UNITED STATES PATENT AND TRADEMARK OFFICE

On the title page:

Signed and Sealed this

c12) EX PARTE REEXAMINATION CERTIFICATE (11479th)

(54) ELECTRONIC TOOL AND METHODS FOR (52) U.S. CI.

Reexamination Certificate for: (56) References Cited

Primary Examiner - B. James Peikari