ezioruan commited on
Commit
3dea108
1 Parent(s): dc8bde2

add gradio ui

Browse files
LICENSE ADDED
@@ -0,0 +1,661 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ GNU AFFERO GENERAL PUBLIC LICENSE
2
+ Version 3, 19 November 2007
3
+
4
+ Copyright (C) 2007 Free Software Foundation, Inc. <https://fsf.org/>
5
+ Everyone is permitted to copy and distribute verbatim copies
6
+ of this license document, but changing it is not allowed.
7
+
8
+ Preamble
9
+
10
+ The GNU Affero General Public License is a free, copyleft license for
11
+ software and other kinds of works, specifically designed to ensure
12
+ cooperation with the community in the case of network server software.
13
+
14
+ The licenses for most software and other practical works are designed
15
+ to take away your freedom to share and change the works. By contrast,
16
+ our General Public Licenses are intended to guarantee your freedom to
17
+ share and change all versions of a program--to make sure it remains free
18
+ software for all its users.
19
+
20
+ When we speak of free software, we are referring to freedom, not
21
+ price. Our General Public Licenses are designed to make sure that you
22
+ have the freedom to distribute copies of free software (and charge for
23
+ them if you wish), that you receive source code or can get it if you
24
+ want it, that you can change the software or use pieces of it in new
25
+ free programs, and that you know you can do these things.
26
+
27
+ Developers that use our General Public Licenses protect your rights
28
+ with two steps: (1) assert copyright on the software, and (2) offer
29
+ you this License which gives you legal permission to copy, distribute
30
+ and/or modify the software.
31
+
32
+ A secondary benefit of defending all users' freedom is that
33
+ improvements made in alternate versions of the program, if they
34
+ receive widespread use, become available for other developers to
35
+ incorporate. Many developers of free software are heartened and
36
+ encouraged by the resulting cooperation. However, in the case of
37
+ software used on network servers, this result may fail to come about.
38
+ The GNU General Public License permits making a modified version and
39
+ letting the public access it on a server without ever releasing its
40
+ source code to the public.
41
+
42
+ The GNU Affero General Public License is designed specifically to
43
+ ensure that, in such cases, the modified source code becomes available
44
+ to the community. It requires the operator of a network server to
45
+ provide the source code of the modified version running there to the
46
+ users of that server. Therefore, public use of a modified version, on
47
+ a publicly accessible server, gives the public access to the source
48
+ code of the modified version.
49
+
50
+ An older license, called the Affero General Public License and
51
+ published by Affero, was designed to accomplish similar goals. This is
52
+ a different license, not a version of the Affero GPL, but Affero has
53
+ released a new version of the Affero GPL which permits relicensing under
54
+ this license.
55
+
56
+ The precise terms and conditions for copying, distribution and
57
+ modification follow.
58
+
59
+ TERMS AND CONDITIONS
60
+
61
+ 0. Definitions.
62
+
63
+ "This License" refers to version 3 of the GNU Affero General Public License.
64
+
65
+ "Copyright" also means copyright-like laws that apply to other kinds of
66
+ works, such as semiconductor masks.
67
+
68
+ "The Program" refers to any copyrightable work licensed under this
69
+ License. Each licensee is addressed as "you". "Licensees" and
70
+ "recipients" may be individuals or organizations.
71
+
72
+ To "modify" a work means to copy from or adapt all or part of the work
73
+ in a fashion requiring copyright permission, other than the making of an
74
+ exact copy. The resulting work is called a "modified version" of the
75
+ earlier work or a work "based on" the earlier work.
76
+
77
+ A "covered work" means either the unmodified Program or a work based
78
+ on the Program.
79
+
80
+ To "propagate" a work means to do anything with it that, without
81
+ permission, would make you directly or secondarily liable for
82
+ infringement under applicable copyright law, except executing it on a
83
+ computer or modifying a private copy. Propagation includes copying,
84
+ distribution (with or without modification), making available to the
85
+ public, and in some countries other activities as well.
86
+
87
+ To "convey" a work means any kind of propagation that enables other
88
+ parties to make or receive copies. Mere interaction with a user through
89
+ a computer network, with no transfer of a copy, is not conveying.
90
+
91
+ An interactive user interface displays "Appropriate Legal Notices"
92
+ to the extent that it includes a convenient and prominently visible
93
+ feature that (1) displays an appropriate copyright notice, and (2)
94
+ tells the user that there is no warranty for the work (except to the
95
+ extent that warranties are provided), that licensees may convey the
96
+ work under this License, and how to view a copy of this License. If
97
+ the interface presents a list of user commands or options, such as a
98
+ menu, a prominent item in the list meets this criterion.
99
+
100
+ 1. Source Code.
101
+
102
+ The "source code" for a work means the preferred form of the work
103
+ for making modifications to it. "Object code" means any non-source
104
+ form of a work.
105
+
106
+ A "Standard Interface" means an interface that either is an official
107
+ standard defined by a recognized standards body, or, in the case of
108
+ interfaces specified for a particular programming language, one that
109
+ is widely used among developers working in that language.
110
+
111
+ The "System Libraries" of an executable work include anything, other
112
+ than the work as a whole, that (a) is included in the normal form of
113
+ packaging a Major Component, but which is not part of that Major
114
+ Component, and (b) serves only to enable use of the work with that
115
+ Major Component, or to implement a Standard Interface for which an
116
+ implementation is available to the public in source code form. A
117
+ "Major Component", in this context, means a major essential component
118
+ (kernel, window system, and so on) of the specific operating system
119
+ (if any) on which the executable work runs, or a compiler used to
120
+ produce the work, or an object code interpreter used to run it.
121
+
122
+ The "Corresponding Source" for a work in object code form means all
123
+ the source code needed to generate, install, and (for an executable
124
+ work) run the object code and to modify the work, including scripts to
125
+ control those activities. However, it does not include the work's
126
+ System Libraries, or general-purpose tools or generally available free
127
+ programs which are used unmodified in performing those activities but
128
+ which are not part of the work. For example, Corresponding Source
129
+ includes interface definition files associated with source files for
130
+ the work, and the source code for shared libraries and dynamically
131
+ linked subprograms that the work is specifically designed to require,
132
+ such as by intimate data communication or control flow between those
133
+ subprograms and other parts of the work.
134
+
135
+ The Corresponding Source need not include anything that users
136
+ can regenerate automatically from other parts of the Corresponding
137
+ Source.
138
+
139
+ The Corresponding Source for a work in source code form is that
140
+ same work.
141
+
142
+ 2. Basic Permissions.
143
+
144
+ All rights granted under this License are granted for the term of
145
+ copyright on the Program, and are irrevocable provided the stated
146
+ conditions are met. This License explicitly affirms your unlimited
147
+ permission to run the unmodified Program. The output from running a
148
+ covered work is covered by this License only if the output, given its
149
+ content, constitutes a covered work. This License acknowledges your
150
+ rights of fair use or other equivalent, as provided by copyright law.
151
+
152
+ You may make, run and propagate covered works that you do not
153
+ convey, without conditions so long as your license otherwise remains
154
+ in force. You may convey covered works to others for the sole purpose
155
+ of having them make modifications exclusively for you, or provide you
156
+ with facilities for running those works, provided that you comply with
157
+ the terms of this License in conveying all material for which you do
158
+ not control copyright. Those thus making or running the covered works
159
+ for you must do so exclusively on your behalf, under your direction
160
+ and control, on terms that prohibit them from making any copies of
161
+ your copyrighted material outside their relationship with you.
162
+
163
+ Conveying under any other circumstances is permitted solely under
164
+ the conditions stated below. Sublicensing is not allowed; section 10
165
+ makes it unnecessary.
166
+
167
+ 3. Protecting Users' Legal Rights From Anti-Circumvention Law.
168
+
169
+ No covered work shall be deemed part of an effective technological
170
+ measure under any applicable law fulfilling obligations under article
171
+ 11 of the WIPO copyright treaty adopted on 20 December 1996, or
172
+ similar laws prohibiting or restricting circumvention of such
173
+ measures.
174
+
175
+ When you convey a covered work, you waive any legal power to forbid
176
+ circumvention of technological measures to the extent such circumvention
177
+ is effected by exercising rights under this License with respect to
178
+ the covered work, and you disclaim any intention to limit operation or
179
+ modification of the work as a means of enforcing, against the work's
180
+ users, your or third parties' legal rights to forbid circumvention of
181
+ technological measures.
182
+
183
+ 4. Conveying Verbatim Copies.
184
+
185
+ You may convey verbatim copies of the Program's source code as you
186
+ receive it, in any medium, provided that you conspicuously and
187
+ appropriately publish on each copy an appropriate copyright notice;
188
+ keep intact all notices stating that this License and any
189
+ non-permissive terms added in accord with section 7 apply to the code;
190
+ keep intact all notices of the absence of any warranty; and give all
191
+ recipients a copy of this License along with the Program.
192
+
193
+ You may charge any price or no price for each copy that you convey,
194
+ and you may offer support or warranty protection for a fee.
195
+
196
+ 5. Conveying Modified Source Versions.
197
+
198
+ You may convey a work based on the Program, or the modifications to
199
+ produce it from the Program, in the form of source code under the
200
+ terms of section 4, provided that you also meet all of these conditions:
201
+
202
+ a) The work must carry prominent notices stating that you modified
203
+ it, and giving a relevant date.
204
+
205
+ b) The work must carry prominent notices stating that it is
206
+ released under this License and any conditions added under section
207
+ 7. This requirement modifies the requirement in section 4 to
208
+ "keep intact all notices".
209
+
210
+ c) You must license the entire work, as a whole, under this
211
+ License to anyone who comes into possession of a copy. This
212
+ License will therefore apply, along with any applicable section 7
213
+ additional terms, to the whole of the work, and all its parts,
214
+ regardless of how they are packaged. This License gives no
215
+ permission to license the work in any other way, but it does not
216
+ invalidate such permission if you have separately received it.
217
+
218
+ d) If the work has interactive user interfaces, each must display
219
+ Appropriate Legal Notices; however, if the Program has interactive
220
+ interfaces that do not display Appropriate Legal Notices, your
221
+ work need not make them do so.
222
+
223
+ A compilation of a covered work with other separate and independent
224
+ works, which are not by their nature extensions of the covered work,
225
+ and which are not combined with it such as to form a larger program,
226
+ in or on a volume of a storage or distribution medium, is called an
227
+ "aggregate" if the compilation and its resulting copyright are not
228
+ used to limit the access or legal rights of the compilation's users
229
+ beyond what the individual works permit. Inclusion of a covered work
230
+ in an aggregate does not cause this License to apply to the other
231
+ parts of the aggregate.
232
+
233
+ 6. Conveying Non-Source Forms.
234
+
235
+ You may convey a covered work in object code form under the terms
236
+ of sections 4 and 5, provided that you also convey the
237
+ machine-readable Corresponding Source under the terms of this License,
238
+ in one of these ways:
239
+
240
+ a) Convey the object code in, or embodied in, a physical product
241
+ (including a physical distribution medium), accompanied by the
242
+ Corresponding Source fixed on a durable physical medium
243
+ customarily used for software interchange.
244
+
245
+ b) Convey the object code in, or embodied in, a physical product
246
+ (including a physical distribution medium), accompanied by a
247
+ written offer, valid for at least three years and valid for as
248
+ long as you offer spare parts or customer support for that product
249
+ model, to give anyone who possesses the object code either (1) a
250
+ copy of the Corresponding Source for all the software in the
251
+ product that is covered by this License, on a durable physical
252
+ medium customarily used for software interchange, for a price no
253
+ more than your reasonable cost of physically performing this
254
+ conveying of source, or (2) access to copy the
255
+ Corresponding Source from a network server at no charge.
256
+
257
+ c) Convey individual copies of the object code with a copy of the
258
+ written offer to provide the Corresponding Source. This
259
+ alternative is allowed only occasionally and noncommercially, and
260
+ only if you received the object code with such an offer, in accord
261
+ with subsection 6b.
262
+
263
+ d) Convey the object code by offering access from a designated
264
+ place (gratis or for a charge), and offer equivalent access to the
265
+ Corresponding Source in the same way through the same place at no
266
+ further charge. You need not require recipients to copy the
267
+ Corresponding Source along with the object code. If the place to
268
+ copy the object code is a network server, the Corresponding Source
269
+ may be on a different server (operated by you or a third party)
270
+ that supports equivalent copying facilities, provided you maintain
271
+ clear directions next to the object code saying where to find the
272
+ Corresponding Source. Regardless of what server hosts the
273
+ Corresponding Source, you remain obligated to ensure that it is
274
+ available for as long as needed to satisfy these requirements.
275
+
276
+ e) Convey the object code using peer-to-peer transmission, provided
277
+ you inform other peers where the object code and Corresponding
278
+ Source of the work are being offered to the general public at no
279
+ charge under subsection 6d.
280
+
281
+ A separable portion of the object code, whose source code is excluded
282
+ from the Corresponding Source as a System Library, need not be
283
+ included in conveying the object code work.
284
+
285
+ A "User Product" is either (1) a "consumer product", which means any
286
+ tangible personal property which is normally used for personal, family,
287
+ or household purposes, or (2) anything designed or sold for incorporation
288
+ into a dwelling. In determining whether a product is a consumer product,
289
+ doubtful cases shall be resolved in favor of coverage. For a particular
290
+ product received by a particular user, "normally used" refers to a
291
+ typical or common use of that class of product, regardless of the status
292
+ of the particular user or of the way in which the particular user
293
+ actually uses, or expects or is expected to use, the product. A product
294
+ is a consumer product regardless of whether the product has substantial
295
+ commercial, industrial or non-consumer uses, unless such uses represent
296
+ the only significant mode of use of the product.
297
+
298
+ "Installation Information" for a User Product means any methods,
299
+ procedures, authorization keys, or other information required to install
300
+ and execute modified versions of a covered work in that User Product from
301
+ a modified version of its Corresponding Source. The information must
302
+ suffice to ensure that the continued functioning of the modified object
303
+ code is in no case prevented or interfered with solely because
304
+ modification has been made.
305
+
306
+ If you convey an object code work under this section in, or with, or
307
+ specifically for use in, a User Product, and the conveying occurs as
308
+ part of a transaction in which the right of possession and use of the
309
+ User Product is transferred to the recipient in perpetuity or for a
310
+ fixed term (regardless of how the transaction is characterized), the
311
+ Corresponding Source conveyed under this section must be accompanied
312
+ by the Installation Information. But this requirement does not apply
313
+ if neither you nor any third party retains the ability to install
314
+ modified object code on the User Product (for example, the work has
315
+ been installed in ROM).
316
+
317
+ The requirement to provide Installation Information does not include a
318
+ requirement to continue to provide support service, warranty, or updates
319
+ for a work that has been modified or installed by the recipient, or for
320
+ the User Product in which it has been modified or installed. Access to a
321
+ network may be denied when the modification itself materially and
322
+ adversely affects the operation of the network or violates the rules and
323
+ protocols for communication across the network.
324
+
325
+ Corresponding Source conveyed, and Installation Information provided,
326
+ in accord with this section must be in a format that is publicly
327
+ documented (and with an implementation available to the public in
328
+ source code form), and must require no special password or key for
329
+ unpacking, reading or copying.
330
+
331
+ 7. Additional Terms.
332
+
333
+ "Additional permissions" are terms that supplement the terms of this
334
+ License by making exceptions from one or more of its conditions.
335
+ Additional permissions that are applicable to the entire Program shall
336
+ be treated as though they were included in this License, to the extent
337
+ that they are valid under applicable law. If additional permissions
338
+ apply only to part of the Program, that part may be used separately
339
+ under those permissions, but the entire Program remains governed by
340
+ this License without regard to the additional permissions.
341
+
342
+ When you convey a copy of a covered work, you may at your option
343
+ remove any additional permissions from that copy, or from any part of
344
+ it. (Additional permissions may be written to require their own
345
+ removal in certain cases when you modify the work.) You may place
346
+ additional permissions on material, added by you to a covered work,
347
+ for which you have or can give appropriate copyright permission.
348
+
349
+ Notwithstanding any other provision of this License, for material you
350
+ add to a covered work, you may (if authorized by the copyright holders of
351
+ that material) supplement the terms of this License with terms:
352
+
353
+ a) Disclaiming warranty or limiting liability differently from the
354
+ terms of sections 15 and 16 of this License; or
355
+
356
+ b) Requiring preservation of specified reasonable legal notices or
357
+ author attributions in that material or in the Appropriate Legal
358
+ Notices displayed by works containing it; or
359
+
360
+ c) Prohibiting misrepresentation of the origin of that material, or
361
+ requiring that modified versions of such material be marked in
362
+ reasonable ways as different from the original version; or
363
+
364
+ d) Limiting the use for publicity purposes of names of licensors or
365
+ authors of the material; or
366
+
367
+ e) Declining to grant rights under trademark law for use of some
368
+ trade names, trademarks, or service marks; or
369
+
370
+ f) Requiring indemnification of licensors and authors of that
371
+ material by anyone who conveys the material (or modified versions of
372
+ it) with contractual assumptions of liability to the recipient, for
373
+ any liability that these contractual assumptions directly impose on
374
+ those licensors and authors.
375
+
376
+ All other non-permissive additional terms are considered "further
377
+ restrictions" within the meaning of section 10. If the Program as you
378
+ received it, or any part of it, contains a notice stating that it is
379
+ governed by this License along with a term that is a further
380
+ restriction, you may remove that term. If a license document contains
381
+ a further restriction but permits relicensing or conveying under this
382
+ License, you may add to a covered work material governed by the terms
383
+ of that license document, provided that the further restriction does
384
+ not survive such relicensing or conveying.
385
+
386
+ If you add terms to a covered work in accord with this section, you
387
+ must place, in the relevant source files, a statement of the
388
+ additional terms that apply to those files, or a notice indicating
389
+ where to find the applicable terms.
390
+
391
+ Additional terms, permissive or non-permissive, may be stated in the
392
+ form of a separately written license, or stated as exceptions;
393
+ the above requirements apply either way.
394
+
395
+ 8. Termination.
396
+
397
+ You may not propagate or modify a covered work except as expressly
398
+ provided under this License. Any attempt otherwise to propagate or
399
+ modify it is void, and will automatically terminate your rights under
400
+ this License (including any patent licenses granted under the third
401
+ paragraph of section 11).
402
+
403
+ However, if you cease all violation of this License, then your
404
+ license from a particular copyright holder is reinstated (a)
405
+ provisionally, unless and until the copyright holder explicitly and
406
+ finally terminates your license, and (b) permanently, if the copyright
407
+ holder fails to notify you of the violation by some reasonable means
408
+ prior to 60 days after the cessation.
409
+
410
+ Moreover, your license from a particular copyright holder is
411
+ reinstated permanently if the copyright holder notifies you of the
412
+ violation by some reasonable means, this is the first time you have
413
+ received notice of violation of this License (for any work) from that
414
+ copyright holder, and you cure the violation prior to 30 days after
415
+ your receipt of the notice.
416
+
417
+ Termination of your rights under this section does not terminate the
418
+ licenses of parties who have received copies or rights from you under
419
+ this License. If your rights have been terminated and not permanently
420
+ reinstated, you do not qualify to receive new licenses for the same
421
+ material under section 10.
422
+
423
+ 9. Acceptance Not Required for Having Copies.
424
+
425
+ You are not required to accept this License in order to receive or
426
+ run a copy of the Program. Ancillary propagation of a covered work
427
+ occurring solely as a consequence of using peer-to-peer transmission
428
+ to receive a copy likewise does not require acceptance. However,
429
+ nothing other than this License grants you permission to propagate or
430
+ modify any covered work. These actions infringe copyright if you do
431
+ not accept this License. Therefore, by modifying or propagating a
432
+ covered work, you indicate your acceptance of this License to do so.
433
+
434
+ 10. Automatic Licensing of Downstream Recipients.
435
+
436
+ Each time you convey a covered work, the recipient automatically
437
+ receives a license from the original licensors, to run, modify and
438
+ propagate that work, subject to this License. You are not responsible
439
+ for enforcing compliance by third parties with this License.
440
+
441
+ An "entity transaction" is a transaction transferring control of an
442
+ organization, or substantially all assets of one, or subdividing an
443
+ organization, or merging organizations. If propagation of a covered
444
+ work results from an entity transaction, each party to that
445
+ transaction who receives a copy of the work also receives whatever
446
+ licenses to the work the party's predecessor in interest had or could
447
+ give under the previous paragraph, plus a right to possession of the
448
+ Corresponding Source of the work from the predecessor in interest, if
449
+ the predecessor has it or can get it with reasonable efforts.
450
+
451
+ You may not impose any further restrictions on the exercise of the
452
+ rights granted or affirmed under this License. For example, you may
453
+ not impose a license fee, royalty, or other charge for exercise of
454
+ rights granted under this License, and you may not initiate litigation
455
+ (including a cross-claim or counterclaim in a lawsuit) alleging that
456
+ any patent claim is infringed by making, using, selling, offering for
457
+ sale, or importing the Program or any portion of it.
458
+
459
+ 11. Patents.
460
+
461
+ A "contributor" is a copyright holder who authorizes use under this
462
+ License of the Program or a work on which the Program is based. The
463
+ work thus licensed is called the contributor's "contributor version".
464
+
465
+ A contributor's "essential patent claims" are all patent claims
466
+ owned or controlled by the contributor, whether already acquired or
467
+ hereafter acquired, that would be infringed by some manner, permitted
468
+ by this License, of making, using, or selling its contributor version,
469
+ but do not include claims that would be infringed only as a
470
+ consequence of further modification of the contributor version. For
471
+ purposes of this definition, "control" includes the right to grant
472
+ patent sublicenses in a manner consistent with the requirements of
473
+ this License.
474
+
475
+ Each contributor grants you a non-exclusive, worldwide, royalty-free
476
+ patent license under the contributor's essential patent claims, to
477
+ make, use, sell, offer for sale, import and otherwise run, modify and
478
+ propagate the contents of its contributor version.
479
+
480
+ In the following three paragraphs, a "patent license" is any express
481
+ agreement or commitment, however denominated, not to enforce a patent
482
+ (such as an express permission to practice a patent or covenant not to
483
+ sue for patent infringement). To "grant" such a patent license to a
484
+ party means to make such an agreement or commitment not to enforce a
485
+ patent against the party.
486
+
487
+ If you convey a covered work, knowingly relying on a patent license,
488
+ and the Corresponding Source of the work is not available for anyone
489
+ to copy, free of charge and under the terms of this License, through a
490
+ publicly available network server or other readily accessible means,
491
+ then you must either (1) cause the Corresponding Source to be so
492
+ available, or (2) arrange to deprive yourself of the benefit of the
493
+ patent license for this particular work, or (3) arrange, in a manner
494
+ consistent with the requirements of this License, to extend the patent
495
+ license to downstream recipients. "Knowingly relying" means you have
496
+ actual knowledge that, but for the patent license, your conveying the
497
+ covered work in a country, or your recipient's use of the covered work
498
+ in a country, would infringe one or more identifiable patents in that
499
+ country that you have reason to believe are valid.
500
+
501
+ If, pursuant to or in connection with a single transaction or
502
+ arrangement, you convey, or propagate by procuring conveyance of, a
503
+ covered work, and grant a patent license to some of the parties
504
+ receiving the covered work authorizing them to use, propagate, modify
505
+ or convey a specific copy of the covered work, then the patent license
506
+ you grant is automatically extended to all recipients of the covered
507
+ work and works based on it.
508
+
509
+ A patent license is "discriminatory" if it does not include within
510
+ the scope of its coverage, prohibits the exercise of, or is
511
+ conditioned on the non-exercise of one or more of the rights that are
512
+ specifically granted under this License. You may not convey a covered
513
+ work if you are a party to an arrangement with a third party that is
514
+ in the business of distributing software, under which you make payment
515
+ to the third party based on the extent of your activity of conveying
516
+ the work, and under which the third party grants, to any of the
517
+ parties who would receive the covered work from you, a discriminatory
518
+ patent license (a) in connection with copies of the covered work
519
+ conveyed by you (or copies made from those copies), or (b) primarily
520
+ for and in connection with specific products or compilations that
521
+ contain the covered work, unless you entered into that arrangement,
522
+ or that patent license was granted, prior to 28 March 2007.
523
+
524
+ Nothing in this License shall be construed as excluding or limiting
525
+ any implied license or other defenses to infringement that may
526
+ otherwise be available to you under applicable patent law.
527
+
528
+ 12. No Surrender of Others' Freedom.
529
+
530
+ If conditions are imposed on you (whether by court order, agreement or
531
+ otherwise) that contradict the conditions of this License, they do not
532
+ excuse you from the conditions of this License. If you cannot convey a
533
+ covered work so as to satisfy simultaneously your obligations under this
534
+ License and any other pertinent obligations, then as a consequence you may
535
+ not convey it at all. For example, if you agree to terms that obligate you
536
+ to collect a royalty for further conveying from those to whom you convey
537
+ the Program, the only way you could satisfy both those terms and this
538
+ License would be to refrain entirely from conveying the Program.
539
+
540
+ 13. Remote Network Interaction; Use with the GNU General Public License.
541
+
542
+ Notwithstanding any other provision of this License, if you modify the
543
+ Program, your modified version must prominently offer all users
544
+ interacting with it remotely through a computer network (if your version
545
+ supports such interaction) an opportunity to receive the Corresponding
546
+ Source of your version by providing access to the Corresponding Source
547
+ from a network server at no charge, through some standard or customary
548
+ means of facilitating copying of software. This Corresponding Source
549
+ shall include the Corresponding Source for any work covered by version 3
550
+ of the GNU General Public License that is incorporated pursuant to the
551
+ following paragraph.
552
+
553
+ Notwithstanding any other provision of this License, you have
554
+ permission to link or combine any covered work with a work licensed
555
+ under version 3 of the GNU General Public License into a single
556
+ combined work, and to convey the resulting work. The terms of this
557
+ License will continue to apply to the part which is the covered work,
558
+ but the work with which it is combined will remain governed by version
559
+ 3 of the GNU General Public License.
560
+
561
+ 14. Revised Versions of this License.
562
+
563
+ The Free Software Foundation may publish revised and/or new versions of
564
+ the GNU Affero General Public License from time to time. Such new versions
565
+ will be similar in spirit to the present version, but may differ in detail to
566
+ address new problems or concerns.
567
+
568
+ Each version is given a distinguishing version number. If the
569
+ Program specifies that a certain numbered version of the GNU Affero General
570
+ Public License "or any later version" applies to it, you have the
571
+ option of following the terms and conditions either of that numbered
572
+ version or of any later version published by the Free Software
573
+ Foundation. If the Program does not specify a version number of the
574
+ GNU Affero General Public License, you may choose any version ever published
575
+ by the Free Software Foundation.
576
+
577
+ If the Program specifies that a proxy can decide which future
578
+ versions of the GNU Affero General Public License can be used, that proxy's
579
+ public statement of acceptance of a version permanently authorizes you
580
+ to choose that version for the Program.
581
+
582
+ Later license versions may give you additional or different
583
+ permissions. However, no additional obligations are imposed on any
584
+ author or copyright holder as a result of your choosing to follow a
585
+ later version.
586
+
587
+ 15. Disclaimer of Warranty.
588
+
589
+ THERE IS NO WARRANTY FOR THE PROGRAM, TO THE EXTENT PERMITTED BY
590
+ APPLICABLE LAW. EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT
591
+ HOLDERS AND/OR OTHER PARTIES PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY
592
+ OF ANY KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO,
593
+ THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
594
+ PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE PROGRAM
595
+ IS WITH YOU. SHOULD THE PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF
596
+ ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
597
+
598
+ 16. Limitation of Liability.
599
+
600
+ IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
601
+ WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MODIFIES AND/OR CONVEYS
602
+ THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES, INCLUDING ANY
603
+ GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING OUT OF THE
604
+ USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED TO LOSS OF
605
+ DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD
606
+ PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER PROGRAMS),
607
+ EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF
608
+ SUCH DAMAGES.
609
+
610
+ 17. Interpretation of Sections 15 and 16.
611
+
612
+ If the disclaimer of warranty and limitation of liability provided
613
+ above cannot be given local legal effect according to their terms,
614
+ reviewing courts shall apply local law that most closely approximates
615
+ an absolute waiver of all civil liability in connection with the
616
+ Program, unless a warranty or assumption of liability accompanies a
617
+ copy of the Program in return for a fee.
618
+
619
+ END OF TERMS AND CONDITIONS
620
+
621
+ How to Apply These Terms to Your New Programs
622
+
623
+ If you develop a new program, and you want it to be of the greatest
624
+ possible use to the public, the best way to achieve this is to make it
625
+ free software which everyone can redistribute and change under these terms.
626
+
627
+ To do so, attach the following notices to the program. It is safest
628
+ to attach them to the start of each source file to most effectively
629
+ state the exclusion of warranty; and each file should have at least
630
+ the "copyright" line and a pointer to where the full notice is found.
631
+
632
+ <one line to give the program's name and a brief idea of what it does.>
633
+ Copyright (C) <year> <name of author>
634
+
635
+ This program is free software: you can redistribute it and/or modify
636
+ it under the terms of the GNU Affero General Public License as published
637
+ by the Free Software Foundation, either version 3 of the License, or
638
+ (at your option) any later version.
639
+
640
+ This program is distributed in the hope that it will be useful,
641
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
642
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
643
+ GNU Affero General Public License for more details.
644
+
645
+ You should have received a copy of the GNU Affero General Public License
646
+ along with this program. If not, see <https://www.gnu.org/licenses/>.
647
+
648
+ Also add information on how to contact you by electronic and paper mail.
649
+
650
+ If your software can interact with users remotely through a computer
651
+ network, you should also make sure that it provides a way for users to
652
+ get its source. For example, if your program is a web application, its
653
+ interface could display a "Source" link that leads users to an archive
654
+ of the code. There are many ways you could offer source, and different
655
+ solutions will be better for different programs; see section 13 for the
656
+ specific requirements.
657
+
658
+ You should also get your employer (if you work as a programmer) or school,
659
+ if any, to sign a "copyright disclaimer" for the program, if necessary.
660
+ For more information on this, and how to apply and follow the GNU AGPL, see
661
+ <https://www.gnu.org/licenses/>.
app.py ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # -* coding:UTF-8 -*
2
+ # !/usr/bin/env python
3
+ import numpy as np
4
+ import gradio as gr
5
+ import roop.globals
6
+ from roop.core import (
7
+ start,
8
+ decode_execution_providers,
9
+ suggest_max_memory,
10
+ suggest_execution_threads,
11
+ )
12
+ from roop.utilities import normalize_output_path
13
+ import os
14
+ from PIL import Image
15
+
16
+
17
+ def swap_face(source_file, target_file):
18
+
19
+ source_path = "input.jpg"
20
+ target_path = "target.jpg"
21
+
22
+ source_image = Image.fromarray(source_file)
23
+ source_image.save(source_path)
24
+ target_image = Image.fromarray(target_file)
25
+ target_image.save(target_path)
26
+
27
+ print("source_path: ", source_path)
28
+ print("target_path: ", target_path)
29
+
30
+ roop.globals.source_path = source_path
31
+ roop.globals.target_path = target_path
32
+ output_path = "output.jpg"
33
+ roop.globals.output_path = normalize_output_path(
34
+ roop.globals.source_path, roop.globals.target_path, output_path
35
+ )
36
+ roop.globals.frame_processors = ["face_swapper"]
37
+ roop.globals.headless = True
38
+ roop.globals.keep_fps = True
39
+ roop.globals.keep_audio = True
40
+ roop.globals.keep_frames = False
41
+ roop.globals.many_faces = False
42
+ roop.globals.video_encoder = "libx264"
43
+ roop.globals.video_quality = 18
44
+ roop.globals.max_memory = suggest_max_memory()
45
+ roop.globals.execution_providers = decode_execution_providers(["cpu"])
46
+ roop.globals.execution_threads = suggest_execution_threads()
47
+
48
+ print(
49
+ "start process",
50
+ roop.globals.source_path,
51
+ roop.globals.target_path,
52
+ roop.globals.output_path,
53
+ )
54
+
55
+ start()
56
+ return output_path
57
+
58
+
59
+ demo = gr.Interface(
60
+ fn=swap_face, inputs=[gr.Image(), gr.Image()], outputs="image"
61
+ )
62
+ demo.launch()
mypy.ini ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ [mypy]
2
+ check_untyped_defs = True
3
+ disallow_any_generics = True
4
+ disallow_untyped_calls = True
5
+ disallow_untyped_defs = True
6
+ ignore_missing_imports = True
7
+ strict_optional = False
requirements.txt ADDED
@@ -0,0 +1,23 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ --extra-index-url https://download.pytorch.org/whl/cu118
2
+
3
+ numpy==1.23.5
4
+ opencv-python==4.7.0.72
5
+ onnx==1.14.0
6
+ insightface==0.7.3
7
+ psutil==5.9.5
8
+ tk==0.1.0
9
+ customtkinter==5.1.3
10
+ pillow==9.5.0
11
+ torch==2.0.1+cu118; sys_platform != 'darwin'
12
+ torch==2.0.1; sys_platform == 'darwin'
13
+ torchvision==0.15.2+cu118; sys_platform != 'darwin'
14
+ torchvision==0.15.2; sys_platform == 'darwin'
15
+ onnxruntime==1.15.0; sys_platform == 'darwin' and platform_machine != 'arm64'
16
+ onnxruntime-silicon==1.13.1; sys_platform == 'darwin' and platform_machine == 'arm64'
17
+ onnxruntime-gpu==1.15.0; sys_platform != 'darwin'
18
+ tensorflow==2.13.0rc1; sys_platform == 'darwin'
19
+ tensorflow==2.12.0; sys_platform != 'darwin'
20
+ opennsfw2==0.10.2
21
+ protobuf==4.23.2
22
+ tqdm==4.65.0
23
+ gfpgan==1.3.8
roop/__init__.py ADDED
File without changes
roop/__pycache__/__init__.cpython-310.pyc ADDED
Binary file (141 Bytes). View file
 
roop/__pycache__/capturer.cpython-310.pyc ADDED
Binary file (815 Bytes). View file
 
roop/__pycache__/core.cpython-310.pyc ADDED
Binary file (8.34 kB). View file
 
roop/__pycache__/face_analyser.cpython-310.pyc ADDED
Binary file (1.26 kB). View file
 
roop/__pycache__/globals.cpython-310.pyc ADDED
Binary file (537 Bytes). View file
 
roop/__pycache__/metadata.cpython-310.pyc ADDED
Binary file (176 Bytes). View file
 
roop/__pycache__/predicter.cpython-310.pyc ADDED
Binary file (1.22 kB). View file
 
roop/__pycache__/typing.cpython-310.pyc ADDED
Binary file (279 Bytes). View file
 
roop/__pycache__/ui.cpython-310.pyc ADDED
Binary file (8.4 kB). View file
 
roop/__pycache__/utilities.cpython-310.pyc ADDED
Binary file (5.59 kB). View file
 
roop/capturer.py ADDED
@@ -0,0 +1,20 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from typing import Any
2
+ import cv2
3
+
4
+
5
+ def get_video_frame(video_path: str, frame_number: int = 0) -> Any:
6
+ capture = cv2.VideoCapture(video_path)
7
+ frame_total = capture.get(cv2.CAP_PROP_FRAME_COUNT)
8
+ capture.set(cv2.CAP_PROP_POS_FRAMES, min(frame_total, frame_number - 1))
9
+ has_frame, frame = capture.read()
10
+ capture.release()
11
+ if has_frame:
12
+ return frame
13
+ return None
14
+
15
+
16
+ def get_video_frame_total(video_path: str) -> int:
17
+ capture = cv2.VideoCapture(video_path)
18
+ video_frame_total = int(capture.get(cv2.CAP_PROP_FRAME_COUNT))
19
+ capture.release()
20
+ return video_frame_total
roop/core.py ADDED
@@ -0,0 +1,215 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ #!/usr/bin/env python3
2
+
3
+ import os
4
+ import sys
5
+ # single thread doubles cuda performance - needs to be set before torch import
6
+ if any(arg.startswith('--execution-provider') for arg in sys.argv):
7
+ os.environ['OMP_NUM_THREADS'] = '1'
8
+ # reduce tensorflow log level
9
+ os.environ['TF_CPP_MIN_LOG_LEVEL'] = '2'
10
+ import warnings
11
+ from typing import List
12
+ import platform
13
+ import signal
14
+ import shutil
15
+ import argparse
16
+ import torch
17
+ import onnxruntime
18
+ import tensorflow
19
+
20
+ import roop.globals
21
+ import roop.metadata
22
+ import roop.ui as ui
23
+ from roop.predicter import predict_image, predict_video
24
+ from roop.processors.frame.core import get_frame_processors_modules
25
+ from roop.utilities import has_image_extension, is_image, is_video, detect_fps, create_video, extract_frames, get_temp_frame_paths, restore_audio, create_temp, move_temp, clean_temp, normalize_output_path
26
+
27
+ if 'ROCMExecutionProvider' in roop.globals.execution_providers:
28
+ del torch
29
+
30
+ warnings.filterwarnings('ignore', category=FutureWarning, module='insightface')
31
+ warnings.filterwarnings('ignore', category=UserWarning, module='torchvision')
32
+
33
+
34
+ def parse_args() -> None:
35
+ signal.signal(signal.SIGINT, lambda signal_number, frame: destroy())
36
+ program = argparse.ArgumentParser(formatter_class=lambda prog: argparse.HelpFormatter(prog, max_help_position=100))
37
+ program.add_argument('-s', '--source', help='select an source image', dest='source_path')
38
+ program.add_argument('-t', '--target', help='select an target image or video', dest='target_path')
39
+ program.add_argument('-o', '--output', help='select output file or directory', dest='output_path')
40
+ program.add_argument('--frame-processor', help='frame processors (choices: face_swapper, face_enhancer, ...)', dest='frame_processor', default=['face_swapper'], nargs='+')
41
+ program.add_argument('--keep-fps', help='keep original fps', dest='keep_fps', action='store_true', default=False)
42
+ program.add_argument('--keep-audio', help='keep original audio', dest='keep_audio', action='store_true', default=True)
43
+ program.add_argument('--keep-frames', help='keep temporary frames', dest='keep_frames', action='store_true', default=False)
44
+ program.add_argument('--many-faces', help='process every face', dest='many_faces', action='store_true', default=False)
45
+ program.add_argument('--video-encoder', help='adjust output video encoder', dest='video_encoder', default='libx264', choices=['libx264', 'libx265', 'libvpx-vp9'])
46
+ program.add_argument('--video-quality', help='adjust output video quality', dest='video_quality', type=int, default=18, choices=range(52), metavar='[0-51]')
47
+ program.add_argument('--max-memory', help='maximum amount of RAM in GB', dest='max_memory', type=int, default=suggest_max_memory())
48
+ program.add_argument('--execution-provider', help='available execution provider (choices: cpu, ...)', dest='execution_provider', default=['cpu'], choices=suggest_execution_providers(), nargs='+')
49
+ program.add_argument('--execution-threads', help='number of execution threads', dest='execution_threads', type=int, default=suggest_execution_threads())
50
+ program.add_argument('-v', '--version', action='version', version=f'{roop.metadata.name} {roop.metadata.version}')
51
+
52
+ args = program.parse_args()
53
+
54
+ roop.globals.source_path = args.source_path
55
+ roop.globals.target_path = args.target_path
56
+ roop.globals.output_path = normalize_output_path(roop.globals.source_path, roop.globals.target_path, args.output_path)
57
+ roop.globals.frame_processors = args.frame_processor
58
+ roop.globals.headless = args.source_path or args.target_path or args.output_path
59
+ roop.globals.keep_fps = args.keep_fps
60
+ roop.globals.keep_audio = args.keep_audio
61
+ roop.globals.keep_frames = args.keep_frames
62
+ roop.globals.many_faces = args.many_faces
63
+ roop.globals.video_encoder = args.video_encoder
64
+ roop.globals.video_quality = args.video_quality
65
+ roop.globals.max_memory = args.max_memory
66
+ roop.globals.execution_providers = decode_execution_providers(args.execution_provider)
67
+ roop.globals.execution_threads = args.execution_threads
68
+
69
+
70
+ def encode_execution_providers(execution_providers: List[str]) -> List[str]:
71
+ return [execution_provider.replace('ExecutionProvider', '').lower() for execution_provider in execution_providers]
72
+
73
+
74
+ def decode_execution_providers(execution_providers: List[str]) -> List[str]:
75
+ return [provider for provider, encoded_execution_provider in zip(onnxruntime.get_available_providers(), encode_execution_providers(onnxruntime.get_available_providers()))
76
+ if any(execution_provider in encoded_execution_provider for execution_provider in execution_providers)]
77
+
78
+
79
+ def suggest_max_memory() -> int:
80
+ if platform.system().lower() == 'darwin':
81
+ return 4
82
+ return 16
83
+
84
+
85
+ def suggest_execution_providers() -> List[str]:
86
+ return encode_execution_providers(onnxruntime.get_available_providers())
87
+
88
+
89
+ def suggest_execution_threads() -> int:
90
+ if 'DmlExecutionProvider' in roop.globals.execution_providers:
91
+ return 1
92
+ if 'ROCMExecutionProvider' in roop.globals.execution_providers:
93
+ return 1
94
+ return 8
95
+
96
+
97
+ def limit_resources() -> None:
98
+ # prevent tensorflow memory leak
99
+ gpus = tensorflow.config.experimental.list_physical_devices('GPU')
100
+ for gpu in gpus:
101
+ tensorflow.config.experimental.set_virtual_device_configuration(gpu, [
102
+ tensorflow.config.experimental.VirtualDeviceConfiguration(memory_limit=1024)
103
+ ])
104
+ # limit memory usage
105
+ if roop.globals.max_memory:
106
+ memory = roop.globals.max_memory * 1024 ** 3
107
+ if platform.system().lower() == 'darwin':
108
+ memory = roop.globals.max_memory * 1024 ** 6
109
+ if platform.system().lower() == 'windows':
110
+ import ctypes
111
+ kernel32 = ctypes.windll.kernel32
112
+ kernel32.SetProcessWorkingSetSize(-1, ctypes.c_size_t(memory), ctypes.c_size_t(memory))
113
+ else:
114
+ import resource
115
+ resource.setrlimit(resource.RLIMIT_DATA, (memory, memory))
116
+
117
+
118
+ def release_resources() -> None:
119
+ if 'CUDAExecutionProvider' in roop.globals.execution_providers:
120
+ torch.cuda.empty_cache()
121
+
122
+
123
+ def pre_check() -> bool:
124
+ if sys.version_info < (3, 9):
125
+ update_status('Python version is not supported - please upgrade to 3.9 or higher.')
126
+ return False
127
+ if not shutil.which('ffmpeg'):
128
+ update_status('ffmpeg is not installed.')
129
+ return False
130
+ return True
131
+
132
+
133
+ def update_status(message: str, scope: str = 'ROOP.CORE') -> None:
134
+ print(f'[{scope}] {message}')
135
+ if not roop.globals.headless:
136
+ ui.update_status(message)
137
+
138
+
139
+ def start() -> None:
140
+ for frame_processor in get_frame_processors_modules(roop.globals.frame_processors):
141
+ if not frame_processor.pre_start():
142
+ return
143
+ # process image to image
144
+ if has_image_extension(roop.globals.target_path):
145
+ if predict_image(roop.globals.target_path):
146
+ destroy()
147
+ shutil.copy2(roop.globals.target_path, roop.globals.output_path)
148
+ for frame_processor in get_frame_processors_modules(roop.globals.frame_processors):
149
+ update_status('Progressing...', frame_processor.NAME)
150
+ frame_processor.process_image(roop.globals.source_path, roop.globals.output_path, roop.globals.output_path)
151
+ frame_processor.post_process()
152
+ release_resources()
153
+ if is_image(roop.globals.target_path):
154
+ update_status('Processing to image succeed!')
155
+ else:
156
+ update_status('Processing to image failed!')
157
+ return
158
+ # process image to videos
159
+ if predict_video(roop.globals.target_path):
160
+ destroy()
161
+ update_status('Creating temp resources...')
162
+ create_temp(roop.globals.target_path)
163
+ update_status('Extracting frames...')
164
+ extract_frames(roop.globals.target_path)
165
+ temp_frame_paths = get_temp_frame_paths(roop.globals.target_path)
166
+ for frame_processor in get_frame_processors_modules(roop.globals.frame_processors):
167
+ update_status('Progressing...', frame_processor.NAME)
168
+ frame_processor.process_video(roop.globals.source_path, temp_frame_paths)
169
+ frame_processor.post_process()
170
+ release_resources()
171
+ # handles fps
172
+ if roop.globals.keep_fps:
173
+ update_status('Detecting fps...')
174
+ fps = detect_fps(roop.globals.target_path)
175
+ update_status(f'Creating video with {fps} fps...')
176
+ create_video(roop.globals.target_path, fps)
177
+ else:
178
+ update_status('Creating video with 30.0 fps...')
179
+ create_video(roop.globals.target_path)
180
+ # handle audio
181
+ if roop.globals.keep_audio:
182
+ if roop.globals.keep_fps:
183
+ update_status('Restoring audio...')
184
+ else:
185
+ update_status('Restoring audio might cause issues as fps are not kept...')
186
+ restore_audio(roop.globals.target_path, roop.globals.output_path)
187
+ else:
188
+ move_temp(roop.globals.target_path, roop.globals.output_path)
189
+ # clean and validate
190
+ clean_temp(roop.globals.target_path)
191
+ if is_video(roop.globals.target_path):
192
+ update_status('Processing to video succeed!')
193
+ else:
194
+ update_status('Processing to video failed!')
195
+
196
+
197
+ def destroy() -> None:
198
+ if roop.globals.target_path:
199
+ clean_temp(roop.globals.target_path)
200
+ quit()
201
+
202
+
203
+ def run() -> None:
204
+ parse_args()
205
+ if not pre_check():
206
+ return
207
+ for frame_processor in get_frame_processors_modules(roop.globals.frame_processors):
208
+ if not frame_processor.pre_check():
209
+ return
210
+ limit_resources()
211
+ if roop.globals.headless:
212
+ start()
213
+ else:
214
+ window = ui.init(start, destroy)
215
+ window.mainloop()
roop/face_analyser.py ADDED
@@ -0,0 +1,34 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import threading
2
+ from typing import Any
3
+ import insightface
4
+
5
+ import roop.globals
6
+ from roop.typing import Frame
7
+
8
+ FACE_ANALYSER = None
9
+ THREAD_LOCK = threading.Lock()
10
+
11
+
12
+ def get_face_analyser() -> Any:
13
+ global FACE_ANALYSER
14
+
15
+ with THREAD_LOCK:
16
+ if FACE_ANALYSER is None:
17
+ FACE_ANALYSER = insightface.app.FaceAnalysis(name='buffalo_l', providers=roop.globals.execution_providers)
18
+ FACE_ANALYSER.prepare(ctx_id=0, det_size=(640, 640))
19
+ return FACE_ANALYSER
20
+
21
+
22
+ def get_one_face(frame: Frame) -> Any:
23
+ face = get_face_analyser().get(frame)
24
+ try:
25
+ return min(face, key=lambda x: x.bbox[0])
26
+ except ValueError:
27
+ return None
28
+
29
+
30
+ def get_many_faces(frame: Frame) -> Any:
31
+ try:
32
+ return get_face_analyser().get(frame)
33
+ except IndexError:
34
+ return None
roop/globals.py ADDED
@@ -0,0 +1,17 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from typing import List
2
+
3
+ source_path = None
4
+ target_path = None
5
+ output_path = None
6
+ frame_processors: List[str] = []
7
+ keep_fps = None
8
+ keep_audio = None
9
+ keep_frames = None
10
+ many_faces = None
11
+ video_encoder = None
12
+ video_quality = None
13
+ max_memory = None
14
+ execution_providers: List[str] = []
15
+ execution_threads = None
16
+ headless = None
17
+ log_level = 'error'
roop/metadata.py ADDED
@@ -0,0 +1,2 @@
 
 
 
1
+ name = 'roop'
2
+ version = '1.1.0'
roop/predicter.py ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import numpy
2
+ import opennsfw2
3
+ from PIL import Image
4
+
5
+ from roop.typing import Frame
6
+
7
+ MAX_PROBABILITY = 0.85
8
+
9
+
10
+ def predict_frame(target_frame: Frame) -> bool:
11
+ image = Image.fromarray(target_frame)
12
+ image = opennsfw2.preprocess_image(image, opennsfw2.Preprocessing.YAHOO)
13
+ model = opennsfw2.make_open_nsfw_model()
14
+ views = numpy.expand_dims(image, axis=0)
15
+ _, probability = model.predict(views)[0]
16
+ return probability > MAX_PROBABILITY
17
+
18
+
19
+ def predict_image(target_path: str) -> bool:
20
+ return opennsfw2.predict_image(target_path) > MAX_PROBABILITY
21
+
22
+
23
+ def predict_video(target_path: str) -> bool:
24
+ _, probabilities = opennsfw2.predict_video_frames(video_path=target_path, frame_interval=100)
25
+ return any(probability > MAX_PROBABILITY for probability in probabilities)
roop/processors/__init__.py ADDED
File without changes
roop/processors/__pycache__/__init__.cpython-310.pyc ADDED
Binary file (152 Bytes). View file
 
roop/processors/frame/__init__.py ADDED
File without changes
roop/processors/frame/__pycache__/__init__.cpython-310.pyc ADDED
Binary file (158 Bytes). View file
 
roop/processors/frame/__pycache__/core.cpython-310.pyc ADDED
Binary file (3.31 kB). View file
 
roop/processors/frame/__pycache__/face_swapper.cpython-310.pyc ADDED
Binary file (3.12 kB). View file
 
roop/processors/frame/core.py ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import os
2
+ import importlib
3
+ import psutil
4
+ from concurrent.futures import ThreadPoolExecutor, as_completed
5
+ from queue import Queue
6
+ from types import ModuleType
7
+ from typing import Any, List, Callable
8
+ from tqdm import tqdm
9
+
10
+ import roop
11
+
12
+ FRAME_PROCESSORS_MODULES: List[ModuleType] = []
13
+ FRAME_PROCESSORS_INTERFACE = [
14
+ 'pre_check',
15
+ 'pre_start',
16
+ 'process_frame',
17
+ 'process_frames',
18
+ 'process_image',
19
+ 'process_video',
20
+ 'post_process'
21
+ ]
22
+
23
+
24
+ def load_frame_processor_module(frame_processor: str) -> Any:
25
+ try:
26
+ frame_processor_module = importlib.import_module(f'roop.processors.frame.{frame_processor}')
27
+ for method_name in FRAME_PROCESSORS_INTERFACE:
28
+ if not hasattr(frame_processor_module, method_name):
29
+ raise NotImplementedError
30
+ except (ImportError, NotImplementedError):
31
+ quit(f'Frame processor {frame_processor} crashed.')
32
+ return frame_processor_module
33
+
34
+
35
+ def get_frame_processors_modules(frame_processors: List[str]) -> List[ModuleType]:
36
+ global FRAME_PROCESSORS_MODULES
37
+
38
+ if not FRAME_PROCESSORS_MODULES:
39
+ for frame_processor in frame_processors:
40
+ frame_processor_module = load_frame_processor_module(frame_processor)
41
+ FRAME_PROCESSORS_MODULES.append(frame_processor_module)
42
+ return FRAME_PROCESSORS_MODULES
43
+
44
+
45
+ def multi_process_frame(source_path: str, temp_frame_paths: List[str], process_frames: Callable[[str, List[str], Any], None], update: Callable[[], None]) -> None:
46
+ with ThreadPoolExecutor(max_workers=roop.globals.execution_threads) as executor:
47
+ futures = []
48
+ queue = create_queue(temp_frame_paths)
49
+ queue_per_future = len(temp_frame_paths) // roop.globals.execution_threads
50
+ while not queue.empty():
51
+ future = executor.submit(process_frames, source_path, pick_queue(queue, queue_per_future), update)
52
+ futures.append(future)
53
+ for future in as_completed(futures):
54
+ future.result()
55
+
56
+
57
+ def create_queue(temp_frame_paths: List[str]) -> Queue[str]:
58
+ queue: Queue[str] = Queue()
59
+ for frame_path in temp_frame_paths:
60
+ queue.put(frame_path)
61
+ return queue
62
+
63
+
64
+ def pick_queue(queue: Queue[str], queue_per_future: int) -> List[str]:
65
+ queues = []
66
+ for _ in range(queue_per_future):
67
+ if not queue.empty():
68
+ queues.append(queue.get())
69
+ return queues
70
+
71
+
72
+ def process_video(source_path: str, frame_paths: list[str], process_frames: Callable[[str, List[str], Any], None]) -> None:
73
+ progress_bar_format = '{l_bar}{bar}| {n_fmt}/{total_fmt} [{elapsed}<{remaining}, {rate_fmt}{postfix}]'
74
+ total = len(frame_paths)
75
+ with tqdm(total=total, desc='Processing', unit='frame', dynamic_ncols=True, bar_format=progress_bar_format) as progress:
76
+ multi_process_frame(source_path, frame_paths, process_frames, lambda: update_progress(progress))
77
+
78
+
79
+ def update_progress(progress: Any = None) -> None:
80
+ process = psutil.Process(os.getpid())
81
+ memory_usage = process.memory_info().rss / 1024 / 1024 / 1024
82
+ progress.set_postfix({
83
+ 'memory_usage': '{:.2f}'.format(memory_usage).zfill(5) + 'GB',
84
+ 'execution_providers': roop.globals.execution_providers,
85
+ 'execution_threads': roop.globals.execution_threads
86
+ })
87
+ progress.refresh()
88
+ progress.update(1)
roop/processors/frame/face_enhancer.py ADDED
@@ -0,0 +1,81 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from typing import Any, List, Callable
2
+ import cv2
3
+ import threading
4
+ import gfpgan
5
+
6
+ import roop.globals
7
+ import roop.processors.frame.core
8
+ from roop.core import update_status
9
+ from roop.face_analyser import get_one_face
10
+ from roop.typing import Frame, Face
11
+ from roop.utilities import conditional_download, resolve_relative_path, is_image, is_video
12
+
13
+ FACE_ENHANCER = None
14
+ THREAD_SEMAPHORE = threading.Semaphore()
15
+ THREAD_LOCK = threading.Lock()
16
+ NAME = 'ROOP.FACE-ENHANCER'
17
+
18
+
19
+ def get_face_enhancer() -> Any:
20
+ global FACE_ENHANCER
21
+
22
+ with THREAD_LOCK:
23
+ if FACE_ENHANCER is None:
24
+ model_path = resolve_relative_path('../models/GFPGANv1.4.pth')
25
+ # todo: set models path https://github.com/TencentARC/GFPGAN/issues/399
26
+ FACE_ENHANCER = gfpgan.GFPGANer(model_path=model_path, upscale=1) # type: ignore[attr-defined]
27
+ return FACE_ENHANCER
28
+
29
+
30
+ def pre_check() -> bool:
31
+ download_directory_path = resolve_relative_path('../models')
32
+ conditional_download(download_directory_path, ['https://huggingface.co/henryruhs/roop/resolve/main/GFPGANv1.4.pth'])
33
+ return True
34
+
35
+
36
+ def pre_start() -> bool:
37
+ if not is_image(roop.globals.target_path) and not is_video(roop.globals.target_path):
38
+ update_status('Select an image or video for target path.', NAME)
39
+ return False
40
+ return True
41
+
42
+
43
+ def post_process() -> None:
44
+ global FACE_ENHANCER
45
+
46
+ FACE_ENHANCER = None
47
+
48
+
49
+ def enhance_face(temp_frame: Frame) -> Frame:
50
+ with THREAD_SEMAPHORE:
51
+ _, _, temp_frame = get_face_enhancer().enhance(
52
+ temp_frame,
53
+ paste_back=True
54
+ )
55
+ return temp_frame
56
+
57
+
58
+ def process_frame(source_face: Face, temp_frame: Frame) -> Frame:
59
+ target_face = get_one_face(temp_frame)
60
+ if target_face:
61
+ temp_frame = enhance_face(temp_frame)
62
+ return temp_frame
63
+
64
+
65
+ def process_frames(source_path: str, temp_frame_paths: List[str], update: Callable[[], None]) -> None:
66
+ for temp_frame_path in temp_frame_paths:
67
+ temp_frame = cv2.imread(temp_frame_path)
68
+ result = process_frame(None, temp_frame)
69
+ cv2.imwrite(temp_frame_path, result)
70
+ if update:
71
+ update()
72
+
73
+
74
+ def process_image(source_path: str, target_path: str, output_path: str) -> None:
75
+ target_frame = cv2.imread(target_path)
76
+ result = process_frame(None, target_frame)
77
+ cv2.imwrite(output_path, result)
78
+
79
+
80
+ def process_video(source_path: str, temp_frame_paths: List[str]) -> None:
81
+ roop.processors.frame.core.process_video(None, temp_frame_paths, process_frames)
roop/processors/frame/face_swapper.py ADDED
@@ -0,0 +1,88 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ from typing import Any, List, Callable
2
+ import cv2
3
+ import insightface
4
+ import threading
5
+
6
+ import roop.globals
7
+ import roop.processors.frame.core
8
+ from roop.core import update_status
9
+ from roop.face_analyser import get_one_face, get_many_faces
10
+ from roop.typing import Face, Frame
11
+ from roop.utilities import conditional_download, resolve_relative_path, is_image, is_video
12
+
13
+ FACE_SWAPPER = None
14
+ THREAD_LOCK = threading.Lock()
15
+ NAME = 'ROOP.FACE-SWAPPER'
16
+
17
+
18
+ def get_face_swapper() -> Any:
19
+ global FACE_SWAPPER
20
+
21
+ with THREAD_LOCK:
22
+ if FACE_SWAPPER is None:
23
+ model_path = resolve_relative_path('../models/inswapper_128.onnx')
24
+ FACE_SWAPPER = insightface.model_zoo.get_model(model_path, providers=roop.globals.execution_providers)
25
+ return FACE_SWAPPER
26
+
27
+
28
+ def pre_check() -> bool:
29
+ download_directory_path = resolve_relative_path('../models')
30
+ conditional_download(download_directory_path, ['https://huggingface.co/henryruhs/roop/resolve/main/inswapper_128.onnx'])
31
+ return True
32
+
33
+
34
+ def pre_start() -> bool:
35
+ if not is_image(roop.globals.source_path):
36
+ update_status('Select an image for source path.', NAME)
37
+ return False
38
+ elif not get_one_face(cv2.imread(roop.globals.source_path)):
39
+ update_status('No face in source path detected.', NAME)
40
+ return False
41
+ if not is_image(roop.globals.target_path) and not is_video(roop.globals.target_path):
42
+ update_status('Select an image or video for target path.', NAME)
43
+ return False
44
+ return True
45
+
46
+
47
+ def post_process() -> None:
48
+ global FACE_SWAPPER
49
+
50
+ FACE_SWAPPER = None
51
+
52
+
53
+ def swap_face(source_face: Face, target_face: Face, temp_frame: Frame) -> Frame:
54
+ return get_face_swapper().get(temp_frame, target_face, source_face, paste_back=True)
55
+
56
+
57
+ def process_frame(source_face: Face, temp_frame: Frame) -> Frame:
58
+ if roop.globals.many_faces:
59
+ many_faces = get_many_faces(temp_frame)
60
+ if many_faces:
61
+ for target_face in many_faces:
62
+ temp_frame = swap_face(source_face, target_face, temp_frame)
63
+ else:
64
+ target_face = get_one_face(temp_frame)
65
+ if target_face:
66
+ temp_frame = swap_face(source_face, target_face, temp_frame)
67
+ return temp_frame
68
+
69
+
70
+ def process_frames(source_path: str, temp_frame_paths: List[str], update: Callable[[], None]) -> None:
71
+ source_face = get_one_face(cv2.imread(source_path))
72
+ for temp_frame_path in temp_frame_paths:
73
+ temp_frame = cv2.imread(temp_frame_path)
74
+ result = process_frame(source_face, temp_frame)
75
+ cv2.imwrite(temp_frame_path, result)
76
+ if update:
77
+ update()
78
+
79
+
80
+ def process_image(source_path: str, target_path: str, output_path: str) -> None:
81
+ source_face = get_one_face(cv2.imread(source_path))
82
+ target_frame = cv2.imread(target_path)
83
+ result = process_frame(source_face, target_frame)
84
+ cv2.imwrite(output_path, result)
85
+
86
+
87
+ def process_video(source_path: str, temp_frame_paths: List[str]) -> None:
88
+ roop.processors.frame.core.process_video(source_path, temp_frame_paths, process_frames)
roop/typing.py ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ from typing import Any
2
+
3
+ from insightface.app.common import Face
4
+ import numpy
5
+
6
+ Face = Face
7
+ Frame = numpy.ndarray[Any, Any]
roop/ui.json ADDED
@@ -0,0 +1,158 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "CTk": {
3
+ "fg_color": ["gray95", "gray10"]
4
+ },
5
+ "CTkToplevel": {
6
+ "fg_color": ["gray95", "gray10"]
7
+ },
8
+ "CTkFrame": {
9
+ "corner_radius": 6,
10
+ "border_width": 0,
11
+ "fg_color": ["gray90", "gray13"],
12
+ "top_fg_color": ["gray85", "gray16"],
13
+ "border_color": ["gray65", "gray28"]
14
+ },
15
+ "CTkButton": {
16
+ "corner_radius": 6,
17
+ "border_width": 0,
18
+ "fg_color": ["#3a7ebf", "#1f538d"],
19
+ "hover_color": ["#325882", "#14375e"],
20
+ "border_color": ["#3E454A", "#949A9F"],
21
+ "text_color": ["#DCE4EE", "#DCE4EE"],
22
+ "text_color_disabled": ["gray74", "gray60"]
23
+ },
24
+ "CTkLabel": {
25
+ "corner_radius": 0,
26
+ "fg_color": "transparent",
27
+ "text_color": ["gray14", "gray84"]
28
+ },
29
+ "CTkEntry": {
30
+ "corner_radius": 6,
31
+ "border_width": 2,
32
+ "fg_color": ["#F9F9FA", "#343638"],
33
+ "border_color": ["#979DA2", "#565B5E"],
34
+ "text_color": ["gray14", "gray84"],
35
+ "placeholder_text_color": ["gray52", "gray62"]
36
+ },
37
+ "CTkCheckbox": {
38
+ "corner_radius": 6,
39
+ "border_width": 3,
40
+ "fg_color": ["#3a7ebf", "#1f538d"],
41
+ "border_color": ["#3E454A", "#949A9F"],
42
+ "hover_color": ["#325882", "#14375e"],
43
+ "checkmark_color": ["#DCE4EE", "gray90"],
44
+ "text_color": ["gray14", "gray84"],
45
+ "text_color_disabled": ["gray60", "gray45"]
46
+ },
47
+ "CTkSwitch": {
48
+ "corner_radius": 1000,
49
+ "border_width": 3,
50
+ "button_length": 0,
51
+ "fg_color": ["#939BA2", "#4A4D50"],
52
+ "progress_color": ["#3a7ebf", "#1f538d"],
53
+ "button_color": ["gray36", "#D5D9DE"],
54
+ "button_hover_color": ["gray20", "gray100"],
55
+ "text_color": ["gray14", "gray84"],
56
+ "text_color_disabled": ["gray60", "gray45"]
57
+ },
58
+ "CTkRadiobutton": {
59
+ "corner_radius": 1000,
60
+ "border_width_checked": 6,
61
+ "border_width_unchecked": 3,
62
+ "fg_color": ["#3a7ebf", "#1f538d"],
63
+ "border_color": ["#3E454A", "#949A9F"],
64
+ "hover_color": ["#325882", "#14375e"],
65
+ "text_color": ["gray14", "gray84"],
66
+ "text_color_disabled": ["gray60", "gray45"]
67
+ },
68
+ "CTkProgressBar": {
69
+ "corner_radius": 1000,
70
+ "border_width": 0,
71
+ "fg_color": ["#939BA2", "#4A4D50"],
72
+ "progress_color": ["#3a7ebf", "#1f538d"],
73
+ "border_color": ["gray", "gray"]
74
+ },
75
+ "CTkSlider": {
76
+ "corner_radius": 1000,
77
+ "button_corner_radius": 1000,
78
+ "border_width": 6,
79
+ "button_length": 0,
80
+ "fg_color": ["#939BA2", "#4A4D50"],
81
+ "progress_color": ["gray40", "#AAB0B5"],
82
+ "button_color": ["#3a7ebf", "#1f538d"],
83
+ "button_hover_color": ["#325882", "#14375e"]
84
+ },
85
+ "CTkOptionMenu": {
86
+ "corner_radius": 6,
87
+ "fg_color": ["#3a7ebf", "#1f538d"],
88
+ "button_color": ["#325882", "#14375e"],
89
+ "button_hover_color": ["#234567", "#1e2c40"],
90
+ "text_color": ["#DCE4EE", "#DCE4EE"],
91
+ "text_color_disabled": ["gray74", "gray60"]
92
+ },
93
+ "CTkComboBox": {
94
+ "corner_radius": 6,
95
+ "border_width": 2,
96
+ "fg_color": ["#F9F9FA", "#343638"],
97
+ "border_color": ["#979DA2", "#565B5E"],
98
+ "button_color": ["#979DA2", "#565B5E"],
99
+ "button_hover_color": ["#6E7174", "#7A848D"],
100
+ "text_color": ["gray14", "gray84"],
101
+ "text_color_disabled": ["gray50", "gray45"]
102
+ },
103
+ "CTkScrollbar": {
104
+ "corner_radius": 1000,
105
+ "border_spacing": 4,
106
+ "fg_color": "transparent",
107
+ "button_color": ["gray55", "gray41"],
108
+ "button_hover_color": ["gray40", "gray53"]
109
+ },
110
+ "CTkSegmentedButton": {
111
+ "corner_radius": 6,
112
+ "border_width": 2,
113
+ "fg_color": ["#979DA2", "gray29"],
114
+ "selected_color": ["#3a7ebf", "#1f538d"],
115
+ "selected_hover_color": ["#325882", "#14375e"],
116
+ "unselected_color": ["#979DA2", "gray29"],
117
+ "unselected_hover_color": ["gray70", "gray41"],
118
+ "text_color": ["#DCE4EE", "#DCE4EE"],
119
+ "text_color_disabled": ["gray74", "gray60"]
120
+ },
121
+ "CTkTextbox": {
122
+ "corner_radius": 6,
123
+ "border_width": 0,
124
+ "fg_color": ["gray100", "gray20"],
125
+ "border_color": ["#979DA2", "#565B5E"],
126
+ "text_color": ["gray14", "gray84"],
127
+ "scrollbar_button_color": ["gray55", "gray41"],
128
+ "scrollbar_button_hover_color": ["gray40", "gray53"]
129
+ },
130
+ "CTkScrollableFrame": {
131
+ "label_fg_color": ["gray80", "gray21"]
132
+ },
133
+ "DropdownMenu": {
134
+ "fg_color": ["gray90", "gray20"],
135
+ "hover_color": ["gray75", "gray28"],
136
+ "text_color": ["gray14", "gray84"]
137
+ },
138
+ "CTkFont": {
139
+ "macOS": {
140
+ "family": "Avenir",
141
+ "size": 12,
142
+ "weight": "normal"
143
+ },
144
+ "Windows": {
145
+ "family": "Corbel",
146
+ "size": 12,
147
+ "weight": "normal"
148
+ },
149
+ "Linux": {
150
+ "family": "Montserrat",
151
+ "size": 12,
152
+ "weight": "normal"
153
+ }
154
+ },
155
+ "RoopDonate": {
156
+ "text_color": ["#3a7ebf", "gray60"]
157
+ }
158
+ }
roop/ui.py ADDED
@@ -0,0 +1,231 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import os
2
+ import webbrowser
3
+ import customtkinter as ctk
4
+ from typing import Callable, Tuple
5
+ import cv2
6
+ from PIL import Image, ImageOps
7
+
8
+ import roop.globals
9
+ import roop.metadata
10
+ from roop.face_analyser import get_one_face
11
+ from roop.capturer import get_video_frame, get_video_frame_total
12
+ from roop.predicter import predict_frame
13
+ from roop.processors.frame.core import get_frame_processors_modules
14
+ from roop.utilities import is_image, is_video, resolve_relative_path
15
+
16
+ ROOT = None
17
+ ROOT_HEIGHT = 700
18
+ ROOT_WIDTH = 600
19
+
20
+ PREVIEW = None
21
+ PREVIEW_MAX_HEIGHT = 700
22
+ PREVIEW_MAX_WIDTH = 1200
23
+
24
+ RECENT_DIRECTORY_SOURCE = None
25
+ RECENT_DIRECTORY_TARGET = None
26
+ RECENT_DIRECTORY_OUTPUT = None
27
+
28
+ preview_label = None
29
+ preview_slider = None
30
+ source_label = None
31
+ target_label = None
32
+ status_label = None
33
+
34
+
35
+ def init(start: Callable[[], None], destroy: Callable[[], None]) -> ctk.CTk:
36
+ global ROOT, PREVIEW
37
+
38
+ ROOT = create_root(start, destroy)
39
+ PREVIEW = create_preview(ROOT)
40
+
41
+ return ROOT
42
+
43
+
44
+ def create_root(start: Callable[[], None], destroy: Callable[[], None]) -> ctk.CTk:
45
+ global source_label, target_label, status_label
46
+
47
+ ctk.deactivate_automatic_dpi_awareness()
48
+ ctk.set_appearance_mode('system')
49
+ ctk.set_default_color_theme(resolve_relative_path('ui.json'))
50
+
51
+ root = ctk.CTk()
52
+ root.minsize(ROOT_WIDTH, ROOT_HEIGHT)
53
+ root.title(f'{roop.metadata.name} {roop.metadata.version}')
54
+ root.configure()
55
+ root.protocol('WM_DELETE_WINDOW', lambda: destroy())
56
+
57
+ source_label = ctk.CTkLabel(root, text=None)
58
+ source_label.place(relx=0.1, rely=0.1, relwidth=0.3, relheight=0.25)
59
+
60
+ target_label = ctk.CTkLabel(root, text=None)
61
+ target_label.place(relx=0.6, rely=0.1, relwidth=0.3, relheight=0.25)
62
+
63
+ source_button = ctk.CTkButton(root, text='Select a face', cursor='hand2', command=lambda: select_source_path())
64
+ source_button.place(relx=0.1, rely=0.4, relwidth=0.3, relheight=0.1)
65
+
66
+ target_button = ctk.CTkButton(root, text='Select a target', cursor='hand2', command=lambda: select_target_path())
67
+ target_button.place(relx=0.6, rely=0.4, relwidth=0.3, relheight=0.1)
68
+
69
+ keep_fps_value = ctk.BooleanVar(value=roop.globals.keep_fps)
70
+ keep_fps_checkbox = ctk.CTkSwitch(root, text='Keep fps', variable=keep_fps_value, cursor='hand2', command=lambda: setattr(roop.globals, 'keep_fps', not roop.globals.keep_fps))
71
+ keep_fps_checkbox.place(relx=0.1, rely=0.6)
72
+
73
+ keep_frames_value = ctk.BooleanVar(value=roop.globals.keep_frames)
74
+ keep_frames_switch = ctk.CTkSwitch(root, text='Keep frames', variable=keep_frames_value, cursor='hand2', command=lambda: setattr(roop.globals, 'keep_frames', keep_frames_value.get()))
75
+ keep_frames_switch.place(relx=0.1, rely=0.65)
76
+
77
+ keep_audio_value = ctk.BooleanVar(value=roop.globals.keep_audio)
78
+ keep_audio_switch = ctk.CTkSwitch(root, text='Keep audio', variable=keep_audio_value, cursor='hand2', command=lambda: setattr(roop.globals, 'keep_audio', keep_audio_value.get()))
79
+ keep_audio_switch.place(relx=0.6, rely=0.6)
80
+
81
+ many_faces_value = ctk.BooleanVar(value=roop.globals.many_faces)
82
+ many_faces_switch = ctk.CTkSwitch(root, text='Many faces', variable=many_faces_value, cursor='hand2', command=lambda: setattr(roop.globals, 'many_faces', many_faces_value.get()))
83
+ many_faces_switch.place(relx=0.6, rely=0.65)
84
+
85
+ start_button = ctk.CTkButton(root, text='Start', cursor='hand2', command=lambda: select_output_path(start))
86
+ start_button.place(relx=0.15, rely=0.75, relwidth=0.2, relheight=0.05)
87
+
88
+ stop_button = ctk.CTkButton(root, text='Destroy', cursor='hand2', command=lambda: destroy())
89
+ stop_button.place(relx=0.4, rely=0.75, relwidth=0.2, relheight=0.05)
90
+
91
+ preview_button = ctk.CTkButton(root, text='Preview', cursor='hand2', command=lambda: toggle_preview())
92
+ preview_button.place(relx=0.65, rely=0.75, relwidth=0.2, relheight=0.05)
93
+
94
+ status_label = ctk.CTkLabel(root, text=None, justify='center')
95
+ status_label.place(relx=0.1, rely=0.9, relwidth=0.8)
96
+
97
+ donate_label = ctk.CTkLabel(root, text='^_^ Donate to project ^_^', justify='center', cursor='hand2')
98
+ donate_label.place(relx=0.1, rely=0.95, relwidth=0.8)
99
+ donate_label.configure(text_color=ctk.ThemeManager.theme.get('RoopDonate').get('text_color'))
100
+ donate_label.bind('<Button>', lambda event: webbrowser.open('https://github.com/sponsors/s0md3v'))
101
+
102
+ return root
103
+
104
+
105
+ def create_preview(parent: ctk.CTkToplevel) -> ctk.CTkToplevel:
106
+ global preview_label, preview_slider
107
+
108
+ preview = ctk.CTkToplevel(parent)
109
+ preview.withdraw()
110
+ preview.title('Preview')
111
+ preview.configure()
112
+ preview.protocol('WM_DELETE_WINDOW', lambda: toggle_preview())
113
+ preview.resizable(width=False, height=False)
114
+
115
+ preview_label = ctk.CTkLabel(preview, text=None)
116
+ preview_label.pack(fill='both', expand=True)
117
+
118
+ preview_slider = ctk.CTkSlider(preview, from_=0, to=0, command=lambda frame_value: update_preview(frame_value))
119
+
120
+ return preview
121
+
122
+
123
+ def update_status(text: str) -> None:
124
+ status_label.configure(text=text)
125
+ ROOT.update()
126
+
127
+
128
+ def select_source_path() -> None:
129
+ global RECENT_DIRECTORY_SOURCE
130
+
131
+ PREVIEW.withdraw()
132
+ source_path = ctk.filedialog.askopenfilename(title='select an source image', initialdir=RECENT_DIRECTORY_SOURCE)
133
+ if is_image(source_path):
134
+ roop.globals.source_path = source_path
135
+ RECENT_DIRECTORY_SOURCE = os.path.dirname(roop.globals.source_path)
136
+ image = render_image_preview(roop.globals.source_path, (200, 200))
137
+ source_label.configure(image=image)
138
+ else:
139
+ roop.globals.source_path = None
140
+ source_label.configure(image=None)
141
+
142
+
143
+ def select_target_path() -> None:
144
+ global RECENT_DIRECTORY_TARGET
145
+
146
+ PREVIEW.withdraw()
147
+ target_path = ctk.filedialog.askopenfilename(title='select an target image or video', initialdir=RECENT_DIRECTORY_TARGET)
148
+ if is_image(target_path):
149
+ roop.globals.target_path = target_path
150
+ RECENT_DIRECTORY_TARGET = os.path.dirname(roop.globals.target_path)
151
+ image = render_image_preview(roop.globals.target_path, (200, 200))
152
+ target_label.configure(image=image)
153
+ elif is_video(target_path):
154
+ roop.globals.target_path = target_path
155
+ RECENT_DIRECTORY_TARGET = os.path.dirname(roop.globals.target_path)
156
+ video_frame = render_video_preview(target_path, (200, 200))
157
+ target_label.configure(image=video_frame)
158
+ else:
159
+ roop.globals.target_path = None
160
+ target_label.configure(image=None)
161
+
162
+
163
+ def select_output_path(start: Callable[[], None]) -> None:
164
+ global RECENT_DIRECTORY_OUTPUT
165
+
166
+ if is_image(roop.globals.target_path):
167
+ output_path = ctk.filedialog.asksaveasfilename(title='save image output file', defaultextension='.png', initialfile='output.png', initialdir=RECENT_DIRECTORY_OUTPUT)
168
+ elif is_video(roop.globals.target_path):
169
+ output_path = ctk.filedialog.asksaveasfilename(title='save video output file', defaultextension='.mp4', initialfile='output.mp4', initialdir=RECENT_DIRECTORY_OUTPUT)
170
+ else:
171
+ output_path = None
172
+ if output_path:
173
+ roop.globals.output_path = output_path
174
+ RECENT_DIRECTORY_OUTPUT = os.path.dirname(roop.globals.output_path)
175
+ start()
176
+
177
+
178
+ def render_image_preview(image_path: str, size: Tuple[int, int]) -> ctk.CTkImage:
179
+ image = Image.open(image_path)
180
+ if size:
181
+ image = ImageOps.fit(image, size, Image.LANCZOS)
182
+ return ctk.CTkImage(image, size=image.size)
183
+
184
+
185
+ def render_video_preview(video_path: str, size: Tuple[int, int], frame_number: int = 0) -> ctk.CTkImage:
186
+ capture = cv2.VideoCapture(video_path)
187
+ if frame_number:
188
+ capture.set(cv2.CAP_PROP_POS_FRAMES, frame_number)
189
+ has_frame, frame = capture.read()
190
+ if has_frame:
191
+ image = Image.fromarray(cv2.cvtColor(frame, cv2.COLOR_BGR2RGB))
192
+ if size:
193
+ image = ImageOps.fit(image, size, Image.LANCZOS)
194
+ return ctk.CTkImage(image, size=image.size)
195
+ capture.release()
196
+ cv2.destroyAllWindows()
197
+
198
+
199
+ def toggle_preview() -> None:
200
+ if PREVIEW.state() == 'normal':
201
+ PREVIEW.withdraw()
202
+ elif roop.globals.source_path and roop.globals.target_path:
203
+ init_preview()
204
+ update_preview()
205
+ PREVIEW.deiconify()
206
+
207
+
208
+ def init_preview() -> None:
209
+ if is_image(roop.globals.target_path):
210
+ preview_slider.pack_forget()
211
+ if is_video(roop.globals.target_path):
212
+ video_frame_total = get_video_frame_total(roop.globals.target_path)
213
+ preview_slider.configure(to=video_frame_total)
214
+ preview_slider.pack(fill='x')
215
+ preview_slider.set(0)
216
+
217
+
218
+ def update_preview(frame_number: int = 0) -> None:
219
+ if roop.globals.source_path and roop.globals.target_path:
220
+ temp_frame = get_video_frame(roop.globals.target_path, frame_number)
221
+ if predict_frame(temp_frame):
222
+ quit()
223
+ for frame_processor in get_frame_processors_modules(roop.globals.frame_processors):
224
+ temp_frame = frame_processor.process_frame(
225
+ get_one_face(cv2.imread(roop.globals.source_path)),
226
+ temp_frame
227
+ )
228
+ image = Image.fromarray(cv2.cvtColor(temp_frame, cv2.COLOR_BGR2RGB))
229
+ image = ImageOps.contain(image, (PREVIEW_MAX_WIDTH, PREVIEW_MAX_HEIGHT), Image.LANCZOS)
230
+ image = ctk.CTkImage(image, size=image.size)
231
+ preview_label.configure(image=image)
roop/utilities.py ADDED
@@ -0,0 +1,141 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import glob
2
+ import mimetypes
3
+ import os
4
+ import platform
5
+ import shutil
6
+ import ssl
7
+ import subprocess
8
+ import urllib
9
+ from pathlib import Path
10
+ from typing import List, Any
11
+ from tqdm import tqdm
12
+
13
+ import roop.globals
14
+
15
+ TEMP_FILE = 'temp.mp4'
16
+ TEMP_DIRECTORY = 'temp'
17
+
18
+ # monkey patch ssl for mac
19
+ if platform.system().lower() == 'darwin':
20
+ ssl._create_default_https_context = ssl._create_unverified_context
21
+
22
+
23
+ def run_ffmpeg(args: List[str]) -> bool:
24
+ commands = ['ffmpeg', '-hide_banner', '-hwaccel', 'auto', '-loglevel', roop.globals.log_level]
25
+ commands.extend(args)
26
+ try:
27
+ subprocess.check_output(commands, stderr=subprocess.STDOUT)
28
+ return True
29
+ except Exception:
30
+ pass
31
+ return False
32
+
33
+
34
+ def detect_fps(target_path: str) -> float:
35
+ command = ['ffprobe', '-v', 'error', '-select_streams', 'v:0', '-show_entries', 'stream=r_frame_rate', '-of', 'default=noprint_wrappers=1:nokey=1', target_path]
36
+ output = subprocess.check_output(command).decode().strip().split('/')
37
+ try:
38
+ numerator, denominator = map(int, output)
39
+ return numerator / denominator
40
+ except Exception:
41
+ pass
42
+ return 30.0
43
+
44
+
45
+ def extract_frames(target_path: str) -> None:
46
+ temp_directory_path = get_temp_directory_path(target_path)
47
+ run_ffmpeg(['-i', target_path, '-pix_fmt', 'rgb24', os.path.join(temp_directory_path, '%04d.png')])
48
+
49
+
50
+ def create_video(target_path: str, fps: float = 30.0) -> None:
51
+ temp_output_path = get_temp_output_path(target_path)
52
+ temp_directory_path = get_temp_directory_path(target_path)
53
+ run_ffmpeg(['-r', str(fps), '-i', os.path.join(temp_directory_path, '%04d.png'), '-c:v', roop.globals.video_encoder, '-crf', str(roop.globals.video_quality), '-pix_fmt', 'yuv420p', '-vf', 'colorspace=bt709:iall=bt601-6-625:fast=1', '-y', temp_output_path])
54
+
55
+
56
+ def restore_audio(target_path: str, output_path: str) -> None:
57
+ temp_output_path = get_temp_output_path(target_path)
58
+ done = run_ffmpeg(['-i', temp_output_path, '-i', target_path, '-c:v', 'copy', '-map', '0:v:0', '-map', '1:a:0', '-y', output_path])
59
+ if not done:
60
+ move_temp(target_path, output_path)
61
+
62
+
63
+ def get_temp_frame_paths(target_path: str) -> List[str]:
64
+ temp_directory_path = get_temp_directory_path(target_path)
65
+ return glob.glob((os.path.join(glob.escape(temp_directory_path), '*.png')))
66
+
67
+
68
+ def get_temp_directory_path(target_path: str) -> str:
69
+ target_name, _ = os.path.splitext(os.path.basename(target_path))
70
+ target_directory_path = os.path.dirname(target_path)
71
+ return os.path.join(target_directory_path, TEMP_DIRECTORY, target_name)
72
+
73
+
74
+ def get_temp_output_path(target_path: str) -> str:
75
+ temp_directory_path = get_temp_directory_path(target_path)
76
+ return os.path.join(temp_directory_path, TEMP_FILE)
77
+
78
+
79
+ def normalize_output_path(source_path: str, target_path: str, output_path: str) -> Any:
80
+ if source_path and target_path:
81
+ source_name, _ = os.path.splitext(os.path.basename(source_path))
82
+ target_name, target_extension = os.path.splitext(os.path.basename(target_path))
83
+ if os.path.isdir(output_path):
84
+ return os.path.join(output_path, source_name + '-' + target_name + target_extension)
85
+ return output_path
86
+
87
+
88
+ def create_temp(target_path: str) -> None:
89
+ temp_directory_path = get_temp_directory_path(target_path)
90
+ Path(temp_directory_path).mkdir(parents=True, exist_ok=True)
91
+
92
+
93
+ def move_temp(target_path: str, output_path: str) -> None:
94
+ temp_output_path = get_temp_output_path(target_path)
95
+ if os.path.isfile(temp_output_path):
96
+ if os.path.isfile(output_path):
97
+ os.remove(output_path)
98
+ shutil.move(temp_output_path, output_path)
99
+
100
+
101
+ def clean_temp(target_path: str) -> None:
102
+ temp_directory_path = get_temp_directory_path(target_path)
103
+ parent_directory_path = os.path.dirname(temp_directory_path)
104
+ if not roop.globals.keep_frames and os.path.isdir(temp_directory_path):
105
+ shutil.rmtree(temp_directory_path)
106
+ if os.path.exists(parent_directory_path) and not os.listdir(parent_directory_path):
107
+ os.rmdir(parent_directory_path)
108
+
109
+
110
+ def has_image_extension(image_path: str) -> bool:
111
+ return image_path.lower().endswith(('png', 'jpg', 'jpeg', 'webp'))
112
+
113
+
114
+ def is_image(image_path: str) -> bool:
115
+ if image_path and os.path.isfile(image_path):
116
+ mimetype, _ = mimetypes.guess_type(image_path)
117
+ return bool(mimetype and mimetype.startswith('image/'))
118
+ return False
119
+
120
+
121
+ def is_video(video_path: str) -> bool:
122
+ if video_path and os.path.isfile(video_path):
123
+ mimetype, _ = mimetypes.guess_type(video_path)
124
+ return bool(mimetype and mimetype.startswith('video/'))
125
+ return False
126
+
127
+
128
+ def conditional_download(download_directory_path: str, urls: List[str]) -> None:
129
+ if not os.path.exists(download_directory_path):
130
+ os.makedirs(download_directory_path)
131
+ for url in urls:
132
+ download_file_path = os.path.join(download_directory_path, os.path.basename(url))
133
+ if not os.path.exists(download_file_path):
134
+ request = urllib.request.urlopen(url) # type: ignore[attr-defined]
135
+ total = int(request.headers.get('Content-Length', 0))
136
+ with tqdm(total=total, desc='Downloading', unit='B', unit_scale=True, unit_divisor=1024) as progress:
137
+ urllib.request.urlretrieve(url, download_file_path, reporthook=lambda count, block_size, total_size: progress.update(block_size)) # type: ignore[attr-defined]
138
+
139
+
140
+ def resolve_relative_path(path: str) -> str:
141
+ return os.path.abspath(os.path.join(os.path.dirname(__file__), path))