Commit Graph

31 Commits

Author SHA1 Message Date
Tudor D. Pop a618697e34
feat(notifications) revisit timeouts and make them configurable 2021-11-24 12:05:27 +01:00
Gabriel Borlea 61684b1071
feat(facial-expressions): add the facial expression feature and display them in speakerstats (#10006)
* Initial implementation; Happy flow

* Maybe revert this

* Functional prototype

* feat(facial-expressions): get stream when changing background effect and use presenter effect with camera

* add(facial-expressions): array that stores the expressions durin the meeting

* refactor(facial-expressions): capture imagebitmap from stream with imagecapture api

* add(speaker-stats): expression label

* fix(facial-expression): expression store

* revert: expression leabel on speaker stats

* add(facial-expressions): broadcast of expression when it changes

* feat: facial expression handling on prosody

* fix(facial-expressions): get the right track when opening and closing camera

* add(speaker-stats): facial expression column

* fix(facial-expressions): allow to start facial recognition only after joining conference

* fix(mod_speakerstats_component): storing last emotion in speaker stats component and sending it

* chore(facial-expressions): change detection from 2000ms to 1000ms

* add(facial-expressions): send expression to server when there is only one participant

* feat(facial-expressions): store expresions as a timeline

* feat(mod_speakerstats_component): store facial expresions as a timeline

* fix(facial-expressions): stop facial recognition only when muting video track

* fix(facial-expressions): presenter mode get right track to detect face

* add: polyfils for image capture for firefox and safari

* refactor(facial-expressions): store expressions by counting them in a map

* chore(facial-expressions): remove manually assigning the backend for tenserflowjs

* feat(facial-expressions): move face-api from main thread to web worker

* fix(facial-expressions): make feature work on firefox and safari

* feat(facial-expressions): camera time tracker

* feat(facial-expressions): camera time tracker in prosody

* add(facial-expressions): expressions time as TimeElapsed object in speaker stats

* fix(facial-expresions): lower the frequency of detection when tf uses cpu backend

* add(facial-expressions): duration to the expression and send it with durantion when it is done

* fix(facial-expressions): prosody speaker stats covert fro string to number and bool values set by xmpp

* refactor(facial-expressions): change expressions labels from text to emoji

* refactor(facial-expressions): remove camera time tracker

* add(facial-expressions): detection time interval

* chore(facial-expressions): add docs and minor refactor of the code

* refactor(facial-expressions): put timeout in worker and remove set interval in main thread

* feat(facial-expressions): disable feature in the config

* add(facial-expressions): tooltips of labels in speaker stats

* refactor(facial-expressions): send facial expressions function and remove some unused functions and console logs

* refactor(facial-expressions): rename action type when a change is done to the track by the virtual backgrounds to be used in facial expressions middleware

* chore(facial-expressions): order imports and format some code

* fix(facial-expressions): rebase issues with newer master

* fix(facial-expressions): package-lock.json

* fix(facial-expression): add commented default value of disableFacialRecognition flag and short description

* fix(facial-expressions): change disableFacialRecognition to enableFacialRecognition flag in config

* fix: resources load-test package-lock.json

* fix(facial-expressions): set and get facial expressions only if facial recognition enabled

* add: facial recognition resources folder in .eslintignore

* chore: package-lock update

* fix: package-lock.json

* fix(facial-expressions): gpu memory leak in the web worker

* fix(facial-expressions): set cpu time interval for detection to 6000ms

* chore(speaker-stats): fix indentation

* chore(facial-expressions): remove empty lines between comments and type declarations

* fix(facial-expressions): remove camera timetracker

* fix(facial-expressions): remove facialRecognitionAllowed flag

* fix(facial-expressions): remove sending interval time to worker

* refactor(facial-expression): middleware

* fix(facial-expression): end tensor scope after setting backend

* fix(facial-expressions): sending info back to worker only on facial expression message

* fix: lint errors

* refactor(facial-expressions): bundle web worker using webpack

* fix: deploy-facial-expressions command in makefile

* chore: fix load test package-lock.json and package.json

* chore: sync package-lock.json

Co-authored-by: Mihai-Andrei Uscat <mihai.uscat@8x8.com>
2021-11-17 16:33:03 +02:00
Pavol Cvengros 2d27195652 chore(deps) update uuid package to 8.3.2
Co-authored-by: Saúl Ibarra Corretgé <saghul@jitsi.org>
2021-11-10 11:35:20 +01:00
Saúl Ibarra Corretgé 162a67fe8b chore(lint) tame the (uppdated) linter 2021-11-09 09:43:55 +01:00
robertpin 69d2cb52fe feat(virtual-bg) Added config to disable screen sharing as virtual bg 2021-11-01 09:50:22 +02:00
Vlad Piersec f9cc813e91 feat(dynamic-branding): Add branding option for virtual backgrounds 2021-09-27 12:59:17 +03:00
Horatiu Muresan 1add438a1f
feat(toolbar-buttons): Add event for notify overwritten toolbar buttons 2021-09-14 10:07:20 +03:00
Tudor D. Pop eb4aefbca1
fix(virtual-background) upload bkg image on poor connection 2021-08-26 15:33:43 +02:00
Avram Tudor 1ad9046a38
Improve premeeting screens ux (#9726)
* feat(prejoin) move invite to toolbar section

* feat(premeeting) redesign prejoin and lobby screens

* code review changes

* fix prejoin flicker and avatar id

* fix password error message and native lobby dialog close position
2021-08-20 11:53:11 +03:00
tudordan7 bb8c30a6c9 fix(virtual-background): Add logs on virtual background actions. 2021-07-16 10:31:35 +03:00
tudordan7 8db3a341b3 fix(virtual-background): Set x scale to default value on desktop share as a virtual background deactivation. 2021-07-12 15:32:58 +03:00
Tudor D. Pop d72b27d46d
fix(virtual-background): Fix mirror behavior for remote participants. 2021-07-08 13:20:12 -04:00
Tudor D. Pop 74d65ff596
fix(virtual-background): Fix resize action and prevent mirror behavio… (#9441)
* fix(virtual-background): Fix resize action and prevent mirror behaviour on desktop share as a virtual background.
Co-authored-by: tudordan7 <tudor.pop@decagon.tech>
2021-06-24 11:21:34 -04:00
Hristo Terezov 0a37ef7d46 fix(VirtualBackgroundDialog): SS on electron. 2021-06-21 17:12:51 +03:00
Tudor D. Pop dc776d209c
fix(virtual-background): Prevent virtual background selection if it h… (#9414)
Co-authored-by: tudordan7 <tudor.pop@decagon.tech>
2021-06-18 10:18:05 -04:00
Steffen Kolmer e9675453e1
feat: Make Jitsi WCAG 2.1 compliant (#8921)
* Make Jitsi WCAG 2.1 compliant

* Fixed password form keypress handling

* Added keypress handler to name form

* Removed unneccessary dom query

* Fixed mouse hove style

* Removed obsolete css rules

* accessibilty background feature

* Merge remote-tracking branch 'upstream/master' into nic/fix/merge-conflicts

* fix error

* add german translation

* Fixed merge issue

* Add id prop back to device selection

* Fixed lockfile

Co-authored-by: AHMAD KADRI <52747422+ahmadkadri@users.noreply.github.com>
2021-06-10 07:48:44 -05:00
damencho 06ce24527e fix: Escapes some keys when parsing input. 2021-06-02 15:24:13 -05:00
tudordan7 c0917f87ae feat(virtual-background): Desktop share as virtual background 2021-05-26 12:36:29 -04:00
tudordan7 7f020a1107 feat(virtual-background): Desktop share as virtual background 2021-05-26 12:36:29 -04:00
tudordan7 f5dd848daf feat(virtual-background): Desktop share as virtual background 2021-05-26 12:36:29 -04:00
tudordan7 99f61ca2cd feat(virtual-background): Desktop share as virtual background 2021-05-26 12:36:29 -04:00
tudordan7 be0632783d feat(virtual-background): Desktop share as virtual background wip 2021-05-26 12:36:29 -04:00
Tudor D. Pop d7a6a48acd
fix(virtual-background): Responsive virtual background dialog
Fixes: https://github.com/jitsi/jitsi-meet/issues/9202
2021-05-20 17:12:39 +02:00
Tudor D. Pop dcc659215e
fix(virtual-background) fix track leak in preview 2021-05-12 11:36:49 +02:00
Tudor D. Pop 9ef984ca3d
feat(virtual-background) add virtual background preview
Also enable background selection while muted.
2021-05-06 08:54:23 +02:00
Tudor D. Pop b1833fddad
feat(virtual-background) Virtual background UI changes 2021-04-14 18:26:36 +02:00
Tudor D. Pop 7ca04ccb0f
fix(virtual-background) keep selected state on dialog 2021-04-09 16:25:26 +02:00
Tudor D. Pop af28080058
feat(virtual-background) add slight blur option 2021-04-09 14:17:06 +02:00
tudordan7 3453e49182 fix(virtual-background): Hide scrollbar on loading action. 2021-03-30 13:43:57 +02:00
Tudor D. Pop 77ee4b13e1
feat(virtual-backgrounds) add ability to upload custom images 2021-03-24 17:32:45 +01:00
tudordan7 194d357005 feat(virtual-backgrounds) add virtual background support 2021-03-12 15:05:20 +01:00