jiti-meet/css
Gabriel Borlea 61684b1071
feat(facial-expressions): add the facial expression feature and display them in speakerstats (#10006)
* Initial implementation; Happy flow

* Maybe revert this

* Functional prototype

* feat(facial-expressions): get stream when changing background effect and use presenter effect with camera

* add(facial-expressions): array that stores the expressions durin the meeting

* refactor(facial-expressions): capture imagebitmap from stream with imagecapture api

* add(speaker-stats): expression label

* fix(facial-expression): expression store

* revert: expression leabel on speaker stats

* add(facial-expressions): broadcast of expression when it changes

* feat: facial expression handling on prosody

* fix(facial-expressions): get the right track when opening and closing camera

* add(speaker-stats): facial expression column

* fix(facial-expressions): allow to start facial recognition only after joining conference

* fix(mod_speakerstats_component): storing last emotion in speaker stats component and sending it

* chore(facial-expressions): change detection from 2000ms to 1000ms

* add(facial-expressions): send expression to server when there is only one participant

* feat(facial-expressions): store expresions as a timeline

* feat(mod_speakerstats_component): store facial expresions as a timeline

* fix(facial-expressions): stop facial recognition only when muting video track

* fix(facial-expressions): presenter mode get right track to detect face

* add: polyfils for image capture for firefox and safari

* refactor(facial-expressions): store expressions by counting them in a map

* chore(facial-expressions): remove manually assigning the backend for tenserflowjs

* feat(facial-expressions): move face-api from main thread to web worker

* fix(facial-expressions): make feature work on firefox and safari

* feat(facial-expressions): camera time tracker

* feat(facial-expressions): camera time tracker in prosody

* add(facial-expressions): expressions time as TimeElapsed object in speaker stats

* fix(facial-expresions): lower the frequency of detection when tf uses cpu backend

* add(facial-expressions): duration to the expression and send it with durantion when it is done

* fix(facial-expressions): prosody speaker stats covert fro string to number and bool values set by xmpp

* refactor(facial-expressions): change expressions labels from text to emoji

* refactor(facial-expressions): remove camera time tracker

* add(facial-expressions): detection time interval

* chore(facial-expressions): add docs and minor refactor of the code

* refactor(facial-expressions): put timeout in worker and remove set interval in main thread

* feat(facial-expressions): disable feature in the config

* add(facial-expressions): tooltips of labels in speaker stats

* refactor(facial-expressions): send facial expressions function and remove some unused functions and console logs

* refactor(facial-expressions): rename action type when a change is done to the track by the virtual backgrounds to be used in facial expressions middleware

* chore(facial-expressions): order imports and format some code

* fix(facial-expressions): rebase issues with newer master

* fix(facial-expressions): package-lock.json

* fix(facial-expression): add commented default value of disableFacialRecognition flag and short description

* fix(facial-expressions): change disableFacialRecognition to enableFacialRecognition flag in config

* fix: resources load-test package-lock.json

* fix(facial-expressions): set and get facial expressions only if facial recognition enabled

* add: facial recognition resources folder in .eslintignore

* chore: package-lock update

* fix: package-lock.json

* fix(facial-expressions): gpu memory leak in the web worker

* fix(facial-expressions): set cpu time interval for detection to 6000ms

* chore(speaker-stats): fix indentation

* chore(facial-expressions): remove empty lines between comments and type declarations

* fix(facial-expressions): remove camera timetracker

* fix(facial-expressions): remove facialRecognitionAllowed flag

* fix(facial-expressions): remove sending interval time to worker

* refactor(facial-expression): middleware

* fix(facial-expression): end tensor scope after setting backend

* fix(facial-expressions): sending info back to worker only on facial expression message

* fix: lint errors

* refactor(facial-expressions): bundle web worker using webpack

* fix: deploy-facial-expressions command in makefile

* chore: fix load test package-lock.json and package.json

* chore: sync package-lock.json

Co-authored-by: Mihai-Andrei Uscat <mihai.uscat@8x8.com>
2021-11-17 16:33:03 +02:00
..
aui-components fixed dropdown colors 2016-11-14 11:01:50 +02:00
components feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
deep-linking feat(PromotionalFooter): Implement 2019-11-06 03:29:49 -08:00
filmstrip fix(FIlmstrip): disable default overscrolling 2021-10-08 09:13:56 -05:00
modals feat(facial-expressions): add the facial expression feature and display them in speakerstats (#10006) 2021-11-17 16:33:03 +02:00
overlay fix(gum) add event handling for SLOW_GET_USER_MEDIA 2021-02-23 13:51:24 +02:00
premeeting fix(responsive-ui): Make modal full screen & fix prejoin layout on mobile landscape 2021-11-17 10:44:35 +02:00
reload_overlay ref(overlay): convert progress bar to react 2017-11-21 14:45:43 -08:00
ringing feat(callee-info): Redesign. 2018-07-09 20:22:43 -05:00
themes feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
third-party-branding Google & Microsoft calendar API integration (#3340) 2018-08-15 13:11:54 -07:00
unsupported-browser Deeplinking (#2760) 2018-04-13 17:00:40 -07:00
404.scss 404 error page added 2016-10-24 19:33:08 +03:00
_atlaskit_overrides.scss fix(responsive-ui): Make modal full screen & fix prejoin layout on mobile landscape 2021-11-17 10:44:35 +02:00
_audio-preview.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_aui_reset.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_avatar.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_base.scss fix(moderation) display green mic icon only for active speaker (#9744) 2021-08-18 15:10:16 +03:00
_chat.scss refactor(chat): Don't display chat inside a dialog 2021-10-26 09:11:14 +03:00
_chrome-extension-banner.scss Add `Install chrome extension` banner (#4996) 2020-01-23 09:32:52 +00:00
_connection-info.scss fix(Drawer): Close drawer on item click 2021-11-02 15:45:29 +02:00
_country-picker.scss feat(ui) update AtlasKit components 2021-01-26 16:47:55 +01:00
_drawer.scss feat(notifications) Changed notifications stack to be full height 2021-10-13 16:37:34 +02:00
_e2ee.scss fix(e2ee) show entire content at all times 2021-08-19 17:19:00 +02:00
_functions.scss Dialogs re-design, invite and password modifications 2016-10-11 19:08:24 -05:00
_inlay.scss feat: Drops filmStripOnly mode. (#8074) 2020-11-10 16:21:07 -06:00
_keyboard-shortcuts.scss feat(keyboard-shortcuts): show help in a react dialog (#2148) 2017-11-13 16:58:00 -06:00
_login_menu.scss Uses tooltip to show custom popups for mute mic button/shared video button. 2017-02-15 11:29:26 +02:00
_meetings_list.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_meter.scss deps: replace node-sass with sass 2020-09-17 16:44:01 +02:00
_mini_toolbox.scss feat(aot): improve AOT UI/UX 2021-04-28 09:49:37 +02:00
_mixins.scss Improve premeeting screens ux (#9726) 2021-08-20 11:53:11 +03:00
_modaldialog.scss Dialogs re-design, invite and password modifications 2016-10-11 19:08:24 -05:00
_navigate_section_list.scss fix(web/Text): p->span 2018-09-27 01:42:59 -05:00
_notice.scss React Toolbar 2017-04-03 13:05:21 -05:00
_notifications.scss feat(notifications) Changed notifications stack to be full height 2021-10-13 16:37:34 +02:00
_participants-count.scss feat(Labels): Redesign labels on mobile & web 2021-04-08 11:57:15 +02:00
_participants-pane.scss fix(Chat): Place Chat pane above Participants pane on mobile web 2021-11-01 15:30:59 +02:00
_plan-limit.scss feat(jaas) display messages about features that are disabled for jaas… (#9448) 2021-06-25 16:28:54 +03:00
_policy.scss Add policy section 2016-10-31 18:23:28 +02:00
_polls.scss feat(Polls): Display creator name for polls 2021-11-02 15:45:46 +02:00
_popover.scss fix(Drawer): Close drawer on item click 2021-11-02 15:45:29 +02:00
_popup_menu.scss fix(Drawer): Close drawer on item click 2021-11-02 15:45:29 +02:00
_promotional-footer.scss feat(PromotionalFooter): Implement 2019-11-06 03:29:49 -08:00
_reactions-menu.scss fix(reactions) Reactions improvements (#9964) 2021-09-21 12:30:24 -05:00
_recording.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_redirect_page.scss fix(filmstriponly): Set the background to transparent 2017-02-21 13:45:46 -06:00
_responsive.scss feat(Toolbar): Redesign web toolbar 2021-03-09 16:29:44 +02:00
_settings-button.scss fix(toolbox): Background of disabled settings button & tileview button 2021-03-16 09:20:02 +01:00
_subject.scss fix(subject): Keep subject centered when chat panel is open 2021-09-24 15:46:33 +03:00
_toolbars.scss feat(dynamic-branding): Add custom theme branding (#10335) 2021-11-15 10:37:54 +02:00
_transcription-subtitles.scss feat(DominantSpeakerName): Implement 2021-07-21 09:05:47 +03:00
_utils.scss ref(Filmstrip): Optimize resizes. (#4992) 2020-01-24 16:28:47 +00:00
_variables.scss refactor(chat): Don't display chat inside a dialog 2021-10-26 09:11:14 +03:00
_video-preview.scss feat: Make Jitsi WCAG 2.1 compliant (#8921) 2021-06-10 07:48:44 -05:00
_videolayout_default.scss fix(connection-indicator): Hide indicator circle when ghost icon is hidden. 2021-11-01 10:02:43 +01:00
_welcome_page.scss fix(css) moved to the left moderation text 2021-07-14 11:47:46 +03:00
_welcome_page_content.scss feat(welcome): new design (#2492) 2018-02-21 22:58:55 -06:00
_welcome_page_settings_toolbar.scss Naming conventions; Add variables 2019-10-15 06:54:54 -07:00
main.scss feat(dynamic-branding): Add custom theme branding (#10335) 2021-11-15 10:37:54 +02:00