Commit Graph

867 Commits

Author SHA1 Message Date
Saúl Ibarra Corretgé 7bbc3bcf9e chore(rn,deps) react-native-webrtc@1.94.0 2021-11-25 12:15:56 +01:00
George Politis 03848fb3f8
chore(deps) lib-jitsi-meet@latest (#10436)
feat: Enables the moderator to {dis/en}able bridge-side rtcstats.

https://github.com/jitsi/lib-jitsi-meet/pull/1789
0261073faf
2021-11-24 15:57:32 +00:00
Jaya Allamsetty 83e22524bc chore(deps) lib-jitsi-meet@latest
* fix(TPC): Select 1 as the default scale factor for p2p. This fixes an issue where a user is not able to unmute their video if the MediaStreamTrack associated with the camera stream returns a null value for the track height.
* Save track source name to JitsiRemoteTrack

bdfbb82087...a1c966058c
2021-11-23 15:10:41 -05:00
Vlad Piersec 76a976b5d1 fix(Avatar): Display correctly any emoji/special character in a avatar initials 2021-11-23 13:56:45 +02:00
Saúl Ibarra Corretgé d98ea3ca24 chore(deps) lib-jitsi-meet@latest
* feat(breakout-rooms) introduce breakout rooms

131b9458fe...bdfbb82087
2021-11-19 09:37:43 +01:00
Jaya Allamsetty d2b7151f23 chore(deps) lib-jitsi-meet@latest
* TPC: make the comments more descriptive.
* fix(SignalingLayerImpl): Log an error when only the ssrc owner gets overwritten with a diff ep id.
* fix(TPC): Force reneg when user unmutes the first time. This ensures that the source signaling is sent before the mute state is sent in presence. Jicofo relies on mute state from presence to check if the sender limit has been reached.

6d981ebb6c...131b9458fe
2021-11-18 11:13:09 -05:00
Andrei Gavrilescu 6243836b3e
chore(deps) lib-jitsi-meet@latest (#10386)
* feat: add facial-expressions in speaker stats (#1724)

b337778da8...6d981ebb6c
2021-11-17 18:32:49 +02:00
Gabriel Borlea 61684b1071
feat(facial-expressions): add the facial expression feature and display them in speakerstats (#10006)
* Initial implementation; Happy flow

* Maybe revert this

* Functional prototype

* feat(facial-expressions): get stream when changing background effect and use presenter effect with camera

* add(facial-expressions): array that stores the expressions durin the meeting

* refactor(facial-expressions): capture imagebitmap from stream with imagecapture api

* add(speaker-stats): expression label

* fix(facial-expression): expression store

* revert: expression leabel on speaker stats

* add(facial-expressions): broadcast of expression when it changes

* feat: facial expression handling on prosody

* fix(facial-expressions): get the right track when opening and closing camera

* add(speaker-stats): facial expression column

* fix(facial-expressions): allow to start facial recognition only after joining conference

* fix(mod_speakerstats_component): storing last emotion in speaker stats component and sending it

* chore(facial-expressions): change detection from 2000ms to 1000ms

* add(facial-expressions): send expression to server when there is only one participant

* feat(facial-expressions): store expresions as a timeline

* feat(mod_speakerstats_component): store facial expresions as a timeline

* fix(facial-expressions): stop facial recognition only when muting video track

* fix(facial-expressions): presenter mode get right track to detect face

* add: polyfils for image capture for firefox and safari

* refactor(facial-expressions): store expressions by counting them in a map

* chore(facial-expressions): remove manually assigning the backend for tenserflowjs

* feat(facial-expressions): move face-api from main thread to web worker

* fix(facial-expressions): make feature work on firefox and safari

* feat(facial-expressions): camera time tracker

* feat(facial-expressions): camera time tracker in prosody

* add(facial-expressions): expressions time as TimeElapsed object in speaker stats

* fix(facial-expresions): lower the frequency of detection when tf uses cpu backend

* add(facial-expressions): duration to the expression and send it with durantion when it is done

* fix(facial-expressions): prosody speaker stats covert fro string to number and bool values set by xmpp

* refactor(facial-expressions): change expressions labels from text to emoji

* refactor(facial-expressions): remove camera time tracker

* add(facial-expressions): detection time interval

* chore(facial-expressions): add docs and minor refactor of the code

* refactor(facial-expressions): put timeout in worker and remove set interval in main thread

* feat(facial-expressions): disable feature in the config

* add(facial-expressions): tooltips of labels in speaker stats

* refactor(facial-expressions): send facial expressions function and remove some unused functions and console logs

* refactor(facial-expressions): rename action type when a change is done to the track by the virtual backgrounds to be used in facial expressions middleware

* chore(facial-expressions): order imports and format some code

* fix(facial-expressions): rebase issues with newer master

* fix(facial-expressions): package-lock.json

* fix(facial-expression): add commented default value of disableFacialRecognition flag and short description

* fix(facial-expressions): change disableFacialRecognition to enableFacialRecognition flag in config

* fix: resources load-test package-lock.json

* fix(facial-expressions): set and get facial expressions only if facial recognition enabled

* add: facial recognition resources folder in .eslintignore

* chore: package-lock update

* fix: package-lock.json

* fix(facial-expressions): gpu memory leak in the web worker

* fix(facial-expressions): set cpu time interval for detection to 6000ms

* chore(speaker-stats): fix indentation

* chore(facial-expressions): remove empty lines between comments and type declarations

* fix(facial-expressions): remove camera timetracker

* fix(facial-expressions): remove facialRecognitionAllowed flag

* fix(facial-expressions): remove sending interval time to worker

* refactor(facial-expression): middleware

* fix(facial-expression): end tensor scope after setting backend

* fix(facial-expressions): sending info back to worker only on facial expression message

* fix: lint errors

* refactor(facial-expressions): bundle web worker using webpack

* fix: deploy-facial-expressions command in makefile

* chore: fix load test package-lock.json and package.json

* chore: sync package-lock.json

Co-authored-by: Mihai-Andrei Uscat <mihai.uscat@8x8.com>
2021-11-17 16:33:03 +02:00
Calin Chitu e42db3c9c2 feat(welcome) added WelcomePage React Nav bottom tabs 2021-11-17 15:42:06 +02:00
Andrei Gavrilescu 6f75226044
chore(deps): update rtcstats 9.0.1 (#10374) 2021-11-17 14:21:37 +02:00
Avram Tudor be6adad61b
chore(deps) lib-jitsi-meet@latest (#10368)
* fix(browser) Mark safari <14 as unsupported

51f77cbd51...b337778da8
2021-11-15 15:45:50 +02:00
Saúl Ibarra Corretgé 61025edb74 chore(deps) lib-jitsi-meet@latest
* fix(e2ee) disable p2p when e2ee is enabled
* fix(e2ee) fix race condition when restarting media sessions
* fix(p2p) fix error if p2p session is stopped while accepting it
* fix(e2ee) removed no longer needed code
* feat: SourceVideoTypeMessage message
* chore(lint) tame the new linter
* chore(deps) update Babel and ESLint to the latest versions
* chore(deps) adapt to logger package rename
* fix(e2ee): fix loading web worker when using a relative path inside a blob for the E2EE context
* * fix(sdp): provide SCTP streams, because the XMPP parser expects them

c193f0d433...51f77cbd51
2021-11-11 16:52:39 +01:00
Calinteodor 4e2fea1e12
feat(rn,welcome) React Navigation drawer 2021-11-11 15:32:56 +01:00
Saúl Ibarra Corretgé a96a4ea336 chore(deps) update rtcstats, change package name 2021-11-11 08:04:28 +01:00
Saúl Ibarra Corretgé 8f08a54fb2 chore(deps) adapt to logger package rename 2021-11-10 14:40:17 +01:00
Saúl Ibarra Corretgé 28c793b3a9 chore(deps) adapt to eslint-config-jitsi rename 2021-11-10 13:10:15 +01:00
Pavol Cvengros 2d27195652 chore(deps) update uuid package to 8.3.2
Co-authored-by: Saúl Ibarra Corretgé <saghul@jitsi.org>
2021-11-10 11:35:20 +01:00
Hristo Terezov e6e808c764 chore(deps) lib-jitsi-meet@latest
* feat(recording): Add unexpected-request error
* fix(xmpp): use RTX with Firefox from 96 on only
* fix(sdp): update data channel to RFC format
* sdp: switch port to 9 and rtp protocol to UDP/TLS/RTP/SAVPF (#1697)

03bc5278da...c193f0d433
2021-11-09 12:33:24 -06:00
Saúl Ibarra Corretgé ba7b5fc996 chore(deps) update eslint-config-jitsi to version 3.0.0 2021-11-09 11:05:09 +01:00
Saúl Ibarra Corretgé 0aba61d5c6 chore(Deps) update Babel and eslint to their latest versions 2021-11-09 09:43:55 +01:00
Robert Pintilii 4767ef497f
chore(deps) lib-jitsi-meet@latest (#10305) 2021-11-04 09:26:39 +02:00
Jaya Allamsetty c653334d69 chore(deps) lib-jitsi-meet@latest
* fix(presence) Send presence on mute state change.
* fix(TPC) change the tranceiver dir to recvonly when track is removed. This fixes occasional failures of MuteTest.MuteAfterJoinCanShareAndUnmute torture test and also the case on Safari where user stopping the screenshare doesn't stop showing the screensharing indication on the thumbnail.
* fix: Avoid sending two presences if start muted and then screen share. (#1771)
* feat: use source names in presence
* ref: move SignalingLayer to the conference
* feat: Delays deployment info stats till we get update from backend. (#1770)

e566291864...e6b330186f
2021-11-02 10:32:00 -04:00
Jaya Allamsetty 0dc061f633 chore(deps) lib-jitsi-meet@latest
* fix(TPC) add muted tracks to TPC but not to the RTCPeerConnection.

447f111cf2...e566291864
2021-10-27 11:27:55 -04:00
Дамян Минков be5c397422 chore(deps) lib-jitsi-meet@latest
* fix(av-moderation) Fix remove from whitelist to match prosody changes

111e50c38a...447f111cf2
2021-10-26 18:09:44 -07:00
Jaya Allamsetty 667a6eac80 chore(deps) lib-jitsi-meet@latest
* ref(JitsiConference) Remove remote tracks from conf before reneg is done. We do not have to wait for the removal of the ssrcs from the remote description for removing the remote tracks associated with a participant that left the call. This speeds up removal of the participant from call even if the JingleSession modification queue is backed up.
* faet(SDP): Add test for jingle JSON format.

42c675249a...111e50c38a
2021-10-25 15:58:05 -04:00
Hristo Terezov acaadb503f chore(deps) lib-jitsi-meet@latest
* fix(SS): missing.

7275ee1286...42c675249a
2021-10-20 19:50:42 -05:00
Saúl Ibarra Corretgé 6e55351e68 chore(deps) uppdate xmldom
The previous package has become unmaintained and it has a new home now.
2021-10-21 02:45:33 +02:00
Jaya Allamsetty 4f58b5fab9 chore(deps) lib-jitsi-meet@latest
* fix(layer-suspension) Do not ignore maxHeight=0 sender constraint. This fixes https://github.com/jitsi/lib-jitsi-meet/issues/1759.

012c38769d...7275ee1286
2021-10-20 16:56:41 -04:00
Calinteodor 9df59b4a6f
feat(conference) added React Navigation
Introduce navigation for all in-conference screens.
2021-10-20 21:29:21 +02:00
Jaya Allamsetty becbbdd139 chore(deps) lib-jitsi-meet@latest
* ref(JingleSessionPC) Do not renegotiate on every local source change. Instead rely on the 'negotiationneeded' event fired by the browser for JVB connection. This makes local source changes faster even if the modification queue is backed up.

75d3106544...012c38769d
2021-10-19 12:43:21 -04:00
Дамян Минков 04194ae8a1 fix: Fixes correct ljm version. 2021-10-15 13:09:19 -07:00
Дамян Минков ea26a48678
feat: Hides prejoin screen on conference in progress event. (#10175)
* feat: Hides prejoin screen on conference in progress event.

We enter the conference view as early as possible on conference in progress as the joined event can be late in a big conference.
Also, we show conference view only when joining is in progress, for example, the with the lobby enabled where we try to join but fail, we do not want to show the conference view for a fraction of a second before showing lobby screen.

* squash: Drops CONFERENCE_JOIN_IN_PROGRESS.

* squash: Updates ljm with the new JitsiConference event.

* squash: Adds some debugs to the github action.

Easier to catch problems with package-lock.json file.
2021-10-15 11:53:50 -07:00
Jaya Allamsetty 2b62cc8a74 chore(deps) lib-jitsi-meet@latest
* ref(TPC) Configure encodings in one go. (#1739)
* feat(CodecSelection) Disable VP9 on Safari. (#1752)

a5cc2321b8...d27a510f84
2021-10-15 11:11:00 -04:00
Saúl Ibarra Corretgé c84e2e6ad8
feat(build) update build toolchain to Node 14 / npm 7 (#10145)
* feat(build) update build toolchain to Node 14 / npm 7

* squash: Updates ljm.

Co-authored-by: Дамян Минков <damencho@jitsi.org>
2021-10-11 09:15:42 -07:00
Saúl Ibarra Corretgé 873ccf24ec chore(deps) lib-jitsi-meet@latest
Bring in Webpack 5 support.
2021-10-07 20:22:44 +02:00
Saúl Ibarra Corretgé a313f5cde2 feat(build) migrate to Webpack 5 2021-10-07 20:22:44 +02:00
Saúl Ibarra Corretgé 720d19ba95 chore(deps) update js-utils
In preparation for Webpack 5.
2021-10-07 20:22:44 +02:00
Saúl Ibarra Corretgé 0af14b0f05 chore(deps) update eslint-config-jitsi
Flow rules are now separate from the default ones.
2021-10-07 20:22:44 +02:00
Дамян Минков b55526702e chore(deps) lib-jitsi-meet@latest
* feat(identity): add region identity parsing
* fix(IceFailedHandling) force client reload when ICE fails locally.
* fix(iOS15) fix not being able to unmute if "everyone starts muted" is set
* fix: logger calling wrong function typo
* feat: generates source names (#1725)

b5288c2989...febd9087b9
2021-10-07 13:07:25 -04:00
robertpin 001ae54a7c feat(screenshot-capture) Updated screensharing screenshot capture
Changed screen capture to non effect. Effects are used to alter the stream, this feature does not need to alter the stream, it just needs access to it

Changed image diff library. Previous library diff’ed the whole image, the new one has en early return threshold

Use ImageCaptureAPI to take the screenshot. Added polyfill for it and polyfill for createImageBitmap

Added analytics
2021-10-05 10:25:27 +02:00
Дамян Минков acfc9c6683 chore(deps) lib-jitsi-meet@latest
* fix: Avoids sending empty nick in presence.

afc1c34e75...b5288c2989
2021-10-01 11:07:30 -05:00
Saúl Ibarra Corretgé 4369579d2b chore(deps): update react-native-webrtc@1.92.2
Fixes a crash on Android
2021-10-01 16:05:10 +02:00
Saúl Ibarra Corretgé eb494f6b8c chore(deps) lib-jitsi-meet@latest
* fix(JitsiConference) make sure isE2EEEnabled() returns a boolean
* fix(loggging) fix exceptions on mobile

7a56f7b341...afc1c34e75
2021-10-01 15:45:20 +02:00
Дамян Минков 6a223763a3 chore(deps) lib-jitsi-meet@latest
* fix(xmpp): disable RTX for Firefox < 93, because it results in random SSRC order
* fix(Jingle): stop reverting the SSRCs from Firefox

c15dda1537...7a56f7b341
2021-09-30 18:24:35 -05:00
Hristo Terezov 9e5a9599ca chore(deps) lib-jitsi-meet@latest
* fix(browser-support) fix detecting iOS browsers correctly
* fix(JitsiConference):2 instances for the same room
* ref: sendMuteStatus is not async

ae70962bfa...c15dda1537
2021-09-30 10:58:23 -05:00
Jaya Allamsetty 28904e18f8 chore(deps) lib-jitsi-meet@latest
* fix(Jingle) Log the extracted info from Jingle IQ.
* ref(Jingle) Alpha sort and prefix the local functions with '_'
* ref(Jingle) Log formatted source information. Instead of logging the full IQs for Jingle messages like session-initiate, source-add and source-remove which can be very long, log just the formatted source information.
* ref(RTC) rename iceConfig to pcConfig. It makes more sense to call it pcConfig since it is the RTCConfiguration object passed to the WebRTC peerconnection.
* fix(logging) Log only the imp events on remote tracks. Log only the important events that we care about on the HTMLMediaElement that the remote tracks are attached to.

0646bc3403...ae70962bfa
2021-09-29 13:12:07 -04:00
Saúl Ibarra Corretgé 7546db53e4 feat(lang) add helper script for manual translations
It updates the main language file for a given locale from the canonical one and
sets the empty string on the missing keys. No longer used keys are discarded.
2021-09-29 13:08:59 +02:00
Andrei Gavrilescu 7b0dccdad1
feat(rtcstats): remove SDP transmission #10054 2021-09-29 13:20:01 +03:00
robertpin ace53c880b
feat(av-moderation) Ask to Unmute and remove from Whitelist (#10043)
* feat(av-moderation) Ask to Unmute and remove from Whitelist

Make Ask to Unmute work without moderation
Add remove from moderation whitelist functionality

* chore(deps) lib-jitsi-meet@latest

* feat(av-moderation) Remove from moderation whitelist functionality (#1729)
* fix(chore) corrected typo in log message
* fix(e2ee) replace nullish coalescing with or
* fix(e2ee) restore initial key when RATCHET_WINDOW_SIZE reached

3b8baa9d3b...0646bc3403

Co-authored-by: Дамян Минков <damencho@jitsi.org>
2021-09-28 11:11:13 -05:00
Дамян Минков 4cd5be9d8b chore(deps) lib-jitsi-meet@latest
* fix(JitsiConference) Check for room before calling isFocus method on the room object.
* fix(Jingle) Reverse the order of ssrcs signaled for Firefox. This fixes an issue where the bridge doesn't forward the HD stream from Firefox to other users in the call. The order of the ssrcs produced by the browser is from Highest resolution to lowest whereas the bridge assumes it to be from lowest to highest as is the case in Chrome and Safari.
* fix(codec-selection): Impose VP9 bitrates only when VP9 is the negotiated codec. If Jicofo doesn't offer VP9 but the client expresses a preference for VP9, VP9 bitrates were being imposed before.

609e3d5a1a...3b8baa9d3b
2021-09-20 17:35:08 -05:00