This repository has been archived by the owner on Sep 11, 2024. It is now read-only.
-
-
Notifications
You must be signed in to change notification settings - Fork 828
Merge end-to-end tests #3537
Merged
Merged
Merge end-to-end tests #3537
Changes from 1 commit
Commits
Show all changes
298 commits
Select commit
Hold shift + click to select a range
edf37e3
add support for passing chrome path as env var
bwindels c3b7e6c
make scripts executable, running them with sh does something weird on…
bwindels e8f626b
exit on error
bwindels 976f041
remove test exit, and use port we are semi-sure is free
bwindels 5cd52e2
show browser logs on error
bwindels 758da78
dont fail when trying to stop riot and its not running
bwindels 29d6885
stop servers on error in run script
bwindels 5129bb5
log all requests with their response code
bwindels 31fcf08
only allow one riot server instance simultaneously
bwindels e50420d
apply config file when starting riot, not installing, so we can suppo…
bwindels a5c8911
output document html on error and dont make a screenshot on submit
bwindels d738b40
try upgrading puppeteer
bwindels c357a01
no need to log contents of zip files
bwindels 9a2f309
xhr and console logs are done for all tests now, no need to do it in …
bwindels 3876577
log when using external chrome!
bwindels f57628e
dont swallow riot server errors
bwindels 97fa7e0
dont swallow synapse startup errors
bwindels 1b01867
Merge pull request #3 from matrix-org/bwindels/ci_script
dbkr 7c91eca
create session object to scope a user, move helper methods there
bwindels 6b843ea
move log buffers into session, start logging implicitely
bwindels 4c0ab11
move outputting steps to session to scope it to username
bwindels 5fe3861
create second user and join room first user creates
bwindels 4e7df21
move step logging to tests, DRY; put test scenario in separate file, …
bwindels aaa5ee1
more consistent naming on session methods
bwindels 2a7438e
no need to double select here, might speed things up slightly
bwindels 643af2d
run synapse on custom port so it doesn't interfere with other synapse…
bwindels a78c095
add support for changing the room settings
bwindels 1fd379b
wait to receive message from other user
bwindels c5f064e
make receiving a bit more robust
bwindels 73c88fe
prepare for more tests
bwindels dc87e2b
avoid typos
bwindels af0c0c0
add test scenario for e2e encryption
bwindels 2c983f8
fix composer issue and more
bwindels 4c3386a
Merge pull request #4 from matrix-org/bwindels/2usersjoin
bwindels a54f13c
Merge pull request #6 from matrix-org/bwindels/e2erooms
bwindels 377a20f
bring indentation in line with other front-end projects
bwindels 9566882
Merge pull request #8 from matrix-org/bwindels/indentation
dbkr 8507cf8
add argument for passing riot server, makes local testing easier
bwindels 0e56250
didnt mean to commit this
bwindels 4f76ad8
increase timeout
bwindels 26e4645
Merge pull request #10 from matrix-org/bwindels/increasetimeout
bwindels 440b103
increase receive message timeout
bwindels c49f1b3
Merge pull request #11 from matrix-org/bwindels/increasetimeout2
bwindels 1e0baa8
Merge pull request #9 from matrix-org/bwindels/commander
dbkr fd67ace
increase timeouts so the tests dont timeout on build server
bwindels f49b858
remove specific timeout for selectors
bwindels 6be5975
dont assume new target is a new page
bwindels a65d6af
encryption dialogs dont always appear coming back from settings... weird
bwindels 2321e43
commander inverts the meaning of program args by itself ... nice, I g…
bwindels 3e8b55b
Merge pull request #12 from matrix-org/bwindels/fixbuild
dbkr 98aafd6
add rest/non-browser session, which we can create a lot more off
bwindels afc678f
pass rest session creator to scenario
bwindels 3c5e73d
support setting the display name on rest session
bwindels 48d95c2
creator instead of factory, as it does registration and authentication
bwindels 827e636
add wrapper around multiple rest sessions
bwindels 4057710
Merge branch 'master' into bwindels/lltests
bwindels 4a4b1f6
wait for the message to be sent
bwindels be4c1cb
support setting the room alias
bwindels 2be413b
allow clients to send messages faster, in order to speed up the test
bwindels ff20bc7
support joining with a room alias for rest session
bwindels abc7c4c
join use cases that touch settings in one file, as selectors are similar
bwindels 3db32c9
past rest creator to scenario to also be able to call createSessionRange
bwindels dcf96e1
WIP for LL test
bwindels 244d5b0
dont show all 20 send messages
bwindels 249cf4f
implement reading and scrolling timeline, group timeline related code
bwindels 4057ec8
store displayName on RestSession to use it in tests
bwindels 29aec25
finish basic LL test to see if display names appear from lazy loaded …
bwindels 7bcb255
increase timeout here in case this wouldnt be enough for the CI server
bwindels e843d53
these changes were not needed in the end
bwindels c8fec94
structure flags better and document them
bwindels 5745e9e
move Logger and LogBuffer to own module
bwindels 923ae90
move range and delay over to util module
bwindels 5ec8f6f
rename tests folder to the more accurate usecases
bwindels 1725e75
split up scenarios in multiple files as lazy-loading scenarios grow
bwindels 5d06c65
split up ll tests in several functions
bwindels 239e6a4
add ll tests to check if all expected members are in memberlist
bwindels 9f4cf77
make receiveMessage more robust by checking first if the message is n…
bwindels af255c6
dont assert the first time in receiveMessage, as it will show an ugly…
bwindels 6deb595
add logging to rest session actions
bwindels 16b2f09
Test if members joining while user is offline are received after retu…
bwindels 58d52f9
Merge pull request #17 from matrix-org/bwindels/flagsandreadme
dbkr 36708cc
wait for next sync before inspecting memberlist
bwindels 992a0be
DRY usernames
bwindels 8cff961
use develop for now as LL with gappy syncs is fixed on that branch fo…
bwindels 5e8a3db
Merge pull request #16 from matrix-org/bwindels/lltests
bwindels 320e39b
Merge pull request #19 from matrix-org/bwindels/lltests2
bwindels 1906661
Merge branch 'master' into bwindels/lltests3
bwindels f26c50c
Merge pull request #22 from matrix-org/bwindels/lltests3
bwindels 42c1b95
spit out logs for creating REST users to figure out what is going on …
bwindels 3de9f6e
Merge pull request #23 from matrix-org/bwindels/restlogs
bwindels 0d86b82
increase timeout for server notices room
bwindels d1d8865
Merge pull request #24 from matrix-org/bwindels/increaseservernoticet…
bwindels a84162e
use patched synapse so admin rest api works with python 2.7.6
bwindels 1c85536
Merge pull request #25 from matrix-org/bwindels/fixadminapiusage
bwindels cf397ef
disable LL tests on travis CI
bwindels d47f782
Revert "increase timeout for server notices room"
bwindels 6e97215
Merge pull request #27 from matrix-org/revert-24-bwindels/increaseser…
bwindels 70eb480
Revert "use patched synapse so admin rest api works with python 2.7.6"
bwindels fec1447
Merge pull request #28 from matrix-org/revert-25-bwindels/fixadminapi…
bwindels 13b20bb
pass parameters through instead of hardcoding --travis
bwindels 64608af
Merge pull request #26 from matrix-org/bwindels/disablelltests
bwindels a637ad8
set a room alias for a public room, as required now
bwindels 4aad156
Merge pull request #29 from matrix-org/bwindels/fixroomaliasrequirements
dbkr 8ee7623
current tests need riot develop to set a room alias without a domain …
bwindels 04b64db
Some changes to make the testing script run on mac, too, + a multithr…
lampholder 861af62
Make the sed usage cross-platform compatible
lampholder 1147508
list of tests we want to write
bwindels a1cd2ae
Merge pull request #31 from matrix-org/bwindels/lltestsonlyrunondevelop
dbkr b2bd134
add config file instructions to run with --riot-url
bwindels 1a22546
test leaving members disappear from memberlist
bwindels f607cb2
Fix the registration process to handle m.login.terms auth
turt2live d57a56d
There is no more server notices invite on signup
turt2live daa9624
Merge pull request #39 from matrix-org/travis/fix-consent
bwindels 1a0f095
Tell synapse to require consent at registration
turt2live 2559786
Merge pull request #41 from matrix-org/travis/fix-consent-register
bwindels 2e839d5
Click the 'Accept' button as part of the signup process
turt2live 259d4d6
Merge pull request #42 from matrix-org/travis/fix-consent-signup
turt2live 19c4f4a
Install jinja2
turt2live 8f55455
Merge pull request #43 from matrix-org/travis/fix-build
turt2live 7ac19b0
adjust synapse install script for python3 and config file changes
bwindels 3056d93
use yarn and update dependencies, commit lock file
bwindels ab5a245
fix signup
bwindels 65ca1b3
fix creating a room
bwindels a27b92a
fix changing the room settings
bwindels fe6a273
fix joining a room through the room directory
bwindels 5598214
fix writing in composer
bwindels a150597
missed this when making createRoom export non-default earlier
bwindels 2bf51da
fix enabling e2e encryption in room settings
bwindels ae5dc9d
fix inviting someone
bwindels 9ab1692
fix verification, replace device id/key with SAS verification.
bwindels 28bba49
fix detecting e2e message in timeline
bwindels 34171ea
doing wait for /sync request to receive message, doesn't work well
bwindels c1312f0
fix import
bwindels f197e9f
lazy loading is not in labs anymore
bwindels 450430d
remove travis flag
bwindels 2449ddc
"disable" rate limiting for rest users
bwindels d63a0c5
fix gete2e info and open settings, even though not used currently
bwindels e147cc9
this dialog isn't shown anymore and this was accepting the SAS dialog
bwindels e10e4b0
nicer output, comment
bwindels 2b2a486
forgot to add consent listener again, this will fix REST registration
bwindels 5939d62
fix scrollpanel selector
bwindels 3affb8f
section for creating rest users
bwindels 240c715
Merge pull request #36 from matrix-org/bwindels/checkleavesmemberlist
bwindels ed772e2
Merge branch 'master' into bwindels/redesignfixes
bwindels 9c41ccc
use shorter .bak suffix approach
bwindels c1464aa
Merge branch 'master' into toml/install-scripts-fail-fast
bwindels 6852851
Merge pull request #32 from matrix-org/toml/install-scripts-fail-fast
bwindels 2228ba8
Merge branch 'master' into bwindels/redesignfixes
bwindels 5d4ded0
use yarn
bwindels 146549a
keep complexhttpserver installation within riot folder and gitignore …
bwindels d93e6ed
use python3 to install riot webserver
bwindels 04e06c3
PR feedback
bwindels 58e6d1b
Merge pull request #46 from matrix-org/bwindels/redesignfixes
bwindels cfff4a9
install ComplexHttpServer regardless of whether riot is already insta…
bwindels 4e1ddf8
c/p error
bwindels 53eab47
pass --no-sandbox to puppeteer
bwindels 7e2d35f
moar sandbox flags
bwindels 492d810
support writing logs to file
bwindels bdd7191
Merge pull request #47 from matrix-org/bwindels/logstofile
bwindels d1df0d9
avoid ipv6, see if that makes buildkite happy
bwindels 4591b26
show all of create rest user command output on failure
bwindels b88dc0f
show browser version when running tests
bwindels 4c79e3b
better error handling when creating rest user fails
bwindels 7fbfe31
dont assume bash when creating rest users
bwindels 200f95b
rest users dont need to be admin
bwindels d978ce6
test upload artefacts on failure
bwindels 6958fdb
write html, console and network logs to different files
bwindels f55a448
add screenshots to logs directory upon failure
bwindels b0fb36d
remove debug error
bwindels be32414
fix broken selector
bwindels b01e126
wait longer to arrive at #home but poll every 100ms
bwindels f489f55
increase dialog timeout a bit
bwindels 945daf2
log messages in timeline when expected not found (debug code)
bwindels 9610e9b
take into account continuation tiles in when checking timeline messages
bwindels 20c3023
use session.poll as well for polling when receiving a message
bwindels ee46c2b
wait for opponent label to appear in sas dialog
bwindels ef59c59
poll these as well as ci is slowwww
bwindels c40f7f6
add flag to throttle cpu to get failures because of slow ci locally
bwindels 48c1d46
remove explicit timeouts from tests for selectors
bwindels eae830a
update readme
bwindels ee1e585
remove explicit timeout for polling as well
bwindels bf02966
Update TODO.md
bwindels 20d80e6
adjust selectors for join and accept button in room preview bar
bwindels 370741f
Merge pull request #48 from matrix-org/bwindels/stylepreviewbar
bwindels 2527995
Only install the minimum deps to pass
jryans 1ffe0d1
Report location of Synpase log
jryans f82f9ec
Use a stronger password
jryans 3e6719e
Wait for password validation
jryans 7a15acf
install synapse/develop (and deps) from pip
bwindels 894a074
generate signing keys without generating config file and then overwr. it
bwindels 26f9dd0
Merge pull request #50 from matrix-org/bwindels/fixsynapseinstallation
dbkr d9def18
adjust path to register script for pip installation
bwindels c76dc87
Merge pull request #51 from matrix-org/bwindels/fixsynapseinstallation2
dbkr a729345
look for activate in cwd
bwindels 6b6de05
Merge pull request #52 from matrix-org/bwindels/fixsynapseinstallation3
dbkr 8a247e0
Bump lodash from 4.17.11 to 4.17.15
dependabot[bot] 6414ac9
Merge pull request #54 from matrix-org/dependabot/npm_and_yarn/lodash…
turt2live 7635e93
Adjust tests for hidden IS field
jryans a3abde5
Merge pull request #55 from matrix-org/jryans/hide-is-field-during-auth
jryans 67b03b5
Fix signup: set custom hs through advanced section, and accept IS step
bwindels f66f5be
Adjust how room directory and create room dialog should be opened
bwindels b8b2ef2
Merge pull request #56 from matrix-org/bwindels/fix-signup
bwindels 1659171
Revert "Fix signup: set custom hs through advanced section, and accep…
bwindels ad10148
Merge pull request #58 from matrix-org/revert-56-bwindels/fix-signup
bwindels e3f7246
Merge pull request #57 from matrix-org/bwindels/fix-open-directory
bwindels f2a3a13
find new join button in room directory
bwindels 7be47b2
Merge pull request #59 from matrix-org/bwindels/fix-roomdirectory-join
bwindels a25056f
retry getting the scroll panel when retrying to get the scrolltop
bwindels 87be5fb
try to fix selecting all text in Field components
bwindels c36673b
Revert "Revert "Fix signup: set custom hs through advanced section, a…
bwindels 04f7514
Merge pull request #60 from matrix-org/bwindels/somefixes
bwindels 5f03854
Merge pull request #61 from matrix-org/revert-58-revert-56-bwindels/f…
bwindels 1ea5047
only need 2 clicks, not 3
bwindels 912a974
Merge pull request #62 from matrix-org/bwindels/morecustomhsregisterfix
bwindels 06af5b3
look for a change (HS) link in the registration but don't fail if its…
bwindels 9694dcd
Merge pull request #63 from matrix-org/bwindels/optionalchangelink
bwindels 03d928b
adjust create room dialog name field selector
bwindels 7d1cb43
Merge pull request #64 from matrix-org/bwindels/createroomadjustments
bwindels fe1b786
unbreak tests; we no longer prompt for IS at register
ara4n f5b605b
unbreak tests (take 2); we no longer prompt for IS at register
ara4n 5b71cf5
use correct css class for cider composer
bwindels 6cb9ef7
remove editorconfig
bwindels ca86969
move everything to subfolder to merge into react-sdk
bwindels ae38e0b
Merge remote-tracking branch 'e2etests/bwindels/bigmerge' into bwinde…
bwindels cad7191
only run riot static server if no riot url has been provided
bwindels 5b9bfae
first attempt at running local e2e tests from CI
bwindels de21cb2
Merge remote-tracking branch 'e2etests/bwindels/use-cider' into bwind…
bwindels 59cc36c
don't fetch riot/master by default when installing e2e tests
bwindels f8358fa
make e2e test safe to run from anywhere
bwindels ebc2bba
warn if not installed yet when running e2e tests
bwindels 3e971e4
provide yarn command to run e2e tests
bwindels 2d848bb
fix lint
bwindels 645a9d8
install static webserver for server symlinked riot on CI
bwindels 6f96049
copyright
bwindels 867739e
switch e2e tests to xlarge queue
bwindels 4b9a29c
put exec perms back on install script
bwindels 15bbf3a
fix the lint fix
bwindels d20b2ee
document how to run the e2e tests locally
bwindels 683947e
Update test/end-to-end-tests/README.md
bwindels 6236909
Update test/end-to-end-tests/README.md
bwindels 8a02802
Update test/end-to-end-tests/install.sh
bwindels 5025a0f
Update test/end-to-end-tests/README.md
bwindels 06e69d1
Update test/end-to-end-tests/README.md
bwindels 142a32b
Update test/end-to-end-tests/README.md
bwindels 76c7f58
Update test/end-to-end-tests/README.md
bwindels 15a7573
Update test/end-to-end-tests/README.md
bwindels e2e7303
Update README.md
bwindels 3d15026
Update test/end-to-end-tests/run.sh
bwindels dca9683
Update test/end-to-end-tests/run.sh
bwindels b03ebb9
split up installing static webserver and riot copy
bwindels File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It's a bit perplexing to have a "Riot" install script which also takes an option "no Riot"... Maybe it would be easier to follow by moving the HTTP server bit to it's own script?
Then this script can call the new script (so caller of this don't need to change), and
end-to-end-tests.shwould only call the HTTP server script.