Jmeter token authentication

string token =. Jan 17, 2023 · Configuring the JMeter test plan . Aug 4, 2021 · Steps to do load testing using JMeter on endpoints that required client authentication based on a security certificate. Set JMeter as a proxy and record your log-in flow ( Click here for a video tutorial ). Now look at JMeter. -- The POST request that posts the login credentials. _applicationAuthenticator = new. Provide Base URL and credentials (plain text) That's it, you don't need to add Authorization header manually, JMeter will automatically generate it, check out How to Use HTTP Basic Authentication in JMeter article for more details if required. Nov 9, 2023 · OpenSSL. Performance testing scripts need to go through authentication in order to access target services with the right authorization. To authenticate with JMeter, we will need 3 different keys. But when I run the script I receive an error: Listener Apr 6, 2016 · You pass said authentication token with each following request. Sep 27, 2020 · Here we can see that we already got the access_token from Connect_Token request and Create_User request failed because we didn’t add the access_token authentication yet in Create_User request. User credentials can be supplied via HTTP Authorization Manager so you won't have to encode them into Base64 yourself Sep 19, 2023 · Overview. But the login is failing due to authentication! enter image description here. If you have limited number of logins/users option 1 may be better. JMeter is a load generator Jul 17, 2018 · The second thread group is to load a particular page which requires authentication. First I get a auth token via a call to our authorization endpoint. 0. It is and it's quite enough to add a HTTP Cookie Manager to your Test Plan. 0 = OpenID Connect. 6. Add Regular Expressions Extractor to your auth request to Extract auth token to variable and send its value to the next request (where you get error) with Jan 28, 2019 · Add (or parametrize) parameter Authorization in your HTTP Header Manager. The Authorization Manager lets you specify one or more user logins to Web pages that are restricted using server authentication. Sometimes the login form contains additional hidden fields. once its done, JMeter is able to handle 3 internal redirect calls for CombinedSigninAndSignup and moving to next page. For this, right click Test Plan and add Config Element → Http Header Manager and add “Content-Type” setting the value to “application/json”. The endpoint can be found by visiting Azure Portal and navigating to Azure Active Directory > App registrations > <YOUR-APPLICATION> > Endpoints . The process of extracting a variable from a response works as mentioned below: First, the server sends back a response, then a post-processor, like the JSON Extractor is executed which extracts part of the response and put it into a variable like See full list on baeldung. JMeter Custom Authentication. Jun 29, 2023 · Then cross-check the requests which JMeter is making with the ones from the "Network" tab of your browser developer tools. Set implementation to httpClient3. com May 15, 2024 · JMeter requires the following steps: 1. Same as it was with the ‘COOKIE_’ prefix. Apr 30, 2018 · 0. In some cases you might need to add a cookie manually, you can do this using the aforementioned HTTP Cookie Manager as well. \s+ matches optional whitespace character. If JMeter can't do it, is there a tool that can? Jul 20, 2017 · Use JSON Extractor (it is available since JMeter 3. There is no single place where you can put these parameters in JMeter because OAuth 2. The user is then able to access the application. Use tokens to make calls to your backend. Nov 12, 2016 · How to Automate Auth Token using JMETER Sep 23, 2015 · I tried the following : In the HTTP Header Manager, add an entry with the name "Authorization" and the value "Basic [encoded credentials from above]" as suggested in JMeter Basic Authentication. Then, add Bearer token to Value field. from previous responses using suitable JMeter Post-Processors and replace recorded values with the JMeter Variables from the Post-Processors. "} Dec 6, 2018 · Going forward be aware that you should be normally able to record the Postman request using JMeter's HTTP(S) Test Script Recorder. The JMeter test plan needs to be configured to make a request to the app’s authentication endpoint to acquire the token. ROPC allows you to sign in as a user instead of automating the interactive sign-in prompt UI. Dec 5, 2023 · The solution to this issue is to add a http header manager. Why there are two different token values for two different path (‘/web’ and ‘/Web/Account/Login’) Mar 12, 2021 · Hi, I am doing performance testing with JMeter for a cloud based application with Azure AD. Get and set access token through Feb 10, 2023 · #JMeter #Tutorial_11 #Generate #Create #API #bearer #token using JMeter by TechGranthaJMeter Beginner Tutorial -https://www. We need to handle this dynamic parameter to properly simulate a user interacting with our Json API. JMeter Custom Feb 10, 2019 · Usually Authentication request returns this value. 0 is a series of requests/responses so you need to implement all these requests which Postman makes under the hood with JMeter's HTTP Request samplers and perform the correlation of the dynamic parameters. Feb 18, 2022 · Don't use scripting when something can be achieved using built-in JMeter Test Elements (or JMeter Plugins) I would recommend: Moving your "login" sampler under setUp Thread Group so it would be executed before the main thread group and only by 1 user. myproject. Select the value say Search 'By name' (By name is an API No. The url of Nov 23, 2021 · 1. I am trying to extract the authentication token with regular expression extractor: Regular Expression extractor. Feb 19, 2020 · OAuth 2. The variable VAR has the value of the XSRF-TOKEN cookie. Also I would recommend switching to JMeter 3. cookies=false" (as suggested in this thread) in user. Token认证. I see it at Response Header: View Results Tree. 0 should authenticate users. Automated OAuth login process by means of JMeter OAuth sampler. Also, auth0 will apply a ban by ip address 1. I've followed some setup guide on different sites but still JMeter failed to authenticate. Feb 7, 2020 · Phase 2. com along with the username and password. Context. Oct 16, 2019 · 0. As part of the flow through the site, I use our API in order to update the user's application. You need to obtain so called token and add it to your request as Authorization header using HTTP Header Manager like: With regards to how to obtain the token - it depends on your application configuration, if you're lucky enough and the token is more or less permanent - you can obtain it using Google Developer Console. In this example ,we have used Azure AD end point to generate the token. More information: Load Testing Your Email Server: How to Send and Receive E-mails with Feb 18, 2019 · 0. Steps to generate authorization token: Generate and keep the [certificate_file_name]. Right now I am stuck with the automation of the login process. Dec 27, 2016 · In this post, we will go over implementing JMeter scripts for load testing web services that use SAML tokens for client authentication and security. In case that token is returned in the header or as a response, you would need to extract it, save it as variable and then pass to each following request (of course you need to find out what is the name of the parameter or Feb 17, 2020 · Hi Team, I am able to automate B2C flow in my current project and able to do a load testing with JMeter. Nov 30, 2021 · Token-based authentication for web APIs is the process of authenticating users or processes for applications in the cloud. These are the relevant requests I have in the script: Apr 15, 2021 · Set the prefix in jmeter. I have a rather unique situation in jmeter where I need to do load-testing on our authentication federation. If it's not possible - ask whether it's possible to switch it to something you can handle easily like OATH Software token. mydomain. So, I have used below. This will show a list of app registrations, select the one you just created. I am doing performance testing with JMeter for our application which requires AD Microsoft Authentication. （垮域访问：两个域名之间不能跨过域名来发送请求或者请求数据）. They also need to validate that the authentication servers are able to handle the target load. Demo: More information: JMeter: Regular Expressions. OAuth 2. If it's server authentication, then follow the link below. In other words, [GET] is taking the auth token from the first thread group and I would like to run them in parallel and only change the token once at 2. If the time + {delay time for next request} < current time = > time =current time and make request for the auth token. Then I enter a variable into the Header Manager Header Manager. Mar 13, 2020 · Generate authentication token for each request in jmeter. 5 min. Oct 19, 2023 · Update the JMeter sampler component to pass the secret in the request. S. Currently, we are facing a problem with Azure authentication in JMeter which we are seeking support. Results will be displayed. If we run the script like this, you can see below that our required token is in the Apr 24, 2018 · Basic Access Authentication is one of the most simple authentication method: Server grants access whenever the provided username and password are correct. The load tests projects is something we did to try an isolated cluster, we did exactly what you described here, but this require a type of connection (identity provider) called Mock that is not available in the API/UI. So, you need to extract this token from the answer. It allows third party services to use the end-user information without revealing their personal credentials. Even if I access the application successfully still the status code will be the same. 3. answered Jan 29, 2019 at 20:49. Jan 27, 2020 · If you really need to use the regular expression extractor you need to amend your regular expression to look like: "access_token":\s+"(\w+)" where: (\w+) matches any number of aplhanumeric characters. prefix=BLAZE_). I have no trouble with the OKTA part, but cannot get Jmeter to authenticate against the SSO server. parameters. I work for Auth0. I need to run this test in Azure Load Test and have created a Key Vault in Azure with the credentials but unable to get my test to read the secrets. MSAL library from the JSR223 Test Elements using Groovy language in order to get the access token. I am passing the same token to through HTTP Header Manager for other thread groups too. 0), the relevant JSON Path query would be as simple as $. Start HTTP(S) Test Script Recorder. 0 authentication method used for server-to-server communication. If present in the ID Token, Clients MUST verify that the nonce Claim Value is equal to the value of the nonce parameter sent in the Authentication Request. Once you have set up ROPC, you can use the Microsoft Authentication Library (MSAL) to acquire tokens and Bạn thường phải đối mặt với ứng dụng web yêu cầu người dùng xác thực (AUTHENTICATION). I'm trying to proceed as follows: POST authentication request; Store token as a variable; Set Authorization HTTP header to stored variable; Request protected resource(s) Evaluate performance Dec 17, 2021 · If for some reason it's not possible - ask around if it's possible to turn off Azure authentication. May 17, 2023 · I am trying to develop a JMeter script for performance testing an application with Azure (Oauth2) authentication. The JMeter test works fine when the Username and Password are read from Excel or hard coded. Exchange the authentication code for an access token: Client request to the Token endpoint to exchanges credentials for access token. reads it from previous response and adds to the next request so you shouldn't require anything else. . In addition to SoapHeader authentication, this method is also protected with basic authentication. Click the Add button twice and enter the username and password details. youtube. Is there any way to do this at all, or am I out of luck? Google was no help. Sep 9, 2019 · You should see JWT token printed to jmeter. Optional HTTP basic authentication in JMeter. log file: More information: Generate authentication token for each request in jmeter. Configure Postman to use JMeter as the proxy Jul 15, 2023 · I have a JMeter test that uses Azure AD authentication using username/password. If it's not possible - ask whether it's possible to turn off the 2nd factor. Get and set access token through Jmeter. Token Based Authentication is a simple mechanism where a token uniquely identifies a user session. If it's parameters through the HTTP request, the authentication manager won't work for you. Nov 18, 2013 · So basically you need to do one of the following: Manual 3-stepped OAuth login and capture token process followed by adding token as a parameter of HTTP Requests for each virtual user. but, before it took 3 weeks efforts to do manual flows in Browser to capture right csrf_token token and pass it to CombinedSigninAndSignup API. pem files in same folder. My app is getting authentication token from the server. And with this request, Access token is generated. While clicking on sign in with credentials, authentication process is happening which is generating a token id. The other controller's purpose is making the thread "sleep" for 30 seconds. 0 on-behalf-of flow. Check this guide about How to parse auth token. Token Apr 14, 2021 · Ok. This is a form of security enhancement to protect the application from CSRF attacks. But for the application related API (By name), I am May 10, 2019 · Jmeter Authentication token. When I record using JMeter, this appears to be done using 4 variables via a redirect (code, id_token, state, session_state). Click on the App Registrations link on the left, under “Manage”. How to store a generated bearer token to a variable. To evaluate the efficiency and scalability of these secured APIs Jan 17, 2020 · Two if controllers checking basically the current time with the jmeter function ${__time(/1000,)}. It sounds like the application you are testing with JMeter uses token authentication. At the next call I get the default value instead of extracted authentication token. 5 minutes and meanwhile to run [GET] thread group non stop. Add("AuthToken", $"Bearer {token}"); This is the code that generates the {token} in May 4, 2017 · Add HTTP Authorization Manager to your test plan. Jan 23, 2018 · General recommendation is: Record your test plan 2 times. Storing the token into a JMeter Property via __setProperty() function May 16, 2016 · 1. properties, then using "${COOKIE_AUTH_TOKEN}" in the post body. e. ] Set the path to the target of the submit button. Let's get started! Aug 26, 2020 · Extracting Auth Token. You can also use BlazeMeter's Proxy recorder. Authentication depends on how your web app is expecting credentials. You’ll need to add an extractor in the corresponding sampler. Nov 13, 2017 · In this article we will describe how to load test one of the relatively new technologies - OpenID Connect, with Apache JMeter™. The user’s application sends a request to the authentication service, which confirms the user’s identity and issues a token. According to the above guide you need to provide not only username and password, but domain and realm as well. Now face a problem with Azure authentication in JMeter. As Azure authentication generate token and session dynamically for login and when every time we login into Aug 22, 2015 · Jmeter Authentication token. Further, I have also used CSV file config for passing dynamic values. cookies=true" (as suggested by the user manual) and "CookieManager. The method ‘Authentication’ returns an access token if the header of a request contains a valid username and password. Configure JMeter to extract dynamic values from the response and substitute the request parameters which are different. But i receive a response like {"detail":"Invalid token. The universal way would be using i. This guide will teach you 3 different ways to handle basic authentication: Or using the base64Encode function from Custom Functions Plugin. For example, to provide an OAuth2 access token, you configure the Authorization HTTP header by adding an HTTP Header Manager: Authenticate with client certificates. properties file to ‘BLAZE_’(CookieManager. 1 Using Json Extractor. Run the script and see the results. Again same parameters are passed. Question : Am I following the right method. Set the headers for authorization api. The response of the first request is Response. How do I differentiate if Jmeter is successfully opening the link I passed or is stuck at the login page to which it is redirected to. record your scenario using jmeter recording template. Configure JMeter for recording using JMeter Templates feature . The method ‘HelloUser’ returns the string ‘Hello ${username}’ if the header of a request contains an active token. 1) Navigate to Customer search page. You can get the email sent to Gmail account via JMeter's Mail Reader Sampler, the setup would be something like: Once done you can fetch the OTP from the email body using a suitable Post-Processor like Regular Expression Extractor or Boundary Extractor. I am unable to fetch those parameter (nonce, state, client Oct 10, 2018 · What Dmitri means is this: (1) start WireShark and set a capture filter with the name/port of your server. Apr 27, 2018 · 4. Getting the Authentication endpoint Mar 28, 2022 · It's a matter of correlation, you need to extract all these dynamic parameters like SAMLRequest, authenticity_token, etc. e. Also make sure that KERBEROS mechanism is selected. The instructions will differ depending on your application authentication flow and covering all of them with examples in a single answer. We can explain it with the following expression: Authentication (OpenID) + OAuth 2. (3) stop WireShark. In my case I should provide one more key/value: Cookie. I am new to JMeter. It appears that the authentication scheme is SPNEGO with KERBEROS, which should be supported by the HttpClient. Issues: In the first thread group I have used JSON extractor and extracted the authentication token. answered May 4, 2017 at 8:12. I don't really know what your "AWS Amplified Framework" is, however it might be sufficient just to send a single simple HTTP POST request to the TOKEN ENDPOINT providing relevant grant_type, client_id, code, etc. then in the view result tree located un HTTP (s) Test Script recorder, use the search field to find the first response in which it appears. You can also visit on May 31, 2024 · Further, inside the loop controller, add two more controllers: The transaction controller, which will generate the token and the runtime controller, which will refresh the token. Generate authentication token for each request in jmeter. to extract the token id from Response Data and i applied the token in . Hope this helps. Vadim Yangunaev. Aug 7, 2022 · Dynamically call an auth token in Jmeter test scripts? Watch the video! Aug 24, 2020 · Jmeter Authentication token. Table of Contents: Dec 15, 2021 · Get a client ID and secret. How to get access token with JMeter JSON Extractor and use it? 0. In this scenario, the application endpoint requires that you use a client certificate to authenticate. (Server authentication is when your web browser gives you a pop-up box to login, instead of a webpage form) Feb 9, 2019 · I'm trying to extract access token from the body response and use it in Header Manager for authorization. To extract the authentication token from the server response, we’re going to use JMeter JsonPath Nov 18, 2020 · OAuth (the Open Standard for Authorization) is an open protocol which provides token-based authentication and authorization - as opposed to the standard username and password requirements. Parameterizing Header manager in Jmeter for API testing. Configuration =. To get these, search for Azure Active Directory in the portal and go to Azure AD. (2) start your client and let it perform the authentication step. Add Cookie Manager to your Test Plan. Aug 15, 2013 · To set up jmeter to access an https url: Create an HTTP Request Defaults with your server name. Oct 20, 2022 · Dynamically call an auth token in Jmeter test scripts? Watch the video!Part-1 (Hack#2): https://www. Added Http Authorization manager and added the base url as https://shopping-qa. Nov 7, 2023 · Note : token generation time is not present in Generation of token API response . For using Bearer token, you should create HTTP Header Manager, what you have already added. Perl 5 Regex Cheat sheet. pem files are located or open it from the start menu of the windows and navigate to the folder using cd command. If you are able to reproduce the issue using real web browser or i. Please, provide Headers and Authorization tabs from postman. Generate authentication I'm attempting to test an HTTP service with JMeter. [If this is difficult to do, you can use the JMeter Proxy Recorder to record the login sequence. Can anyone please suggest a solution We would like to show you a description here but the site won’t allow us. It needs to be realistic hence your test should be designed as follows: HTTP GET Request (simulate opening Login page with a browser) Post Processor to fetch dynamic parameters values (if any) HTTP POST Request (login event itself) where you pass your credentials and dynamic parameters. Make sure to have View Results Tree listener under the HTTP (S) Test Script Recorder. Jan 7, 2019 · Also, even if I access the website pages without username and password, still Jmeter returns a status code 200. 2) Click search. To find where the token appeared: clear browser history. This returns a bit of JSON like this: Aug 1, 2023 · Aug 1, 2023, 2:55 AM. In my understanding, the next step is to obtain a "token" to submit with my next response to the Service Provider Application. I used spring security, so I set path to /j_spring_security_check. Feb 11, 2019 · I am trying to use Jmeter to load test a site that uses OKTA Oauth2 for authorization, but uses ADFS/SSO for authentication. May 23, 2019 · However, it doesn't seem to cater exactly for what I am looking for in terms of using the variables required, step through the Microsoft configuration which configures the token. The client credentials grant type is a common OAuth 2. once only controller for authentication, extract access_token and refresh_token. The value is passed through unmodified from the Authentication Request to the ID Token. Jan 4, 2021 · 0. Identify two locations: -- The GET request that gets the login form. Aug 1, 2020 · This Video explains on how to generate bearer token using JMeter. The API uses OAuth authentication, which I'm familiar with using our own proprietary testing tool. 3:. Jan 3, 2019 · I am able to go through the login process and obtain the MSISAuth and MSISAuthenticated cookies. Add ‘JSON Extractor’ under ‘Connect_Token’ Request: TIP: Right click HTTP Request(Connect_Token) > Add > Post Processors > JSON Extractor Oct 5, 2023 · To extract the authentication token from the request, we are going to use JMeter JSON Extractor. 1 (it didnt work for me otherwise) Set protocol to https. Once the interface for the http Oct 15, 2019 · The concrete problem I have now, is that I want to load test an Authorization Code Flow. OpenID Connect is an add-on for OAuth 2. . The HTTP service requires authentication through a simple bearer token mechanism. I don't know what i am missing. Oct 31, 2020 · 2. 0, and it defines how OAuth 2. Then add Key/Name what is used in request, mostly it's Authorization, but we should check it out. Change the value of the VAR parameter in the ‘Reset password page’ request to ‘${BLAZE_XSRF-TOKEN}’. The requests can be even recorded using JMeter's Jan 24, 2013 · Jmeter Authentication token. As Azure authentication generate token and session dynamically for user when every time login the application, so simulating Azure authentication is needed in JMeter. Referred following blogs & didn't worked out : Rerun getToken(authorization) requests only on expiry - Jmeter. Inspect recorded request details and identify the values which are dynamic. under Authorization After executing i am getting response like . com/playlist?list=PL-Olzo Feb 16, 2024 · JMeter openid Connect oidc token jwt Refresh Token keycloak How to load test OpenID/OAUTH. Feb 25, 2014 · to get Auth0 access token which you could reuse for your tests. 1. 0 which was released 6 month ago already with lots of bug fixes, performance improvements and new features. access_token Demo: See Jayway JsonPath for more information on JSON Path language. Jun 16, 2016 · 5. The requests must be exactly the same (apart from dynamic values which need to be correlated) With regards to roles/groups membership - authentication != authorization, authentication is the ability to access the system and Nov 4, 2016 · 1. How to handle Token expiration and regeneration during load test in JMeter. name. Hi Team. Add the http header manager (Add → config element → http header manager) Http header manager ui. I have been using JMeter so far. Dec 11, 2012 · Defining the property "CookieManager. Using Json Extractor¶ To extract the authentication token from the server response, we're going to use JMeter JsonPath Jan 30, 2017 · In the first request you get something called "CSRF token" either in response body or in response headers. Create an HTTP Request for the login. Then in next request, redirects occur and same kind of URL is achieved (as in step1). Xác thực truy cập cơ bản (Basic Access Authentication) là một trong những phương pháp xác thực đơn giản nhất: Hướng dẫn này sẽ dạy cho bạn 3 cách khác nhau để xử lý xác thực cơ bản Token based authentication works by ensuring that each request to a server is accompanied by a signed token which the server verifies for authenticity and only then responds to the request. If you need to run loadtest / soak test for longer than one hour you can use if controller to verify the token validity and renew the token if necessary. (4) inspect the WebSocket frames in the WireShark trace and copy the messages your client has sent to your JMeter test script. Aug 26, 2021 · Login to the application using microsoft credentials (API No. Step 1 API I was able to do it successfully, since I followed some videos in the internet. Sep 3, 2011 · 3. (optional) Response Assertion to verify that user is Feb 13, 2023 · You can simulate user login in JMeter scripts without manual intervention by using the Resource Owner Password Credential Grant (ROPC) auth flow. 0 client credentials grant. In case of a cookie, all you need is HTTP Cookie Manager . As the last resort you can use a browser Jan 23, 2020 · Use JMeter's CSV Config to read those credentials . pem and [key_file_name]. 4. Token Interactions and Authentications. Either your test cases (scripts) will need to include a step to obtain a valid token (this is best practice, and what I would recommend), or you will need to update the application to use a special testing token that never expires (this is kind of hacky Jul 18, 2017 · With regards to JMeter specifics the options of bypassing OAuth challenge are described in How to Run Performance Tests on OAuth Secured Apps with JMeter. WebTest. check. com/watch?v=z1TPuIusnBY&t=936s (When auth token Jun 12, 2015 · These can be found out by inspecting the code of the login page. I would like to run "Get auth token" once every 2. P. But it doesn't work. In order to be able to make next request you need to pass exactly the same value as you got in response to your first request (to confirm your origin). It automatically manages cookies, i. Loader generator: JMeter. Either open the command prompt by typing cmd in the address bar of the folder where . Add Bearer ${AuthToken} value. 2. Then I use regular expression for extracting the token Json Extractor. Access Token Generation ; Inside the Transaction Controller, add an HTTP Sampler and setup a POST request to the token endpoint to fetch the access token. Jan 7, 2021 · 0. Apr 12, 2018 · 0. Sep 4, 2019 · nonce String value used to associate a Client session with an ID Token, and to mitigate replay attacks. I have so problems trying to authenticate with Kerberos through JMeter. Among other elements, you have the HTTP Authorization Manager. This means I need to generate a unique authentication token from a federated token server for each request and because the tokens expire after 5 minutes, I can't use Apr 1, 2018 · This screenshot is for the path ‘/Web/Account/Login’ (which has different token)! enter image description here. save. Before this, our test server uses both Kerberos and NTLM for authentication and the tests went fine. Set method to post. 1、支持跨域访问: Cookie是不允许垮域访问的，这一点对Token机制是不存在的，前提是传输的用户认证信息通过HTTP头传输。. But I have no clue how to provide an endpoint for the required redirect_uri, to complete the flow. So we need to set a Content-Type header. Jan 22, 2016 · I have a fairly simple jmeter script for our site. In my current project the application passes an authentication token id after login. Extracting Auth Token¶ Token Based Authentication is a simple mechanism where a token uniquely identifies a user session. Postman tool - report this issue to developers, otherwise you will need to fix your JMeter test. You should parse that token from previouse request. 2、无状态 (也称：服务端可扩展行):Token机制在服务端不 Feb 12, 2018 · I have the following scenario using Jmeter 3. May 22, 2018 · Using the REST API, we will be posting data as a JSON object. All HTTP requests that I recorded failed during playback with code 401. edited Jan 31, 2019 at 14:04. With either or both of these in place, JMeter sets ${COOKIE_AUTH_TOKEN} as the auth token value in the post body. JSON Web Token (JWT) is an open standard ( RFC 7519 ) that defines a compact and self-contained method for securely transmitting information between parties Mar 10, 2021 · 1. wx af br hk za xe pa sx qp ws