Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

TraceTest - Failing tests #1091

Closed
julianocosta89 opened this issue Sep 1, 2023 · 0 comments · Fixed by #1096
Closed

TraceTest - Failing tests #1091

julianocosta89 opened this issue Sep 1, 2023 · 0 comments · Fixed by #1096
Assignees
@julianocosta89
Labels
bug Something isn't working

Comments

@julianocosta89
Copy link
Member

Bug Report

Which version of the demo you are using? (please provide either a specific
4acb07e.

Symptom

What is the expected behavior?

When running the trace test I'd expect all tests to succeed.

What is the actual behavior?

✔ Ad Service (http://tracetest-server:11633/testsuite/ad-service-all/run/1)
	✔ Ad: get (http://tracetest-server:11633/test/ad-get-ads/run/1/test) - trace id: cee4e16d1377d9563144a548ace95dd9
		✔ It returns two ads
		✔ It returns a valid redirectUrl for each ads

✔ Cart Service (http://tracetest-server:11633/testsuite/cart-all/run/1)
	✔ Cart: empty cart (http://tracetest-server:11633/test/cart-empty-cart/run/1/test) - trace id: e004ad68b045b2058b463c69489fafc5
		✔ It emptied the shopping cart with success
		✔ It sent cleaning message to the database
	✔ Cart: add item to cart (http://tracetest-server:11633/test/cart-add-item-to-cart/run/1/test) - trace id: 4118e49247b80f75c5dbb3667eddeadd
		✔ It added an item correctly into the shopping cart
		✔ It set the cart item correctly on the database
		✔ It returned an empty cart
	✔ Cart: check if cart is populated (http://tracetest-server:11633/test/cart-check-if-cart-is-populated/run/1/test) - trace id: 255ea57505723e8ebbddcd3322823f96
		✔ It retrieved the cart items correctly
		✔ It returned the first item with correct attributes
	✔ Cart: empty cart (http://tracetest-server:11633/test/cart-empty-cart/run/2/test) - trace id: eda5a361da294c18c1e663808ea198df
		✔ It emptied the shopping cart with success
		✔ It sent cleaning message to the database
	✔ Cart: check if cart is empty (http://tracetest-server:11633/test/cart-check-if-cart-is-empty/run/1/test) - trace id: a332a8a2e93dfeaea28a316313e1b2d0
		✔ It retrieved the cart items correctly
		✔ It returned no items

✔ Currency Service (http://tracetest-server:11633/testsuite/currency-service-all/run/1)
	✔ Currency: Convert (http://tracetest-server:11633/test/currency-convert/run/1/test) - trace id: b0a4d8d696a03107c9bd0760374771ac
		✔ It converts from USD to CAD
		✔ It has more nanos than expected
	✔ Currency: Supported (http://tracetest-server:11633/test/currency-supported/run/1/test) - trace id: d97747e6b78ce2c1c858aecbeb488be3
		✔ It has a span called "CurrencyService/GetSupportedCurrencies"
		✔ It returns the expected currency codes

✘ Checkout Service (http://tracetest-server:11633/testsuite/checkout-service-all/run/1)
	✘ Checkout: place order (http://tracetest-server:11633/test/checkout-place-order/run/1/test) - trace id: bcf611133a2f01066bb689335a5d9bb4
		✔ It returns a valid order
			✔ #34f033efe79385f1
				✔ attr:tracetest.response.body | json_path '$.order.orderId' != "" (949b9b33-48c0-11ee-9c89-02420ac90215)
				✔ attr:tracetest.response.body | json_path '$.order.shippingTrackingId' != "" (b5812d2d-3007-4925-9dda-c8cdb48240f9)
				✔ attr:tracetest.response.body | json_path '$.order.shippingAddress' != "{}" (map[city:Seattle country:United States state:Washington streetAddress:410 Terry Ave. North zipCode:98109])
				✔ attr:tracetest.response.body | json_path '$.order.shippingCost.currencyCode' = "USD" (USD)
		✔ It calls the PlaceOrder method successfuly
			✔ #8f4064946c8dbf47
				✔ attr:rpc.grpc.status_code = 0 (0)
		✘ It sends an order to be processed asyncronously
			✘ #meta
				✘ attr:messaging.destination = "orders" (http://tracetest-server:11633/test/checkout-place-order/run/1/test?selectedAssertion=2)

		✘ Required gates
			✔ analyzer-score
			✘ test-specs

✘ Frontend Service (http://tracetest-server:11633/testsuite/frontend-all/run/1)
	✔ Frontend: See Ads (http://tracetest-server:11633/test/frontend-see-adds/run/1/test) - trace id: 16a282bcee2163ea8206fa9618a9c5f7
		✔ It called the frontend with success and got a valid redirectUrl for each ads
		✔ It returns two ads
	✔ Frontend: Get recommendations (http://tracetest-server:11633/test/frontend-get-recommendation/run/1/test) - trace id: 64723c2f4bcf21bf0c93f42f0cfd32a0
		✔ It called the frontend with success
		✔ It called ListRecommendations correctly and got 5 products
	✔ Frontend: Browse products (http://tracetest-server:11633/test/frontend-browse-product/run/1/test) - trace id: 0e8092de6c4e8cce1d1500b246969a70
		✔ It called the frontend with success and got a product with valid attributes
		✔ It queried the product catalog correctly for a specific product
	✔ Frontend: Add product to the cart (http://tracetest-server:11633/test/frontend-add-product/run/1/test) - trace id: 5908b673e7c21d5d2f51ad300b603863
		✔ It called the frontend with success
		✔ It added an item correctly into the shopping cart
		✔ It set the cart item correctly on the database
	✔ Frontend: View cart (http://tracetest-server:11633/test/frontend-view-cart/run/1/test) - trace id: 8290451e75ac1b5341b8ef0f4dbab9dc
		✔ It called the frontend with success
		✔ It retrieved the cart items correctly
	✘ Frontend: Checking out shopping cart (http://tracetest-server:11633/test/frontend-checkout-shopping-cart/run/1/test) - trace id: 72e875fda9605cc38f526093d3a347c2
		✔ It called the frontend with success
			✔ #091f70a1463ae7fb
				✔ attr:tracetest.response.status = 200 (200)
		✔ The order was placed
			✔ #c2932aca173013e9
				✔ attr:app.user.id = "2491f868-88f1-4345-8836-d5d8511a9f83" (2491f868-88f1-4345-8836-d5d8511a9f83)
				✔ attr:app.order.items.count = 1 (1)
		✔ The user was charged
			✔ #01d7d79e4590484f
				✔ attr:rpc.grpc.status_code  =  0 (0)
				✔ attr:tracetest.selected_spans.count >= 1 (1)
		✔ The product was shipped
			✔ #ab9447c15f595533
				✔ attr:rpc.grpc.status_code = 0 (0)
				✔ attr:tracetest.selected_spans.count >= 1 (1)
		✔ The cart was emptied
			✔ #913a7244195a51bc
				✔ attr:rpc.grpc.status_code = 0 (0)
				✔ attr:tracetest.selected_spans.count >= 1 (2)
			✔ #5867866f5c90e33e
				✔ attr:rpc.grpc.status_code = 0 (0)
				✔ attr:tracetest.selected_spans.count >= 1 (2)
		✘ The order was sent to be processed asyncronously
			✘ #meta
				✘ attr:messaging.destination = "orders" (http://tracetest-server:11633/test/frontend-checkout-shopping-cart/run/1/test?selectedAssertion=5)
		✘ The order was sent to accountability
			✘ #meta
				✘ attr:name = "orders receive" (http://tracetest-server:11633/test/frontend-checkout-shopping-cart/run/1/test?selectedAssertion=6)
		✔ The order was sent to fraud detection team
			✔ #a28160de4769c412
				✔ attr:name = "orders process" (orders process)

		✘ Required gates
			✔ analyzer-score
			✘ test-specs

✔ Email Service (http://tracetest-server:11633/testsuite/email-service-all/run/1)
	✔ Email: Confirmation (http://tracetest-server:11633/test/email-confirmation/run/1/test) - trace id: 86cdd4f6552ccb44bf0ddc087887a673
		✔ It should be called successfully
		✔ It should render a email to send
		✔ It should send an email

✔ Payment Service (http://tracetest-server:11633/testsuite/payment-service-all/run/1)
	✔ Payment: valid credit card (http://tracetest-server:11633/test/payment-valid-credit-card/run/1/test) - trace id: 04d65ecf41d7f7e6210b89362e007926
		✔ It should call Charge method successfully
		✔ It should return a transaction ID
	✔ Payment: invalid credit card (http://tracetest-server:11633/test/payment-invalid-credit-card/run/1/test) - trace id: efbb432d2c1a1b1fcf39bdb21a26baaa
		✔ It should call Charge method and receive a gRPC error
		✔ It should return a return an gRPC error code to the caller
	✔ Payment: Amex credit card not allowed (http://tracetest-server:11633/test/payment-amex-credit-card-not-allowed/run/1/test) - trace id: 22f3d69176a46050fc60adcafaf612f0
		✔ It should call Charge method and receive a gRPC error
		✔ It should return a return an gRPC error code to the caller
	✔ Payment: expired credit card (http://tracetest-server:11633/test/payment-expired-credit-card/run/1/test) - trace id: 82542c1c6ca72a9fd061278a036af44b
		✔ It should call Charge method and receive a gRPC error
		✔ It should return a return an gRPC error code to the caller

✔ Product Catalog Service (http://tracetest-server:11633/testsuite/product-catalog-service-all/run/1)
	✔ Product: List (http://tracetest-server:11633/test/product-list/run/1/test) - trace id: 8a4e822b7c88ffc45c3af795b75a386c
		✔ It queried the product catalog correctly
		✔ It returned products with IDs
	✔ Product: Get (http://tracetest-server:11633/test/product-get/run/1/test) - trace id: d72dfb88fd20e2e9874f702ac8934cde
		✔ It queried the product catalog correctly for a specific product
		✔ It returned a product with valid attributes
	✔ Product: Search (http://tracetest-server:11633/test/product-search/run/1/test) - trace id: 469b317d333cc2f03a9944a5efc59db9
		✔ It called SearchProducts correctly and it returned 1 item
		✔ It returned the desired product

✔ Recommendation Service (http://tracetest-server:11633/testsuite/recommendation-service-all/run/1)
	✔ Recommendation: List products (http://tracetest-server:11633/test/recommendation-list/run/1/test) - trace id: 6b4d55fbdc68ca6c15d00842359c3af5
		✔ It called ListRecommendations correctly and got 5 products

✔ Shipping Service (http://tracetest-server:11633/testsuite/shipping-service-all/run/1)
	✔ Shipping: Quote (http://tracetest-server:11633/test/shipping-quote/run/1/test) - trace id: e7d18f347d3b86854beda1141029c769
		✔ It called GetQuote correctly
		✔ It returned a valid quote
	✔ Shipping: Empty Quote (http://tracetest-server:11633/test/shipping-empty-quote/run/1/test) - trace id: 686dccc42a94299094753f543d6b6978
		✔ It called GetQuote correctly
		✔ It returned a valid quote
	✔ Shipping: Order (http://tracetest-server:11633/test/shipping-order/run/1/test) - trace id: 07d6dcfa2fcb4fc5f41a600049f51728
		✔ It called GetQuote correctly
		✔ It returned a trackingId


Tests done! Exit code: 2
make: *** [Makefile:100: run-tracetesting] Error 2

Reproduce

make run-tracetesting
@julianocosta89 julianocosta89 added the bug Something isn't working label Sep 1, 2023
@julianocosta89 julianocosta89 self-assigned this Sep 4, 2023
@julianocosta89 julianocosta89 mentioned this issue Sep 4, 2023
Merged
3 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@julianocosta89 julianocosta89

Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Fix TraceTest after IBM/sarama upgrade julianocosta89/opentelemetry-demo
1 participant
@julianocosta89