Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed Test cases are marked as passed #376

Open
pradeepsundaram opened this issue Apr 26, 2022 · 2 comments
Open

Failed Test cases are marked as passed #376

pradeepsundaram opened this issue Apr 26, 2022 · 2 comments

Comments

@pradeepsundaram
Copy link

Describe the bug
Though the tests are failed, they are marked as passed in the report. Failure screen shot is being generated.

Code Reproduce
This is inside paypal corp and its confidential

Expected behavior
The test case should be marked as failure.

Screenshots
│ Tests: 1 │
│ Passing: 1 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 1 │
│ Video: true │
│ Duration: 6 minutes, 16 seconds │
│ Spec Ran: UK/cbpUKTC2.js │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
(Screenshots)

  • /home/****/agent/workspace/riskcbprotectnodeweb-FT/cypress/screenshots/UK/cbp (1280x720)
    UKTC2.js/Risk Manage Hub page with CB - Seller response and No product -- TC2 sh
    ould be able to see the risk CB and No Protections for UK (failed).png

Environment (please complete the following information):

  • Platform
  • mochawesome version - ^7.1.2
  • mocha (or other test library) version - ^9.2.2
  • Node version - 6.14.14

Additional context
we are running our CI and there are some tests which fails and retry attempts are not made. the reason for that is the tests are marked as passed though it fails. Screenshots are being attached in the log for failure but marked as passed.

@adamgruber
Copy link
Owner

I see that you are using Cypress so it may be an issue with them. However, without some kind of code to reproduce the issue there's nothing for me to debug. Are you able to provide a simple test case that illustrates your issue without providing sensitive information?

@pradeepsundaram
Copy link
Author

Hi @adamgruber ,

Code goes like this,

cy.visit(url).get('#email').type(${email}{enter})
cy.get('#password', { timeout: 10000 })
.should('be.visible')
.type(atob(data.pass))
.type('{enter}')
cy.get(data.mrhpnoppcp).contains('some label')

but the page itself is not loaded, getting error like this "cy.visit() failed trying to load: https://www.te-"
the results in mochawesome shows like this. it says passed but screen shot is taken for the failed one (which i have highlighted below).
┌────────────────────────────────────────────────────────────────────────────────────────────────┐
│ Tests: 1 │
│ Passing: 1 │
│ Failing: 0 │
│ Pending: 0 │
│ Skipped: 0 │
│ Screenshots: 1 │
│ Video: true │
│ Duration: 6 minutes, 16 seconds │
│ Spec Ran: IT/cbpITTC5.js │
└────────────────────────────────────────────────────────────────────────────────────────────────┘
(Screenshots)

  • /home/****/agent/workspace/riskcbprotectnodeweb-FT/cypress/screenshots/IT/cbpITTC5.js/Risk Manage Hub page with CB - Seller response, Fraud Protection and No
    product -- TC5 should be able to see the risk CB and No Protections for IT (failed).png

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants