I'm having intermittent tests on Circle CI

[Hoffmano]

My problem

• My tests works very well on my computer and my team mates computers, but when we run on Circle CI something strange is happening. An alleatory test does not pass

Details

I am creating E2E tests to my application

So on CI I create a container with a database and a container with redis

Then I run migrations in that database and seeders to E2E test and to finish I run tests
package.json scripts

"scripts": {
    "test:e2e:local": ". ./src/configs/development.sh && ava src/modules/public/e2e/tests --serial --no-worker-threads --concurrency 1",
  },

To run E2E tests with ava js I created a transitional test function to not alterate my database state
transitionalTest.js

const test = require('ava')
const { logger } = require('@/src/utils/logger')
const { sequelize } = require('@/src/database')
const { flushall } = require('@/src/lib/cache/redis')

const transactionalTest = (title, testFunction) => {
  test(
    title,
    t => new Promise((resolve, reject) => {
      sequelize
        .transaction(transaction => testFunction(t)
          .then(() => {
            resolve()
          })
          .catch((error) => {
            console.log('test error', error)
            logger.error(error)
            reject(error)
          })
          .finally(async () => {
            await transaction.rollback()
            await flushall()
          }))
        .catch((error) => {
          console.log('transaction error', error)
          logger.error(error)
          reject(error)
        })
    }),
  )
}

module.exports = transactionalTest

On local thats works very well, but on CI sometimes an alleatory test throwns a test error because some request is returning 401 unauthorized

test.spec.js

const supertest = require('supertest')
const { app } = require('@/src/index')
const test = require('@/src/utils/transactionalTest')
const {
  CLINICS,
  SPECIALITIES,
} = require('@/src/enums')

test('should get care history by patient', async (t) => {
  const login = await supertest(app)
    .post('/session')
    .send({
      email: 'xxxxxxxxxxxxxx',
      password: 'xxxxxxxxxxxxxxx',
    })
  t.is(login.status, 200)
  t.is(login.body.user.id, 'xxxxxxxxxxxxxx')

  const loginToken = login.body.token

  const getCareHistory = await supertest(app)
    .get('/care_history/xxxxxxxxxxxxxx')
    .set('Authorization', `Bearer ${loginToken}`)

  t.is(getCareHistory.status, 200)
  t.is(getCareHistory.body.events.length, 0)

  const slots = await supertest(app)
    .get('/slot')
    .set('Authorization', `Bearer ${loginToken}`)
    .query({
      clinicId: CLINICS.amparoTele,
      specialityId: SPECIALITIES.familyCommunityHealth,
    })

  await supertest(app)
    .post('/appointment')
    .set('Authorization', `Bearer ${loginToken}`)
    .send({
      slotsId: [slots.body.slots[0].id],
      patientId: 'xxxxxxxxxxxxxxxxxxx',
    })

  const getCareHistory2 = await supertest(app)
    .get('/care_history/xxxxxxxxxxxxx')
    .set('Authorization', `Bearer ${loginToken}`)

  t.is(getCareHistory2.status, 200)
  t.is(getCareHistory2.body.events.length, 1)

  const getCareHistory3 = await supertest(app)
    .get('/care_history/xxxxxxxxxx')
    .set('Authorization', `Bearer ${loginToken}`)
    .query({
      'filters[]': 'forms',
    })

  t.is(getCareHistory3.status, 200)
  t.is(getCareHistory3.body.events.length, 0)
})

Anyone can give me a hint?
If another detail is necessary, please tell me.

[novemberborn]

I'm not sure what you mean by alleatory. Typically what you have to be careful with here is different tests interfering with each other but based on your config that shouldn't be the case.