A repository running the Flyte conformance tests
The Flyte conformance test suite is a series of tests that are run against a Flyte deployment to ensure that it is functioning correctly.
Make sure all the flytesnacks are working correctly.
make flytesnacks- Test backend plugin, such as Tensorflow, Pytorch, Spark, etc.
- Test flytekit plugin, such as flyteinteractive, mlflow, pandera, etc.
make flytepluginsTest all the agents in flytekit, including BigQuery, Airflow, sensor, OpenAI, etc.
make flyteagentsAny tests that cannot be added to Flytesnacks will be included in the flyte-conformance tests.
- Failure node, pod template, array node, image spec, etc
make flyte-conformanceIt uses flytekit remote to run the tasks/workflows to test the functionality of Flyte. For example,
- Verify whether the outputs are being cached
- Verify whether the cache can be overridden
- Verify whether Flyte deck is working
- Verify whether flytekit remote is functioning properly.
make functional_tests