Running multiple test files from one test.py file through Pytest

Question

I have multiple test files in the test folder. The structure is similar to something like this:

/test
----test_abc.py
----test_bcd.py
----test_cde.py
----conftest.py

The conftest.py contains all the spark context initialization which is necessary for running the unit test. My problem is I would like to have a test.py file which internally triggers all the test_abc.py, test_bcd.py and test_cde.py. It becomes very easy when we deal with utit_test module of python but I am not sure how to obtain this through pytest module. Do let me know if any more clarification required on the question.

The conftest.py looks something like this:

import pytest
from pyspark import SQLContext
from pyspark import SparkConf
from pyspark import SparkContext
from pyspark.streaming import StreamingContext

@pytest.fixture(scope="session")
def spark_context(request):
    conf = (SparkConf().setMaster("local[2]").setAppName("pytest-pyspark-local-testing"))
    request.addfinalizer(lambda: sc.stop())
    sc = SparkContext(conf=conf).getOrCreate()
    return sc

And one of the test_abc.py looks something like this:

import pytest
import os
from pyspark.sql import SQLContext
pytestmark = pytest.mark.usefixtures("spark_context")
def test_get_pc_browser_sql(spark_context):
    "assert something"

the 'test' you are referring to are the different test_*.py files? — talkdatatome
– talkdatatome, Commented Dec 10, 2018 at 10:46
@hoefling the solution works when we put test.py outside the test folder and call it. Is there any possibility that I can place the test.py inside the test folder and try running the testfiles through test.py — talkdatatome
– talkdatatome, Commented Dec 10, 2018 at 11:11

slayer · Accepted Answer · 2018-12-10 06:21:22Z

1

I'd recommend just using a bash script and use that to call command line python calls. For example, in you bash script you can just write:

pytest test/

to run all tests within the test directory. You can also add all argument commands and any commands that use on the command line. Then, just execute the bash script for the specific set of files or directories to test. Look at pytest Documentation for reference.

edited Dec 10, 2018 at 6:21

answered Dec 10, 2018 at 6:09

slayer

6527 silver badges15 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

LOrD_ARaGOrN Over a year ago

We don;t give external link as a solution rather explain the user your answer and may be can give link for more reference.

talkdatatome Over a year ago

My question was I want to have a master .py file where I would call all the other test_*.py files. A bash script would do my work but I dont want to do this through bash script

slayer Over a year ago

already answered?

Scott · Accepted Answer · 2021-12-13 23:34:53Z

1

I had a similar need where I want to run only some test files and not an entire folder. In order to have pytest run several files with a single command, if you rename the files you want to run as a group, bash provides a couple of different ways to run such a group.

In this example, I want to run all tests that start with the name testpi:

Gathers all matching files and puts then in a string:

$ pytest -v $(ls tests/testpi*)

Pipe the output of ls to xargs to do the same:

ls tests/testpi* | xargs pytest -v

answered Dec 13, 2021 at 23:34

Scott

1,4291 gold badge15 silver badges20 bronze badges

Comments

Pham Tien Dung · Accepted Answer · 2024-08-17 02:55:10Z

0

You create folder tests/ and input all file test into this. Run terminal:

pytest -v $(ls tests/**/*.py)

answered Aug 17, 2024 at 2:55

Pham Tien Dung

211 bronze badge

Collectives™ on Stack Overflow

Running multiple test files from one test.py file through Pytest

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related