Why you might wanna have a look on this as well, it uses pandas and multiprocessing to create a…
https://python.plainenglish.io/pandas-and-multiprocessing-how-to-create-dataframes-in-a-parallel-way-72f9b18ea72f
Why you might wanna have a look on this as well, it uses pandas and multiprocessing to create a Dataframe in parallel, but in this case you can select how many processes it will use, also some benchmarking is included