Time Complexity of dplyr functions

Thread starter Trollfaz
Start date May 30, 2023

AI Thread Summary

The time complexity of basic dplyr functions like filter(), select(), mutate(), rename(), summarize(), count(), separate(), unite(), spread(), and gather() is generally considered O(N), where N is the number of rows in the data frame. Assuming mutate operates in O(1), this holds true for single data frames. For operations involving two data frames, such as inner_join, left_join, and outer_join, the time complexity is O(N + M), where N and M are the row counts of the respective data frames. This reflects the need to process both data frames during the join operations. Understanding these complexities is crucial for optimizing data manipulation tasks in R using dplyr.

May 30, 2023

Trollfaz

TL;DR Summary: R

For R's dplyr package this is my query.
Suppose I have a data frame/tibble of n observations or n rows. Let's call it df1. Is the time complexity for dplyr's basic manipulation functions O(N)
filter()
select()
mutate() assuming mutate is O(1)
rename()
summarize()
count()
separate()
unite()
spread()
gather()
If I have another data frame/tibble df2 of m rows, then are the following functions of time complexity O(N+M)
inner_join(df1,df2)
right/left_join(df1,df2)
outer_join(df1,df2)

Thread 'Learning Assembly and computer architecture for x86'

Dear Peeps I have posted a few questions about programing on this sectio of the PF forum. I want to ask you veterans how you folks learn program in assembly and about computer architecture for the x86 family. In addition to finish learning C, I am also reading the book From bits to Gates to C and Beyond. In the book, it uses the mini LC3 assembly language. I also have books on assembly programming and computer architecture. The few famous ones i have are Computer Organization and...

View full post »

Thread 'Learning data structures and algorithms in different programming languages'

I have a quick questions. I am going through a book on C programming on my own. Afterwards, I plan to go through something call data structures and algorithms on my own also in C. I also need to learn C++, Matlab and for personal interest Haskell. For the two topic of data structures and algorithms, I understand there are standard ones across all programming languages. After learning it through C, what would be the biggest issue when trying to implement the same data...

View full post »