ASPN ActiveState Programmer Network
ActiveState
/ Home / Perl / PHP / Python / Tcl / XSLT /
/ Safari / My ASPN /
Cookbooks | Documentation | Mailing Lists | Modules | News Feeds | Products | User Groups


Recent Messages
List Archives
About the List
List Leaders
Subscription Options

View Subscriptions
Help

View by Topic
ActiveState
.NET Framework
Open Source
Perl
PHP
Python
Tcl
Web Services
XML & XSLT

View by Category
Database
General
SOAP
System Administration
Tools
User Interfaces
Web Programming
XML Programming


MyASPN >> Mail Archive >> python-tutor
python-tutor
Re: [Tutor] why is os.path.walk so slow?
by Garry Willgoose other posts by this author
Nov 4 2009 4:38PM messages near this date
Re: [Tutor] why is os.path.walk so slow? | Re: [Tutor] why is os.path.walk so slow?
>  [snip]
> > I need to synchronize the files on my home and office machine and  
> > have
> > been using someone else's code for this to date but have been
> > frustrated by how slow it is in getting the information on files for
> > the mounted drive from my office machine...
>  [/snip]
> 
>  Not to cut your coding project short, and it may not even be
>  applicable, but have you looked into rsync? They kind of wrote the
>  book on efficiency in regards to synchronization of files.
> 
>  Just a thought.
>  -Modulok-

It looks like rsync is ideal for what I want ... thanks for pointing  
this out. One less project to work on ;-)

To the other replies:

1. Both local and remote systems for the testing are OSX 10.5 and CPU  
was not limiting during the test.  Python was the Enthought binary  
distribution. Internet service is ADSL 1500/512.
2. I neglected to mention that I did comment out the code inside  
visitfunc() with the same result so the issue is inside walk().

I guess now I know abut rsync the pressing need for this is gone (I  
might still write a nice GUI for rsync ;-) but I'm still intrigued by  
the problem and whether its a latency vs bandwidth problem. The idea  
of writing a script to run on the remote end is good, and something I  
might use for another project.
_______________________________________________
Tutor maillist  -  Tutor@[...].org
To unsubscribe or change subscription options:
http://mail.python.org/mailman/listinfo/tutor
Thread:
Garry Willgoose
Modulok
Garry Willgoose
Wayne Werner
Hugo Arts

Privacy Policy | Email Opt-out | Feedback | Syndication
© ActiveState Software Inc. All rights reserved