Search Mailing List Archives


Limit search to: Subject & Body Subject Author
Sort by: Reverse Sort
Limit to: All This Week Last Week This Month Last Month
Select Date Range     through    

[farmshare-discuss] Linux to download files from Web AFS to local drive

Yizheng Liao yzliao at stanford.edu
Thu Jan 2 12:45:26 PST 2014


Hi, Chris:

Why do not you use scp to copy from remote server to local device?

like: scp -r ccoke at corn.stanford.edu:/afs/ir/users/c/c/ccoke/Indeed
~/some_folders

Thanks,
Yizheng

Best wishes,
Yizheng


On Thu, Jan 2, 2014 at 3:26 PM, Chris Coke <chris.r.coke at gmail.com> wrote:

> Hi,
>
> I'm trying to download a large number of files from my Web AFS, and would
> prefer to automate it rather than use the UI.  Here's what I've tried so
> far.  Anyone have suggestions?
>
> *I've tried using curl and/or wget, but I can't figure out a good way to
> get past the log-in and then redirection pages:*
>
> wget --no-check-certificate
> https://afs.stanford.edu/?path=/afs/ir/users/c/c/ccoke/Indeed/Jobs_99_010114_time.txt
>
> returns the html from the redirection page, and same thing even when I
> supply wget with my log-in credentials.
>
> *I've also tried mounting the drive locally using sshfs (but then when
> trying to navigate or copy+paste from the mounted directory, I get a
> Permission Denied error).*
>
> Success.  output from "mount":
> ccoke at corn.stanford.edu:/afs/ir/users/c/c/ccoke/Indeed on
> /Users/chriscoke/Dropbox/JobsData/Data (osxfusefs, nodev, nosuid,
> synchronous, mounted by chriscoke)
>
> But then, error:
> rescomp-13-270614:~ chriscoke$ cd ~/Dropbox/JobsData/Data
> -bash: cd: /Users/chriscoke/Dropbox/JobsData/Data: Permission denied
>
> *And finally, I've tried mounting via CIFS. But here, I always get the
> below error:*
>
> rescomp-13-270614:~ chriscoke$ mount -t cifs -o
> username=[username],password=[password] //corn.stanford.edu/ccoke
> ~/Dropbox/JobsData/Data
>
> mount: exec
> /System/Library/Filesystems/cifs.fs/Contents/Resources/mount_cifs for
> /Users/chriscoke/Dropbox/JobsData/Data: No such file or directory
>
>
> Thanks,
>
> Chris
>
> _______________________________________________
> farmshare-discuss mailing list
> farmshare-discuss at lists.stanford.edu
> https://mailman.stanford.edu/mailman/listinfo/farmshare-discuss
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.stanford.edu/pipermail/farmshare-discuss/attachments/20140102/3322a1dd/attachment.html>


More information about the farmshare-discuss mailing list