Request: Library Export Feature

Page 1 of 21 2 Next

- JustSomeOldJoe said...
- User
- 1 Jul 2009, 04:19
Request: Library Export Feature

It would be great to have a "Library Export" feature that exports all tracks in a user's library in XML format. A great deal of time has been spent building up a library, and many new artists found using the excellent recommendation feature. Having a Lib Export feature would go a long way toward providing the piece of mind that the time spent wasn't time wasted.

Basic attributes required would include the following:

Must Have
Artist Name
Album Name
Track Name
Loved (Y/N)
User Tags (names of all user tags applied to track)
User Playlist Names (names of all user playlists assigned to track)

Nice To Have
Artist MBID
Album MBID
Track MBID
Playcount

I realize that 3rd party tools exist that supposedly do the task. But, to my knowledge, none of them work appropriately (or include the info requested) due to LFM public API constraints. As such, I suspect external party import routines are flawed as well. Having access to a full lib feed would be extremely useful.

[quote][b][user]JustSomeOldJoe[/user][/b] said: It would be great to have a "Library Export" feature that exports all tracks in a user's library in XML format. A great deal of time has been spent building up a library, and many new artists found using the excellent recommendation feature. Having a Lib Export feature would go a long way toward providing the piece of mind that the time spent wasn't time wasted. Basic attributes required would include the following: [b][u]Must Have[/u][/b] Artist Name Album Name Track Name Loved (Y/N) User Tags (names of all user tags applied to track) User Playlist Names (names of all user playlists assigned to track) [b][u]Nice To Have[/u][/b] Artist MBID Album MBID Track MBID Playcount I realize that 3rd party tools exist that supposedly do the task. But, to my knowledge, none of them work appropriately (or include the info requested) due to LFM public API constraints. As such, I suspect external party import routines are flawed as well. Having access to a full lib feed would be extremely useful.[/quote]

Permalink Quote
- [Deleted user] said...
- User
- 1 Jul 2009, 08:14
For now I just worked around this by using File->SaveAs...HTML on every page in the http://www.last.fm/user/<USERNAME>/library/recent collection, as well as the loved tracks, playlist, tags (for each), grapevine, replytracker, and profile pages.

I can then re-interrogate last.fm if necessary for album info if there's anything I want to buy, and (when I get round to it) write some VB hack to transform the HTML into CSV and import to excel or appleworks or whatever.

(OK I'm assuming there's no hidden system state, or its loss would be insignificant, such as playcount, MBID guids etc.)

[quote][b][user][/user][/b] said: For now I just worked around this by using File->SaveAs...HTML on every page in the http://www.last.fm/user/<USERNAME>/library/recent collection, as well as the loved tracks, playlist, tags (for each), grapevine, replytracker, and profile pages. I can then re-interrogate last.fm if necessary for album info if there's anything I want to buy, and (when I get round to it) write some VB hack to transform the HTML into CSV and import to excel or appleworks or whatever. (OK I'm assuming there's no hidden system state, or its loss would be insignificant, such as playcount, MBID guids etc.)[/quote]

Permalink Quote
- JustSomeOldJoe said...
- User
- 1 Jul 2009, 08:37
Yup, I've got a kluge as well... but it gets pretty wild as the tags/playlists and overall lib size grow.

They've got a basic feed which is close to suitable for the purpose already. Just a bit of modification and the feature is in place.

[quote][b][user]JustSomeOldJoe[/user][/b] said: Yup, I've got a kluge as well... but it gets pretty wild as the tags/playlists and overall lib size grow. They've got a basic feed which is close to suitable for the purpose already. Just a bit of modification and the feature is in place.[/quote]

Permalink Quote
- Patriushko said...
- User
- 1 Dec 2009, 15:42
How to export last.fm library? Still, no solution?

I would like to export to an excel page a list:

-including all tracks that I added, even if the ones that have 0 counts.

Could someone who works at Last.fm actually answer if there´s plans to incorporate this simple feature, or let others do it?

I know there are some applications out there that can do part of this but none can export the HOLE library.

This is a basic, useful, easy, feature that should have been incorporated long time ago.

I need it to have a backup, and to be able to print out the list and clean the song list effectively.

Please let us know what are the prospects.
Thanks

[quote][b][user]Patriushko[/user][/b] said: I would like to export to an excel page a list: [b] -including all tracks that I added, even if the ones that have 0 counts.[/b] Could someone who works at Last.fm actually answer if there´s plans to incorporate this simple feature, or let others do it? I know there are some applications out there that can do part of this but none can export the HOLE library. This is a basic, useful, easy, feature that should have been incorporated long time ago. I need it to have a backup, and to be able to print out the list and clean the song list effectively. Please let us know what are the prospects. Thanks [/quote]
Edited by Patriushko on 1 Dec 2009, 15:59

Permalink Quote
- lijemo said...
- User
- 1 Dec 2009, 15:58
This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included)

Edited: darn, that seems to just be per-artist and per-artist-per-week counts, which won't be helpful if you want to export individual scrobbles.

\mXm/ R.I.P (Rock in Peace) Ronnie James Dio 1942 - 2010 \mXm/

[quote][b][user]lijemo[/user][/b] said: This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included) [b]Edited: [/b]darn, that seems to just be per-artist and per-artist-per-week counts, which won't be helpful if you want to export individual scrobbles. [/quote]

Permalink Quote
- Patriushko said...
- User
- 1 Dec 2009, 16:04
lijemo said:
This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included)

Thank you but I think I saw this before and couldn´t extract all the data.
If someone has a suggestion please include the precise link.

[quote][b][user]Patriushko[/user][/b] said: [quote][b][user]lijemo[/user][/b] said: This 3rd party site: http://build.last.fm/item/36 has a feature that allows you to export your last.fm library info in Excel format. (I don't remember exactly which fields are included)[/quote] Thank you but I think I saw this before and couldn´t extract all the data. If someone has a suggestion please include the precise link.[/quote]

Permalink Quote
- lijemo said...
- User
- 1 Dec 2009, 16:06
Thank you but I think I saw this before and couldn´t extract all the data.
Yup, I noticed that and added my "Edited: Darn," addendum before you even had a chance to finish posting your response =^).

Hope you find something!

(I've been meaning to request an API key and start playing around with the API-- if I do, I'll keep this thread in mind and see if I can come up with something. Nobody hold your breath though, very much a when-and-if-I-get-around-to-it thing.)

\mXm/ R.I.P (Rock in Peace) Ronnie James Dio 1942 - 2010 \mXm/

[quote][b][user]lijemo[/user][/b] said: [quote]Thank you but I think I saw this before and couldn´t extract all the data.[/quote] Yup, I noticed that and added my "[b]Edited:[/b] Darn," addendum before you even had a chance to finish posting your response =^). Hope you find something! (I've been meaning to request an API key and start playing around with the API-- if I do, I'll keep this thread in mind and see if I can come up with something. Nobody hold your breath though, very much a when-and-if-I-get-around-to-it thing.)[/quote]

Permalink Quote
- Patriushko said...
- User
- 1 Dec 2009, 16:22
thanks, i stay tuned...

[quote][b][user]Patriushko[/user][/b] said: thanks, i stay tuned...[/quote]

Permalink Quote
- percy74 said...
- User
- 1 Dec 2009, 17:45
Have you tried this? I think it will do what you want, although there's no easy-to-use UI and it does require you to have Perl installed on your computer (the links for everything you need are included in this journal entry). Once I figured out how to work it, it worked quite well. It may take a while to run (my library took about 20 minutes to extract) but I found the library.getAlbums / library.getArtists / library.getTracks data was very complete. Hope this helps.

[quote][b][user]percy74[/user][/b] said: Have you tried [url=http://www.last.fm/user/toc-rox/journal/2009/08/26/2ysler_lfm_col_-_last.fm_data_collector_%28for_windows%2C_linux_and_os_x%29]this[/url]? I think it will do what you want, although there's no easy-to-use UI and it does require you to have Perl installed on your computer (the links for everything you need are included in this journal entry). Once I figured out how to work it, it worked quite well. It may take a while to run (my library took about 20 minutes to extract) but I found the library.getAlbums / library.getArtists / library.getTracks data was very complete. Hope this helps.[/quote]

Permalink Quote
- JustSomeOldJoe said...
- User
- 1 Dec 2009, 21:48
Dang... resurrected thread from the dead!

I'll throw a 2nd out there for toc-rox's utils. They get right to the point and do the job well, and there's plenty of doc's to get you going.

[quote][b][user]JustSomeOldJoe[/user][/b] said: Dang... resurrected thread from the dead! I'll throw a 2nd out there for toc-rox's utils. They get right to the point and do the job well, and there's plenty of doc's to get you going.[/quote]

Permalink Quote
- onno said...
- User
- 2 Dec 2009, 09:22
is this useful: http://www.last.fm/api

" they said the classics never go out of style, but they do, they do "

[quote][b][user]onno[/user][/b] said: is this useful: http://www.last.fm/api[/quote]

Permalink Quote
- akrde said...
- Subscriber
- 3 Dec 2009, 17:20
onno said:
is this useful: http://www.last.fm/api

Nope, mainly because of this:

limit (Optional) : Limit the amount of tracks returned (maximum/default is 50).

And API had to be extended to get user tags, user playlist names, and so on...

Tomahawk Music Player
Last.fm Free Music Player
Playdar Music Content Resolver

[quote][b][user]akrde[/user][/b] said: [quote][b][user]onno[/user][/b] said: is this useful: http://www.last.fm/api[/quote] Nope, mainly because of this: [url=http://www.last.fm/api/show?service=323]limit (Optional) : Limit the amount of tracks returned ([b]maximum/default is 50[/b]).[/url] And API had to be extended to get user tags, user playlist names, and so on...[/quote]

Permalink Quote
- acreature said...
- Alumni
- 3 Dec 2009, 18:09
Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish.

[quote][b][user]acreature[/user][/b] said: Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish. [/quote]

Permalink Quote
- akrde said...
- Subscriber
- 3 Dec 2009, 19:40
acreature sagte:
Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish.

Ah yes, you are right. Overlooked the page parameter there...

Tomahawk Music Player
Last.fm Free Music Player
Playdar Music Content Resolver

[quote][b][user]akrde[/user][/b] said: [quote][b][user]acreature[/user][/b] sagte: Note there's also a 'page' parameter – you can get a user's entire track history in blocks of 50 tracks if you so wish. [/quote] Ah yes, you are right. Overlooked the page parameter there...[/quote]

Permalink Quote
- Patriushko said...
- User
- 14 Dec 2009, 11:22
What if this happens to us? When we will have a solution, or an answer from Last.fm?

"They sold out on Dec. 8th.” Users are particularly upset about losing their playlists"

Why we don´t have this simple feature? designed for everyone not just computer savvy people? Should we create a group to lobby for it?

MySpace Continues To Get Trashed Over Imeem Shutdown
http://fon.gs/mydata/

[quote][b][user]Patriushko[/user][/b] said: [i] "They sold out on Dec. 8th.” Users are particularly upset about losing their playlists"[/i] Why we don´t have this simple feature? designed for everyone not just computer savvy people? Should we create a group to lobby for it? MySpace Continues To Get Trashed Over Imeem Shutdown http://fon.gs/mydata/ [/quote]

Permalink Quote
- andymydear said...
- User
- 11 Jan 2010, 19:40
I love http://mcm69.org.ua/lastfm/

It goes through your entire library.
So you can just copy&paste, and alphabetize (http://alphabetizer.flap.tv/), and have a list of it. It's your charts/library, without all the data/numbers.

[quote][b][user]andymydear[/user][/b] said: I love http://mcm69.org.ua/lastfm/ It goes through your entire library. So you can just copy&paste, and alphabetize (http://alphabetizer.flap.tv/), and have a list of it. It's your charts/library, without all the data/numbers.[/quote]

Permalink Quote
- CrybKeeper said...
- Subscriber
- 15 Jan 2010, 01:45
+1 from me :)

Better Similars? Play Artists Custom Tag Radios: ellsbeth, world versus me, suicide sanctum, george ellias, dig jelly, starside casino, sharelle, el vrother, the madeleine haze
COOL Groups @ Lastfm: Skiye Sounds Next Event: Prog Rock 2012
Music:, The Madeleine Haze @ LastFM, Skiye@LastFM, Ellsbeth@LastFM, World Versus Me@LastFM, DigJelly@LastFM, Level-C@LastFM, Woolgather@LastFM, Lunarium@LastFM

[quote][b][user]CrybKeeper[/user][/b] said: +1 from me :)[/quote]

Permalink Quote
- CrookedSmile12 said...
- User
- 15 Jan 2010, 11:49
I'd love to have that feature, too!

[quote][b][user]CrookedSmile12[/user][/b] said: I'd love to have that feature, too![/quote]

Permalink Quote
- toc-rox said...
- User
- 15 Jan 2010, 14:56
Maybe helpful:

How to collect your scrobbling history:
perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe

How to collect your music library (tracks):
perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe

Works on Windows, Unix and OS X.
And you can do much more ...

Link to utility and documentation: lfmCOL.pl

[quote][b][user]toc-rox[/user][/b] said: Maybe helpful: How to collect your scrobbling history: perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe How to collect your music library (tracks): perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe Works on Windows, Unix and OS X. And you can do much more ... Link to utility and documentation: [url=http://www.easyclasspage.de/lastfm/seite-12.html]lfmCOL.pl[/url] [/quote]
Edited by toc-rox on 22 Jan 2010, 10:45

Permalink Quote
- JustSomeOldJoe said...
- User
- 15 Jan 2010, 17:29
Thanks, Klaus... I was actually going to throw up a link to your tool.

Folks, if you want to export your lib -- and you should -- get yourself over to toc-rox's page, download his lfmCOL tool, and run it. It's well doc'd, takes minimal effort, and it works!

[quote][b][user]JustSomeOldJoe[/user][/b] said: Thanks, Klaus... I was actually going to throw up a link to your tool. Folks, if you want to export your lib -- and you should -- get yourself over to toc-rox's page, download his lfmCOL tool, and run it. It's well doc'd, takes minimal effort, and it works![/quote]

Permalink Quote
- [Deleted user] said...
- User
- 15 Jan 2010, 18:19
Ooh! Bookmarking this one to check out at the weekend. Thanks!

[quote][b][user][/user][/b] said: Ooh! Bookmarking this one to check out at the weekend. Thanks![/quote]

Permalink Quote
- Erkan-Yilmaz said...
- User
- 11 Jul 2010, 10:00
short feedback on lfmCOL.pl:

for 139 library pages (ca. 2500 artists) I got a 5.3 MB xml file with:
perl lfmCOL.pl -xmlfile=Erkan.xml method=library.getTracks user=Erkan-Yilmaz

perceived problems so far:

1. missing packages at first start:
Can't locate XML/Simple.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at lfmCOL.pl line 52.
BEGIN failed--compilation aborted at lfmCOL.pl line 52.

solvable with installing missing package: perl -MCPAN -e 'install XML::Simple'

2. not complete library exported (?)
atm I have 144 pages, but the tool just read 139
I guess this may be due to a database not being yet synced? must check

test system:
download version: lfmCOL.pl - Generic last.fm Data Collector (last.fm -> xml), Rel. 0.4.0 - 2010-02-10
Debian 5.0.5 (lenny64)
perl 5.10.0

last.fm tools: music soulmates, recommender for: bands, last.fm groups, trends, ...

[quote][b][user]Erkan-Yilmaz[/user][/b] said: short feedback on lfmCOL.pl: for 139 library pages (ca. 2500 artists) I got a 5.3 MB xml file with: perl lfmCOL.pl -xmlfile=Erkan.xml method=library.getTracks user=Erkan-Yilmaz perceived problems so far: 1. missing packages at first start: Can't locate XML/Simple.pm in @INC (@INC contains: /etc/perl /usr/local/lib/perl/5.10.0 /usr/local/share/perl/5.10.0 /usr/lib/perl5 /usr/share/perl5 /usr/lib/perl/5.10 /usr/share/perl/5.10 /usr/local/lib/site_perl .) at lfmCOL.pl line 52. BEGIN failed--compilation aborted at lfmCOL.pl line 52. solvable with installing missing package: perl -MCPAN -e 'install XML::Simple' 2. not complete library exported (?) atm I have 144 pages, but the tool just read 139 I guess this may be due to a database not being yet synced? must check test system: [url=http://www.easyclasspage.de/lastfm/seite-12.html]download[/url] version: lfmCOL.pl - Generic last.fm Data Collector (last.fm -> xml), Rel. 0.4.0 - 2010-02-10 Debian 5.0.5 (lenny64) perl 5.10.0[/quote]

Permalink Quote
- epiciocchi said...
- User
- 13 Aug 2010, 13:21
toc-rox said:
Maybe helpful:

How to collect your scrobbling history:
perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe

How to collect your music library (tracks):
perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe

Works on Windows, Unix and OS X.
And you can do much more ...

Link to utility and documentation: lfmCOL.pl

lfmCOL sounds great. I have tried to install it but I failed (see details below).

Any tip for a non-IT expert please?

Many thanks,

E.

-------------

I am using Windows Vista.

I have
- followed the link and read the documentation
- downloaded and unzipped lfmCOL.pl,
- downloaded and installed ActivePerl,
- typed in the following text in command prompt to collect the tracks from my library:
perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi

but it replied:
can't open perl script "lfmCOL.pl": No such file or directory

Mind you, I did not understand the following paragraph from the instructions, so maybe I missed a step to do with unicode (all I did was to type "mode con" in command prompt, and it showed: Code Page 850).

Technical notes:
- The utility comes with a configuration file (lfmCOL.cfg).
- You typically configure your "terminal encoding" and "proxy setting".
- lfmCOL.pl has full unicode (utf8) support.
- You have to configure the terminal encoding according to your codepage setting.
- Windows: eg. "cp850" / use "mode con" to find out your codepage setting.
- Linux / OS X: eg. "utf8" / have a look at your terminal configuration.
- Proxy support and configuration is possible.
- HTTP timeout configuration ist possible.

[quote][b][user]epiciocchi[/user][/b] said: [quote][b][user]toc-rox[/user][/b] said: Maybe helpful: How to collect your scrobbling history: perl lfmCOL.pl -xmlfile=JoesRecentTracks.xml method=user.getRecentTracks limit=50 user=JustSomeOldJoe How to collect your music library (tracks): perl lfmCOL.pl -xmlfile=JoesMusicLibrary.xml method=library.getTracks user=JustSomeOldJoe Works on Windows, Unix and OS X. And you can do much more ... Link to utility and documentation: [url=http://www.easyclasspage.de/lastfm/seite-12.html]lfmCOL.pl[/url] [/quote] lfmCOL sounds great. I have tried to install it but I failed (see details below). Any tip for a non-IT expert please? Many thanks, E. ------------- I am using Windows Vista. I have - followed the link and read the documentation - downloaded and unzipped lfmCOL.pl, - downloaded and installed ActivePerl, - typed in the following text in command prompt to collect the tracks from my library: perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi but it replied: can't open perl script "lfmCOL.pl": No such file or directory Mind you, I did not understand the following paragraph from the instructions, so maybe I missed a step to do with unicode (all I did was to type "mode con" in command prompt, and it showed: Code Page 850). Technical notes: - The utility comes with a configuration file (lfmCOL.cfg). - You typically configure your "terminal encoding" and "proxy setting". - lfmCOL.pl has full unicode (utf8) support. - You have to configure the terminal encoding according to your codepage setting. - Windows: eg. "cp850" / use "mode con" to find out your codepage setting. - Linux / OS X: eg. "utf8" / have a look at your terminal configuration. - Proxy support and configuration is possible. - HTTP timeout configuration ist possible. [/quote]

Permalink Quote
- percy74 said...
- User
- 13 Aug 2010, 15:53
You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in.

For example, if the file is in

C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210

you type this:

cd C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210

Then press Enter and you are now in the folder where the file is. Then run the program as you did before:

perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi

[quote][b][user]percy74[/user][/b] said: You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in. For example, if the file is in C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210 you type this: [b]cd C:\Documents and Settings\YourName\My Documents\lfmCOL-20100210[/b] Then press Enter and you are now in the folder where the file is. Then run the program as you did before: perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi [/quote]

Permalink Quote
- epiciocchi said...
- User
- 13 Aug 2010, 16:23
percy74 said:
You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in.

For example, if the file is in

C:\Documents and Settings\YourName\My Documents\lfmCOL20091107

you type this:

cd C:\Documents and Settings\YourName\My Documents\lfmCOL20091107

Then press Enter and you are now in the folder where the file is. Then run the program as you did before:

perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi

Thanks very much. I am getting really excited. I am now in the right directory. But I get the reply:
Error opening logfile "lfmCOL.log" : Permission denied

Any idea please? I feel I am near...

E.

[quote][b][user]epiciocchi[/user][/b] said: [quote][b][user]percy74[/user][/b] said: You've almost got it. You just need to change the directory to the folder where the file is located. To do that type "cd" followed by a space and the directory the file is in. For example, if the file is in C:\Documents and Settings\YourName\My Documents\lfmCOL20091107 you type this: [b]cd C:\Documents and Settings\YourName\My Documents\lfmCOL20091107[/b] Then press Enter and you are now in the folder where the file is. Then run the program as you did before: perl lfmCOL.pl -xmlfile=epiciocchiMusicLibrary.xml method=library.getTracks user=epiciocchi [/quote] Thanks very much. I am getting really excited. I am now in the right directory. But I get the reply: Error opening logfile "lfmCOL.log" : Permission denied Any idea please? I feel I am near... E.[/quote]

Permalink Quote