Ashley Williamson and I were supposed to be in Montreal in May for Partition/Ensemble 2024, this year’s joint conference of the Canadian Association for Theatre Research and la Société québécoise d’études théâtrale. We were going to do a workshop on Theatre Science.
The in-person conference was cancelled, of course, and instead they’re having a relaxed digital conference. It started on Monday and runs to 09 August: everyone who was going to do something has instead either posted something online (a PDF, a narrated presentation, a video) or (in a few cases) will be doing a live talk. For example, the panel discussion on Theatre and Climate Change was done a little while ago in a video call, recorded and then transcribed. All the conference participants can watch it and leave comments. (An advantage of moving online is that all the content is available for free for everyone else, too.)
Ashley and I decided we’d do a “thirty minute immersive audio experience,” which we later realized was really a “forty minute radio play.” It is made of seventeen scenes that start with the conception of the idea and end with a brief excerpt of Experiment One, the full performance. There are three audio environments: flat narration (for facts), phone conversations, and meetings in the Great Hall of the Arts and Letters Club (which we recorded over Zoom; I added room tone from recordings I’d made last year).
See the Theatre Science site for the downloads. An MP3 and the full script are available (both under a CC BY license).
Screenshot of Zoom recording session
Only participants will be able to leave comments on the conference web site, but feel free to email Ashley and me about it if you like.
黑洞加速器打不开了-快柠檬加速器
jugglingmathematics老王2.2.11最新版
I was sorry to hear that Ron Graham, the great mathematician and juggler, died last week. I first heard of him decades ago, in my teens, and he seemed amazing: he did math and juggled and was a magician and helped Paul Erdős and did many, many other things. I never met him or even saw him in person, but he was always out there as an inspiration. Just last month I read Magical Mathematics: The Mathematical Ideas That Animate Great Magic Tricks, which he wrote with Persi Diaconis.
A remarkable life, and one from which we can all learn lessons.
Here’s a video clip from 1980 where he talks about juggling and math.
黑洞加速器打不开了-快柠檬加速器
covid19wychwood.barns
Two months ago I wrote about Clover Roads Organic Farm as one of the vendors I missed when the Wychwood Barns Farmer’s Market closed. I wrote them a letter … and heard back from John and Inge Crowther by email! And since then, I’ve got three orders of stuff from them. Here are some pictures.
Here’s a close-up of the rosemary, sage and soaps (one of which is scented with rosemary). Nice smells!
老王vpm2.2.11下载安卓版
In the second order I got much the same stuff. The eggs are interesting because there’s a mix of shell colours and sizes (from large on up, I’d guess—I’m no expert on egg sizes, but any one of them suits me for breakfast). I also got more soap to stock up.
Clover Roads produce
I also got honey and some dried herbs, including herbes de Provences, which I’ve never used but am keen to try out.
Clover Roads produce
It’s incredible the difference between fresh lettuce and store-bought stuff. Those plastic tubs of organic lettuce at Loblaw’s seem virtuous, but on the one hand you’re just making price-fixing billionaires richer and on the other the lettuce goes all manky in a couple of days. Lettuce fresh from a market, picked that day or the day before, stays fresh forever.
Yesterday I met the Crowthers for a pick-up over by the Barns in the mid-afternoon, during a blasting thunderstorm which, fate would have it, began just before I left home and ended just after I got back. I was soaked through, but me and the onions all dried off easily enough. Tonight I made a nice salad with Clover Roads lettuce, onions and cucumbers and some cold-smoked Arctic char I’d got from another Wychwood Barns vendor a few months ago and kept frozen, with a dressing based on yogourt and Clover Roads herbed mustard. Delicious.
Further to last week’s update of Jekyll CO₂, my plugin for the web site generator Jekyll, that shows current atmospheric CO₂ data: I was hacking on it some more and along with some refactoring it can now optionally use an option in Jekyll’s configuration file, _config.yml, like so:
co2:
years: 0
Setting years there determines how many years back the CO₂ comparison goes. By default it’s 50, but it can be changed to 10 or 25 for example. It cannot go back before March 1958, when the Mauna Loa data begins.
If years is set to 0, the comparison is to March 1958. This is how I’m using it now.
Jekyll CO₂ screenshot
The June data isn’t available yet, so it’s comparing May 2024 to March 1958. Atmospheric CO₂ has gone up 101.36 ppm from 315.71 to 417.07, for a change of 32.1%.
The plugin needs more refactoring, but it works, so I’m going to leave it for a while.
黑洞加速器打不开了-快柠檬加速器
老王2.2.11下载安卓版codejekyll
I updated Jekyll CO₂, my plugin for the web site generator Jekyll, that shows current atmospheric CO₂ data. You can see it in the right-hand bar on this site, down towards the bottom. It looks like this:
Screenshot of Jekyll CO₂ box
It’s showing May data because as I write that is the latest month for which data is available from the NOAA’s Earth System Research Laboratory.
It shows the current CO₂ concentration, the value fifty years ago (year range is configurable), the absolute increase and the percentage change.
I made this plugin in June 2014, at the end of my previous sabbatical, and it was text only. In October that year I python无网安装psycopg2 - 软件老王 - 博客园:2021-7-13 · 1. 问题描述 python项目要获取greenplum数据库数据，gp底层是postgresql，需要使用python的第三方工具包psycopg2操作数据库，但是问题是服务器上没有网络，无法在线安装，试了N中方法，最后才用whl安装成功。 2. 解决方案 2.1 官网下载whl, but over time I realized that just isn’t an effective way of visualizing this data in this context. All it ever showed was a little staircase going up bit by bit. You could hover over a step to see the number, but who’d do that?
Now it tells you the numbers right up front. Comparing to 50 years ago isn’t the best possible, but it works with the data available, and it’s a start.
The raw data is stored in Jekyll’s _data_ directory, where Jekyll sees it and groks it automatically. I don’t use data files yet, but now it’s possible, though I’m not sure how. It would be possible to indicate on every page how much the CO₂ has changed since the page was created, but you’d need to regenerate the site at least once a month to make that reasonable. (That’s the “problem” with static site generators as opposed to WordPress or Drupal, at least without using Javascript to do live content on a page.)
(There’s one improvement needed: fail gracefully if the NOAA’s web site is unavailable. This happens when there’s a government shutdown in the States because they haven’t passed a budget. Mind-boggling.)
See also GHG.EARTH, which is right up to date.
Screenshot of GHG.EARTH
黑洞加速器打不开了-快柠檬加速器
solidarityyork
When I started working at York University Libraries in 2007 I was amazed at how slowly everything went. I came from the private sector: for over a decade I’d worked at internet access providers and a couple of tech startups. Things moved fast there, of course. At York, in the libraries, sometimes it would take months just to talk to someone. A lot was handled with committees, and if someone said they’d have something ready for the committee meeting next month, and then didn’t, there wasn’t much anyone else could do, so we’d wait until the next month. And if there was a plan to do something over the summer to have it ready for September, but there was a problem along the way, the default would be to delay for an entire year to the next September.
Sometimes the slowness is good, certainly. The long time scale universities have helps makes them important institutions in society. Small units can move quickly, and in emergencies like the Covid-19 pandemic things get done very fast. But …
How about a decade? We’re now getting near the end of ten years of work on something I am very confident will soon end with nothing changing.
Divider image of peeling paint on an old door
It’s a document: Criteria and Procedures for Promotion and Continuing Appointments of Professional Librarians and Archivists, which is the tenure and promotion policy for librarians and archivists in the York University Faculty Association, our union.
CPPCAPLA is part of our collective agreement. It was first agreed when librarians joined the union in 1978, and left alone until 2009 when some very minor procedural changes were made. (Meanwhile, the faculty T&P policy was updated and refined in regular bargaining every three years.)
With those changes made there was some appetite for more, because the document was over thirty years old.
Peeling paint
老王vpm2.2.11下载安卓版
2010: First try starts A working group is formed to draft some changes to one part of CPPCAPLA, about promotion to Senior Librarian. One colleague says the whole thing should be revised and modelled more along the faculty process, but this is ignored. (She was right, though I didn’t see it at the time; this is what we ended up doing.)
2011: First try ends YUFA rejected our proposed changes and would not take them forward. I think an experienced YUFA staffer agreed we should renegotiate the whole thing, and there was no point in small changes. My notes from back then aren’t nearly as detailed as I keep now, but I did write, “Back it comes to the library and the [union] chapter … cripes, this will take a couple of years by the time it’s done.”
2013: Discussion Some discussion about getting back to the criteria.
2014: Discussion More discussion in the librarian and archivist union chapter. YUFA advises us that one way to handle this would be to get a memorandum of agreement (MOA) in bargaining to set up a side table to negotiate new language. Something this detailed and complex can’t be handled in regular bargaining.
2015: Preparation We get 老王2.2.11下载安卓版 revisions into the YUFA primary negotiating positions. In the summer, the chapter sets up Working Group 1 to look at what areas of the document should be changed. In the fall the chapter votes on its recommendations and creates Working Group 2 to draft a new document.
2016: Bargaining The new YUFA collective agreement is ratified. New article 7.10 says: “Within three months of the ratification of this Agreement, the Parties shall name an equal number of representatives to sit on a joint committee to revise the existing Criteria and Procedures for Promotion and Continuing Appointments of Librarians and Archivists. The Joint Committee shall report to the JCOAA every six (6) months or on request from either party and will submit its proposed revisions to the Employer and the Association for approval or ratification.” (Thus setting up a side table through collective agreement language directly, not an MOA.) The bargaining teams form later in the year—I was one of three librarians working with an expert union staffer on the YUFA side of the table.
2017: Bargaining In January the chapter unanimously passes Working Group 2’s draft language. Bargaining begins in March. We have six bargaining sessions that year. The Employer cancels ten others.
2018: Bargaining Bargaining continues (we met off campus during the longest post-secondary strike in Canadian history) with sixteen sessions. The Employer cancels four, we cancel one, and there’s one mutual.
旋风加速器 Bargaining session #23 in January is the last. We sign a memorandum of settlement with the new language. There is much internal chapter debate about whether three clauses (on criteria for research considered for promotion) are good or not. In March there is a general membership meeting and a ratification vote: vote yes or vote no. The MOS is voted down. In May the chapter meets with some YUFA executive members to discuss next steps. In June, YUFA writes to the Employer setting out three options and asks if any are of interest. We hope there is some way of salvaging something.
2024: Discussion In February the Employer responds to one option with a tentative suggestion of a possible way forward. In September the union chapter will meet with some Exec members to discuss the suggestion. (That’s right: in September 2024 we discuss a response to a proposal sent in June 2024.)
Peeling paint
There are three potential outcomes of that meeting. The first (everyone likes the Employer’s suggestion) won’t happen. The second will halt everything at that meeting and the third will be rejected by the Employer.
Ten years of work—I can’t imagine how many people put in how many hours on this—that I am regretfully confident will end up achieving nothing. And it will be another decade before there’s any appetite for going back at CPPCAPLA.
(These are my opinions only and I am not speaking for anyone I’ve worked with on anything about CPPCAPLA.)
Peeling paint
黑洞加速器打不开了-快柠檬加速器
codeunix
I have that complex feeling of being satisfied that I solved a problem but mildly dissatisfied because the problem was very small and I probably spent too long on it, but nevertheless satisfied that a very small part of my life (one hopes for many years to come) will be a tiny bit better.
Was it worth it? The likelihood is greater if I share what I did. So it goes with customizing one’s Unix environment, and life overall.
It all started when I realized that source-highlight doesn’t do syntax highlighting on Markdown files. That was a surprise, because Markdown is so popular. Pygments, on the other hand, does. And it does many more file formats, including JSON.
After a bunch of work, I got it so that if pygmentize is available on the system, it’s used for highlighting files when viewed with less, or if source-highlight is there then it falls back to that, or if neither is available, just plain old less on its own is used. If lessfile is on the system (it’s on all Linux systems, but not on a FreeBSD server I use) then that is mixed in for powerful magic.
In my .bashrc this sets things up:
# lessfile is a nice incantation that lets less open up tar and gz files
# and so on and show you what's inside.
if command -v lessfile > /dev/null 2>&1; then
eval "$(lessfile)"
# This sets LESSOPEN and will pick up on ~/.lessfilter.
else
# Fall back to do the best we can.
export LESSOPEN="| ~/.lessfilter %s"
fi
# If any syntax highlighters are available, use them.
# pygmentize does more, but source-highlight is still good.
if command -v pygmentize > /dev/null 2>&1; then
export LESSCOLOURIZER="pygmentize -f terminal"
elif command -v source-highlight > /dev/null 2>&1; then
export LESSCOLOURIZER="source-highlight --failsafe --infer-lang -f esc --style-file=esc.style -i"
fi
# Pass through raw ANSI colour escape sequences. In other words, make colourizing work.
export LESS=' -R '
My .lessfilter has this:
if [ -v LESSCOLOURIZER ]; then
case "$1" in
# Could have .bashrc in here, but mine seems to mess it up, perhaps because of escape sequences.
# pygmentize can handle many more file types; this is just what I want.
.bash_|*.bat|*.bib|*.c|Changelog|*.diff|Gemfile|\
*.gemspec|*.h|*.ini|*.js|*.json|*.jsonld|\
Makefile|*.md|*.patch|*.php|*.pl|*.pm|*.py|Rakefile|\
*.rake|*.rb|*.R|*.Rprofile|*.rss|*.sh|*.sql|*.xsl|\
*.tex|*.toc|*.yaml|*.yml)
$LESSCOLOURIZER "$1" ;;
*.pdf)
if command -v pdftotext > /dev/null 2>&1 ; then pdftotext -layout "$1" -
else echo "No pdftotext available; try installing poppler-utils"; fi ;;
*)
# Pass through to lessfile
exit 1
esac;
fi
# Hand whatever is left over to lessfile
exit 1
Now I can use less on binaries like tarballs and zip files (where it shows me a file listing) and PDFs (where it shows me the text), and on text files wherever possible it adds syntax highlighting. On any system where one part of the tool set isn’t available, it will fall back to something
simpler, in the end arriving at just plain old unadorned less.
This is part of Conforguration. It will probably work on any Unix-like system (perhaps including macOS, but I don’t know).
Neither source-highlight or Pygments handles Org files, which surprises me. Maybe I can figure out a recipe to fix that.
I never run less, I always run 老王加速器2.2.11. The habit was set decades ago, and it’s easier to alias than switch.
UPDATE (25 June 2024): Fixed shell redirection error in 老王2.2.11下载安卓版.
黑洞加速器打不开了-快柠檬加速器
老王vpm2.28下载安卓版privacy
Today I upgraded to the latest version of Matomo (moving up from an older version from when it was called Piwik): that’s the open, non-proprietary self-controlled more private equivalent of Google Analytics. The upgrade had been on my to do list for over a year. It didn’t take long, even with the renaming, which meant I needed to change some URLs in Javascript footers that put a tracker on every page.
I got it all working and looked at the fresh Matomo interface. It tells me: not many people look at my web site; the three most popular pages are an out of date post from 2012 (Counting and aggregating in R), [1.11.2-1.5.2][Waila——我看什么呢][永更] - Mod发布 ...:2021-5-16 · [1.11.2-1.5.2][Waila——我看什么呢][永更] - 本帖最后由 afkavril 于 2021-5-16 13:45 编辑 Waila（What Am I Looking At）我看什么呢？这个模组是用来显示物品的信息如图从这俩张图可众看出来当你的鼠标指向该物 ... and this list of definitions and principles from Ranganathan’s Prolegomena to Library Classification; and Freedom of information request for York University eresource costs completed has had over 400 views since posted two weeks ago, which is very nice to see.
Screenshot of Matomo report on this site
I hadn’t looked at the stats in over a year. I don’t use them. I don’t need them. Why am I tracking users on my site anyway? There is no reason. Becky Yoose and other experts would ask me: Why are you recording personal information you’re not using?
So I turned it off. I went even further: I disabled logging on the web server.
I added a privacy statement to the sidebar: “Zero logging: As of 23 June 2024, no tracking is done on this web site and no logs are kept. I know absolutely nothing about how the site is used.” I also turned off logging on 老王v p n (which I didn’t even know I’d set up: I thought it was like GHG.EARTH and STAPLR, where there’s no tracking).
Matomo is an excellent application! It’s under the GPL, the code is on GitHub, it’s easy to install and use … I like everything about it. I just don’t need it. (And now I don’t have to ever upgrade it again.)
Zero logging is punk.
黑洞加速器打不开了-快柠檬加速器
code4libemacsfippalibrariesyork
Abstract
The data I requested in March 2018 through provincial freedom of information legislation was supplied last month, and the costs paid by York University Libraries for electronic resources in fiscal years 2017 and 2018 are now public: York University Libraries eresource costs (DOI: 10.5683/SP2/K1XCLU). There are three files: the data (extracted by me; available as CSV or in other formats; it is not complete, there are some redactions in what I was given), an R Markdown file with a basic R script to do some simple analysis, and the PDF released to me by York that is the responsive record.
Librarian Bill prepared the data that was released to Civilian Bill, who turned it into a more usable form and gave it back to Librarian Bill to post in York University’s official data repository. Both of us are pleased that this can be added to the list of York University librarian and archivist research outputs, and that it stands as an example of York University Libraries’ commitment to open data.
老王2.2.11下载安卓版
I first wrote about this on 22 August 2018, in Freedom of information request for York University eresource costs denied.
I’m a librarian at York University Libraries in Toronto. Let’s call me Librarian Bill when I’m there. At home I’m Civilian Bill, and last month Civilian Bill put in a freedom of information request to York University for the amounts the Libraries spent on electronic resources in fiscal years 2017 and 2018. Civilian Bill knew the information exists because Librarian Bill prepared a spreadsheet with precisely those costs.
York has refused to release the data. Their response is “withhold in full.”
I made this request under Ontario’s Freedom of Information and Protection of Privacy Act (FIPPA) because I was inspired by 老王 v p v官网’s talk 安卓老王VP* V2.2.11 最新去广告绿色版下载 - 峰哥博客:2021-2-25 · 安卓酷我音乐V9.1.0.2 VIP豪华会员直装破解版 免登陆下载试听无损音乐！ 2021-2-23 银联云闪付APP扫银联、云闪付标识活动最高领2021元无门槛抵扣红包！ 2021-1-5 格式工厂FormatFactory V4.5.0 最新去广告绿色版 2021-12-8 2021 12月最新可用酸酸乳ssr. She said:
My challenge to all of you here today is to go back to your libraries and start shining a light into the deep recesses of the databases you use…. Do you know how much your library spends on the products you use every day? Are you able to speak confidently on how those prices have fluctuated over time and why they have? If something doesn’t work the way that we think it should or as it is advertised, why is an increase in price—no matter how modest—a given? These are all questions that we need to start asking more consistently. Also, thank you, Simon Fraser University and University of Alberta, for taking the lead on sharing your expenditure data.
In July Civilian Bill filed my request. It was denied. Civilian Bill appealed and eventually won. As reported on 14 March 2024 in Freedom of information appeal for York University eresource costs successful:
Seven months later Civilian Bill and Librarian Bill am very happy to report the data will be released.
York University said in their response:
As a result of mediation with [the mediator] at the Information and Privacy Commission York University would like to suggest a possible resolution to Appeal PA-18-403. York University is committing the resources necessary to schedule the release of this information with a goal of April 30, 2024 for the completion of this project. It is hoped that this will resolve the appeal.
I marked 30 April 2024 in my calendar.
The deadline approaches
Summer and fall of 2024 came and went … the days grew short … winter began … then the days began to lengthen. By February the change was really noticeable. My mood brightened. Spring would be here soon. Finally! And with spring would come the FIPPA response. I waited quietly. Would it happen? It? The final absurd irony?
On 04 March 2024 I received an official email from Patti Ryan, director of 恶搞隔壁老王破解版下载_恶搞隔壁老王无限金币内购破解版1 ...:2021-6-9 · 恶搞隔壁老王破解版是一款趣味十足的街机休闲类游戏！这款游戏整体的画面感还是非常值得大家前来尝试一番的，卡通的画面让所有的玩家感受到趣味；解锁超多的道具，完成各种不同的特殊任务体系，拥有着更多的奖励 (my department, called CDA), working through channels. The email said in part:
I am writing to request your help with doing a final check of the eResources cost data for F2017 and F2018 in order to prepare for their
release to the privacy office. Recall that this has been requested from the DLO [Dean of Libraries’ Office] in connection with a freedom of information request, but is also part of CDA’s workplan.
Yes! It happened! Librarian Bill was being asked to prepare the data for release to Civilian Bill! We was overjoyed. If you ever meet one of the Bills in person, let him tell you about this, because I love talking about it.
I responded immediately to confirm that of course I would work on this. This is provincial legislation we’re talking about! And open data! I was pleased to see the work fitted with Goal 1 of the Libraries’ 2016–2024 strategic plan: “Advance the University Community’s Evolving Engagement with Open Scholarship.” It’s great when something you really believe in is part of your institution’s strategic plan.
By early April Librarian Bill finished up a new spreadsheet containing all the data. I was directed to compare the data to the 钓鱼王老李安卓版下载_钓鱼王老李 v1.1.0手机版下载 - D9下载站:2021-8-11 · 《钓鱼王老李：Fisherman Fisher》是一款放置类的游戏，玩法比较轻松，只需不断买入卖出升级配置，老李、老张众及老赵，为什么没有老王呢？ D9下载站：打造最安全放心的免费绿色软件下载站！ to double check anything redacted there but not in what I had prepared. The eresources librarian, Aaron Lupton, checked any final missing non-disclosure details with vendors. With all that done, I handed it back through channels and waited.
老王 v p v官网
The end of April arrived. May began. May continued. I waited. Nothing.
On 11 May Civilian Bill emailed York’s Information and Privacy Office to ask about the status of the release. That email never arrived, but Librarian Bill followed up on 19 May and got a quick response saying the release had been posted earlier in the month, but mail delivery is slow and we could have a PDF by email. I waited over the weekend to see if the envelope would arrive, but it didn’t. On 26 May the response was supplied as a PDF.
The envelope has still not arrived in the post.
The responsive record
This is the PDF I got: Cost_release_data_F2017_F2018.pdf. Here is the first page.
老王app下载2.2.8
Civilian Bill was very pleased! To Librarian Bill this was nothing new, of course.
Having this PDF made my work a lot easier, because it’s a live PDF with structured data in side it, not just a static image. Whoever got the spreadsheet I had prepared had turned it into a PDF, and all the columns and rows and cells were still in it. The printed version of this PDF on paper would have required a lot of tedious work scanning and OCRing and cleaning.
Of course, you might ask, Why didn’t they send the spreadsheet? Well, they have their processes in the Information and Privacy Office, and if they deal with PDFs, fair enough. The real question is: Why didn’t York University Libraries release this data back in 2017?
I had a PDF containing easily extracted data, which was going to save me a lot of time, and I would work with it.
Starting to extract the data
I thought that pdf2txt would be the easiest way to get the data out. I’d used it before (so I thought) and it had worked well (so I thought). It’s part of the PDFMiner project, but after a bunch of fiddling I couldn’t get beyond it dumping all the data out in one mixed-up column, which was no good.
Doing it manually seemed to be the only way. I hoped I could copy and paste column by column from the PDF into a file, but that got messed up on most pages because there were some cells with line breaks that made the selection veer over into the next column right. For example, here I’m selecting the F2017 column (second from right) from the bottom up. All fine so far.
Selecting text in a column
But when I get to the line where the title is on two lines inside its cell, the F2018 column (far right) starts getting picked up instead.
Selection moves into the wrong column
Every time this happened I had to treat the row specially. On some the pages this meant a fair bit of fiddly work. I got six pages done one day then put it aside. (I was doing all this in Emacs and Org, which made the work quick, but wait until you see what happened next.)
The day after next I woke up in the middle of the night and thought, “I should use pdf2txt to pull the data out.” Then I remembered I’d tried it and it hadn’t worked. But something wasn’t right. I knew I’d extracted data from PDFs where the page structure was maintained. Aha! That was with pdftotext, an entirely different program, that is part of Poppler! Yes, it is confusing. I hope no one writes pdf2text or pdftotxt.
pdftotext comes with a 老王2.2.11最新版 option:
Maintain (as best as possible) the original physical layout of the text. The default is to ´undo’ physical layout (columns, hyphenation, etc.) and output the text in reading order.
$ pdftotext Cost_release_data_F2017_F2018.pdf
$ head Cost_release_data_F2017_F2018.txt
These costs include all e-resources purchased by and licensed to York University Libraries (YUL)for the fiscal periods (May to April)for the
years indicated. Costs indicated are in Canadian dollars paid at 老王2.2.11最新版invoice was processed by YUL. Costs are exclusive of taxes.
Where cost information is indicated as “Redacted” for a product, this indicates that a non-disclosure clause prohibits release of cost
information. Where cost information is indicated as “NA”, no costs were incurred for the fiscal year period.
vendor
(miscellaneous)
ACM
Adam Matthew Digital
Adam Matthew Digital
Adam Matthew Digital
$ pdftotext -layout Cost_release_data_F2017_F2018.pdf
$ 老王2.2.11下载安卓版Cost_release_data_F2017_F2018.txt
These costs include all e-resources purchased by and licensed to York University Libraries (YUL)老王v p nthe fiscal periods (May to April)for the
years indicated. Costs indicated are in Canadian dollars paid at time invoice was processed by YUL. Costs are exclusive of taxes.
Where cost information is indicated as “Redacted” 老王2.2.11下载a product, this indicates that a non-disclosure clause prohibits release of cost
information. Where cost information is indicated as “NA”, no costs were incurred for the fiscal year period.
vendor title 2016-2017 2017-2018
(miscellaneous) Open Access NA 43187
ACM ACM Digital Library 5780 6017
Adam Matthew Digital American Consumer Culture REDACTED REDACTED
Now I had a text file with ragged but more or less even columns of data.
Emacs and Org make it easy
I’ve often written about how much I like the text editor Emacs and within it Org mode. (My Emacs configuration files are available if you want to see the details.)
Whenever I’m dealing with text, I use Emacs. If that text (including numbers) is structured as a table, I use Org. Its table editor looks confusing in the documentation, but simple use is a lot easier than it looks, and it’s very powerful and really helpful.
In this case, the best thing about the tables (think: spreadsheets) is that it marks the columns with the pipe symbol (“|”) and if you enter them ragged it will align them to fit. If you start with
With the output from 老王2.2.11最新版, I had one text file with fourteen sections (one per original page) of somewhat ragged columns of data. I used the Emacs rectangle commands to add columns of pipe symbols into the raw text, then copy the block of ragged text into an Org table, where it would be nicely formatted automatically.
Here’s what it looks like to start.
Emacs screenshot 1: raw text
Here I’ve added four columns of pipes (using C-x <SPC> to go into rectangle mark mode, which is super cool). They don’t all line up, but that’s OK.
老王加速器下载官网
Here I paste all that into an Org file. There’s a blank line between this and the nice-looking table above.
Emacs screenshot 1: raw text
I remove the blank line, hit TAB, and it all aligns.
Emacs screenshot 1: raw text
Beautiful! Then I use M-x org-table-export to write all that to a CSV file.
This is more Emacs information than most people need, but I want to show how powerful it is, and that a multipurpose tool like this can make life easier.
Dataverse
Now that the data was extracted, where should it go? Somewhere reliable … somewhere the data would be available forever, or close enough … somewhere not commercial … somewhere affiliated with York. The answer: the Scholars Portal Dataverse. Depositing your data explains how York researchers can use Dataverse. As it happens, the librarian in charge of York’s Dataverse has her office across from me in the library (back when we were in our offices). Minglu Wang asked a couple of questions and then set me up and sent me a long list of great resources about good data practices. She’s an expert on research data management and I strongly recommend anyone at York with data to preserve get in touch with her.
Librarian Bill now have my own dataverse and within it is the “Eresource costs” dataverse at the nice URL http://dataverse.scholarsportal.info/dataverse/eres.
老王vpm2.28下载安卓版
There’s 老王加速器下载官网 in the Dataverse that you can load into RStudio or the like, or you can just copy and paste the lines into an R session. (I do my R sessions inside Emacs with ESS and Org, which you probably predicted.) Here’s some of what it has.
First, load in the tidyverse (install it if it’s not already there).
Now get the data right out of Dataverse (skipping the step where you have to click to agree to abide by the CC BY license, because I haven’t found out how to turn it off):
## Get the data from the CSV.raw_costs<-read_csv("http://dataverse.scholarsportal.info/api/access/datafile/105969?format=original")## Turn it into a better (longer) data structure.## Replace all NAs with 0s while we're at it.costs<-raw_costs%>%pivot_longer(c("F2017","F2018"),names_to=老王app下载2.2.8,values_to="cost")%>%老王加速器下载官网(list(cost=0))## Pick out all the products where the cost is known.costs_known<-costs%>%filter(!cost==老王app下载2.2.8)%>%mutate(cost=as.numeric(cost))
This takes the “wide” format of the original data and makes it “long” and tidy. Notice how instead of “F2017” and “F2018” columns there’s one column with “year” that has the values of either 2017 or 2018.
ℝ>老王2.2.11下载ios# A tibble: 1,722 x 4vendortitleyearcost<chr><chr><chr><chr>1(miscellaneous)OpenAccessF201702(miscellaneous)OpenAccessF2018431873ACMACMDigitalLibraryF201757804ACMACMDigitalLibraryF201860175AdamMatthewDigitalAmericanConsumer老王下载地址官网老王 v p v官网老王v p nREDACTED6老王永久佛系MatthewDigital老王v p n老王vpm2.2.11下载安卓版Culture老王2.2.11下载安卓版F2018REDACTED7AdamMatthewDigital老王加速器2.2.11老王2.2.11最新版IF20171148Adam老王vpm2.28下载安卓版DigitalAmericanHistoryIF20181229AdamMatthewDigital老王加速器下载官网IndianHistoriesandCulturesF20179810老王加速器2.2.11Matthew老王加速器2.2.11AmericanIndian老王永久佛系andCulturesF2018105
## Short list of vendors where YUL spent the most.major_amount<-100000老王vpm2.2.11下载安卓版<-format(major_amount,big.mark=",",scientific=FALSE)major_vendors<-老王 v p v官网%>%filter(老王 v p v官网>major_amount)%>%pull(vendor)%>%unique()major_vendor_costs<-total_vendor_costs%>%filter(老王加速器下载官网%in%major_vendors)## The reorder function sorts the vendor list by total costs, which## makes the chart much more readable.【王老菊】奴隶阿飞的励志人生02_哔哩哔哩 (゜-゜)つロ 干杯 ...:2021-6-29 · 7.2万播放 · 120弹幕 2:09:04 王老菊教你杀将军01~03 怕上火暴王老菊 118.8万播放 · 2.1万弹幕 05:28 靠抄袭成为百万粉丝人气UP主！高能栗子王 62.6万播放 · 1739弹幕 12:09 【梗百科112】光溜溜的阿飞！荣耀属于天生战狂！真实最强新番完美落幕 ...major_vendor_costs%>%ggplot(aes(x=reorder(vendor,老王下载地址官网),y=total/老王app下载2.2.8,fill=老王永久佛系))+geom_col(position=老王2.2.11下载安卓版)+geom_label(aes(label=round(total/1000,-1)),老王加速器下载官网=position_dodge(0.9),show.legend=FALSE)+老王2.2.11下载安卓版()+老王加速器2.2.11labs(title=paste0("York University Libraries eresource costs: vendors paid over $",major_amount_pretty," total"),老王加速器subtitle=老王-备课中心:2021-3-1 · 【老王】备课资料列表 共 122 份资料 首页 | 上一页 | 1 2 3 | 下一页 | 尾页 50 份资料/页 转到第 页 《老王》课件7 - 2021/3/1,x="",y="$000 (rounded)",fill="",caption="William Denton <wdenton@yorku.ca>, CC BY")+theme_minimal()
Chart showing total amount spent on major vendors
In F2018 we know the Libraries paid Elsevier about $1.57 million. And that’s not including the sixteen products where the prices were redacted! The most expensive product was 老王佛系免费—no surprise—at about $1.4 million. The Elsevier F2018 annual report says it had an “adjusted operating profit margin” of 31.3% that year—yes, 31.3%—so of that $1.57 million that we know, $491,000 was pure profit for the company. The Libraries’ collections budget is (in this fiscal year) on the order of $13 million. That means close to 4% of the collections budget goes straight to Elsevier profit.
This is an example of a major issue in scholarly publishing. See SPARC’s Big Deal Cancellation Tracking for more about all this.
Here’s a chart counting redactions by vendor:
costs_redacted<-costs%>%filter(老王vpm2.2.11下载安卓版=="REDACTED")costs_redacted%>%count(vendor,year)%>%ggplot(aes(x=reorder(vendor,n),y=n,fill=year))+老王vpm2.28下载安卓版(position="dodge")+coord_flip()+labs(title="York University Libraries eresource costs: vendors with redacted costs",老王2.2.11最新版="Count of products where costs were redacted because of vendor license restrictions",x="",y="$000",fill="",caption="William Denton <wdenton@yorku.ca>, CC BY")+theme_minimal()
