We <3 web/text/image/etc. annotation!

2015-10-15

timfinnegan
02:50:39 AM

The online community for annotating James Joyce currently seems pretty fragmented


2015-10-16

timfinnegan
11:46:09 AM

amanda, will iu 1.0 support images?


mwidner
01:26:47 PM

I can’t speak for Amanda, but I can say that image annotation is a bit of a holy grail at the moment, particularly with the Annotator.js library she’s using.


edsu
02:22:05 PM

@mwidner have you seen Annotorious before? https://github.com/annotorious/annotorious


edsu
02:23:18 PM

it’s a plugin for annotator.js ; also I believe Mirador has image annotation baked in at some level http://iiif.github.io/mirador/


mwidner
02:25:18 PM

I have, but it doesn’t work with the latest 1.x branch of Annotator. You’d have to run an older version to use annotorius. the original idea was that they’d pick up development again once 2.0 was released, which it has been, but I haven’t heard of any progress on that front.


mwidner
02:25:45 PM

Mirador does not use annotator.js for image annotation, because the 1.x branch of Annotator is OA compliant, so the Stanford Libraries decided to develop their own image annotator.


edsu
02:25:57 PM

huh, ok — yeah, last time i looked at it was a few years ago — just didn’t think it was that much of a holy grail


mwidner
02:26:11 PM

I’m hoping that they’ll work with http://Hypothes.is to update the image annotator in Mirador so that it’s an Annotator.js plugin.


mwidner
02:26:57 PM

but even then, the version of Annotator that Amanda’s site uses is Annotator.js 1.x, so that would need updating. Probably not too much of a challenge for her site, but for Lacuna Stories (which is partially what hers is based on) has a lot of custom Annotator.js plugins that would need updating.


mwidner
02:27:58 PM

Getting a community together focused on image annotation working with Annotator.js is a goal of mine that I haven’t had much time to pursue lately.


edsu
02:27:58 PM

i see


mwidner
02:28:09 PM

Yeah… :disappointed:


edsu
02:28:34 PM

you have a lot invested in annotator.js i guess


edsu
02:29:22 PM

seems like since you are at stanford getting on the mirador train might be a good idea?


mwidner
02:29:23 PM

Well, I developed Lacuna Stories (http://www.lacunastories.com) and it uses Annotator.js. Plus, I like settling on a widely-used, open source library like that. The other options are not widely adopted. For example, Columbia’s MediaThread has image annotation in it, but afaik, that’s a home-grown solution.


mwidner
02:30:07 PM

Mirador is very focused on images (not surprising, considering that it’s a demo for IIIF). I don’t know that they have any plans for text annotation. I should ask again, though.


edsu
02:31:10 PM

oh, text too ; last i heard they were working on image based transcription


edsu
02:31:29 PM

but that’s sounds different from what you’d want


mwidner
02:32:22 PM

yeah, that sounds more like they’re doing a T-PEN-style approach. Not sure, though.


mwidner
02:32:28 PM

I haven’t talked to the developers about it in a while.


edsu
02:32:53 PM

i guess even stanford libraries is a big place :simple_smile:


mwidner
02:34:15 PM

It’s very big, especially the team that Drew is on: Digital Libraries Systems and Services (DLSS). I’m in a different part and actually don’t spend much time in the libraries proper because I’m embedded in a literature department.


mwidner
02:42:03 PM

thanks for bringing it up. I just wrote to Drew to see if there’s been any movement there. My guess is no. :simple_smile:


edsu
02:43:33 PM

there’s been movement, perhaps not the movement you are looking for


mwidner
02:46:10 PM

:simple_smile:


mwidner
02:46:16 PM

yeah, Mirador is great stuff.


literature_geek
03:48:24 PM

@timfinnegan: do you mean annotating the text with images?


mwidner
03:48:54 PM

@literature_geek: I don’t know if you’ve seen, but Lacuna Stories allows you to embed media in your annotations now: images, video, gifs


literature_geek
03:48:59 PM

I’m going to play around with https://github.com/danielcebrian/richText-annotator for adding rich text and images to annotations


literature_geek
03:49:37 PM

But I’m not sure yet how well it works or will integrate with Drupal. @mwidner and I have emailed a bit about getting that plugin to work with existing Drupal WYSIWYG


literature_geek
03:49:45 PM

@mwidner: Oh wow!


mwidner
03:49:52 PM

just grab the plugin I wrote. it’ll save you time. as soon as I get the install profile working properly, I’m going to open source everything.


mwidner
03:50:02 PM

just don’t want to release software people can’t install! :simple_smile:


literature_geek
03:51:49 PM

@mwidner: Thanks, that’s fantastic! Maybe after the release we could Skype? I’m waiting to hear back on two grant proposals to support more annotation coding, and it would be neat to compare wishlists and avoid redundancies.


mwidner
03:52:07 PM

sure thing!


mwidner
03:52:35 PM

I’ve added so many new features this past summer that when it’s finally publicly released, I’m calling it Lacuna Stories 2.0


mwidner
03:56:45 PM
Comment: A screenshot of a few of my favorite new features

timfinnegan
05:19:55 PM

has anyone seen a classification of annotation types, eg: link to sourcetext, bio-of-real-person, word-definition, illustrative-image, meta-commentary-image, etcetcetc?


mwidner
05:32:03 PM

In what context? I’ve seen a few examples of categorization of annotations. Lacuna Stories allows for that. We have “Comment”, “Question”, “Analyze”, and “Compare”, but it sounds like you’re looking for something more nuanced. It’s customizable to allow for that, but it’d probably get rather messy in the interface with too many categories.


timfinnegan
07:27:30 PM

dream feature: highlight a name and type ‘bio’ and have it link the wikipedia bio, or generate a map, or translate a passage, or fetch a synonym


timfinnegan
02:02:10 AM

(belated realisation: ‘image annotation’ can mean either adding annotations to images, or adding images to annotations)


timfinnegan
02:06:23 AM

is everyone open to interlinear placement of annotations, rather than popups? (for finnegans wake it’s the only efficient approach, i think: http://fwannotated.blogspot.com/2014/09/p25h.html )


timfinnegan
02:34:37 AM

has anyone else been burned by http://genius.com , where seniority is based on a gamified point system that promotes obsessives over insight?


2015-10-17

timfinnegan
03:17:19 AM

With storage so cheap, a site like Genius or Infinite could avoid edit-wars by letting every annotator create their own forked view


literature_geek
11:03:38 AM

@timfinnegan: Something I’d like to do is let any reader generate a custom URL that you can visit to see just the annotations that reader curated (their own annotations and/or ones they favorited).


literature_geek
11:08:19 AM

@timfinnegan: I know Jonathan Reeve and Alex Gil are thinking about letting people fork texts on GitHub (https://twitter.com/j0_0n/status/643401337334468608) and then maybe make custom editions (https://twitter.com/elotroalex/status/646831403963969536)


timfinnegan
12:27:13 PM

ASCIIDOC looks too simple for Ulysses, we need: newspaper-headlines, dialog-speaker, stage-directions, song-lyrics, quote-dash (so css can restyle it), various other odd indents…


literature_geek
07:30:39 PM

@timfinnegan: I like your bio/map/etc. dream feature. I could see this returning the first result of a search of Wikipedia or Google Translate, and then letting the annotator click a button to confirm adding the result or to say “that isn’t right, show me a different result”


literature_geek
07:31:12 PM

@timfinnegan: I should get a master list of desired features up in a public place so people can add to it and let me know which are priorities for different types of reading…


2015-10-18

2015-10-19

2015-10-20

suttonkoeser
10:25:20 AM

Just joining and looking around, but wanted to respond to @literature_geek’s comment: https://digitalhumanities.slack.com/archives/annotation/p1445024939000043


suttonkoeser
10:26:38 AM

We’ve been working on adding annotation functionality to http://readux.library.emory.edu based on annotator.js (the release is almost done and should go out soon); that rich text annotator plugin didn’t work so well for us, so we created a different one using markdown and meltdown: https://github.com/emory-lits-labs/annotator-meltdown


suttonkoeser
10:48:32 AM

I also have an annotator.js plugin for selecting and annotating portions of images using imgAreaSelect http://odyniec.net/projects/imgareaselect/ but I see now I haven’t yet pulled that code into its own git repo. (I’m not sure how generalizable it is yet, but would be interesting to see if it worked for someone else.)


literature_geek
11:10:40 AM

@suttonkoeser: Cool! Thanks, that’s really helpful to know.


mwidner
01:37:18 PM

ooooo… that’s really exciting. @suttonkoeser Is it off the 1.x branch of Annotator.js?


mwidner
01:37:42 PM

If so, I could probably integrate it into Drupal pretty quickly.


suttonkoeser
01:39:31 PM

@mwidner: no, we saw there was a 2.0 alpha release of annotator and didn’t want to target a version that was about to be out of date, so it’s compatible with the 2.0 alpha.


mwidner
01:40:09 PM

gotcha. That makes sense. Unfortunately, I don’t have time to update all my plugins for 2.0 right now. :disappointed:


mwidner
01:40:34 PM

If you post the plugin on Github somewhere, though, it might still be useful to take a look.


suttonkoeser
01:42:30 PM

Yeah, I hope to do that soon. I’ll drop a link in this channel when I get it up on github


mwidner
01:42:38 PM

Also: I saw in the intros thread you have a PhD in English. Me, too! What was your speciality?


suttonkoeser
01:45:16 PM

20th c poetry (although that was a while back now!); dissertation on Eliot’s Four Quartets, Susan Howe’s Nonconformist’s Memorial, and ideas of reading those texts nonlinearly / out of order / as exploring a textual space. I see projects like Infinite Ulysses now and wonder what I could have done had that kind of work been farther along at the time! (if you want to discuss more maybe we should move to dm, but thanks for the interest)


mwidner
01:47:00 PM

Just curious! :simple_smile: Sounds like Amanda’s work would’ve been great for you, for sure.


2015-10-22

timfinnegan
03:14:55 PM

in annotating ulysses, there are three distinct levels of ‘consciousness’: 1) no access to gifford or equivalent, 2) access and agreement, 3) access and disagreement. (gifford compiled the standard in-print collection of annotations.) it might get messy/ impolite to assign these levels to others, but could we ask contributors to classify themselves?


2015-10-23


timfinnegan
02:33:07 AM

in theory, the annotations at any point in a text can be expanded to mirror the whole universe as reflected in that point… in practice, choosing any point to begin from is near impossible… unless it’s joyce


timfinnegan
02:35:49 AM

the corollary here is that every annotation is potentially infinite, so if you’re soliciting reader input you want to offer/ allow for infinite whitespace


timfinnegan
02:40:01 AM

(so interlinear trumps hyperlinks)


2015-10-24

timfinnegan
03:14:21 AM

eg in finnegans wake when HCE meets the cad, joyce is pretty unambiguously inviting us to map all meetings ever onto it, back to primal carbon atoms meeting hydrogen.


timfinnegan
03:15:43 AM

and the mythic ai Singularity must perfect this universal mapping


timfinnegan
12:31:58 PM

has anyone else noticed a conflict between crowdsourced online annotation projects, and academic cv-enhancement? how do you get credit for creativity you give away?


2015-10-26

literature_geek
08:51:29 AM

@timfinnegan: This is an interesting question—and really important given that the crowdsourcing/community-building projects I know of are all really concerned with crediting annotators as co-authors. Some related thoughts:


literature_geek
08:55:42 AM

1) Is there an issue with citing on your CV work done under a username not affiliated with your real name? I.e. How do other people know the username is you? (Not something I personally much worry about—I think there’s a culture of trusting what’s on a CV, as one incorrect statement crushes your whole reputation.) Still, interesting in terms of how you design a site to give people anonymity when they want it, and still also give credit. Maybe a site admin could create a “real name” page per username, which lists the person’s real name and # of annotations authored (but isn’t linked to their username); CV can point to that, and even though there are ways of figuring out from annotation # which real name matches username, at least that’s some plausible deniability. Not sure whether that’s something users would want or not…


literature_geek
09:00:10 AM

2) Maybe we can look at other places where people do unpaid academic work, such as academic journals. Dino Felluga, the general editor of the BRANCH site (http://www.branchcollective.org/; open 18thc literary criticism/history) has discussed “fixing” a set of annotations at some predetermined deadline date, having the annotations available then undergo peer review, and then having those reviewed annotations available as a fixed set (for example at a specific URL) in the future. That would give users a fixed URL to point to as well as peer review.


literature_geek
09:02:06 AM

There could be “calls for annotations” just like journals have calls for articles that match an issue’s theme, perhaps with a focus on annotating for a certain mission (the post-colonialism annotation mission, the Finnegans Wake overlaps mission).


literature_geek
09:02:50 AM

These ideas work better with shorter works like on the BRANCH site (in my case, I’d probably want to focus on one Ulysses chapter per mission).


timfinnegan
10:06:07 AM

could IU offer a page with all my annotations numbered chronologically so i could cite any or all?


literature_geek
11:21:06 AM

@timfinnegan: yes, i’ll put that on my to-do list.


2015-10-27

suttonkoeser
01:04:52 PM

As I mentioned the other day, here is an annotator 2.x plugin for image annotation: http://emory-lits-labs.github.io/annotator-imgselect/
It seems to have a display issue with the main annotator ui viewer, which I didn’t discover until I pulled it out separately (it was developed with our marginalia plugin) and I haven’t had a chance to really look into yet. (And possibly some other quirks specific to our current use)


suttonkoeser
01:05:08 PM

And our other annotator 2.x plugins: http://emory-lits-labs.github.io/annotator-meltdown/



suttonkoeser
01:05:57 PM

Each site includes a little demo page that will let you play with it and try it out.


literature_geek
01:16:03 PM

@suttonkoeser: Cool! Looking forward to checking these out


mwidner
02:38:46 PM

Thanks!


2015-10-28

2015-10-29

mia
08:04:43 AM

re @literature_geek ‘s first point on Oct 26, I don’t think a real name is necessary, unless an organisation wants to check a reference by asking a project about a participant. A lot of voluntary work (my ‘go to’ analogy for online participatory work) doesn’t come with formal recognition.


suttonkoeser
10:11:33 AM

fyi if you want to cite an earlier comment in slack you can copy the link from the timestamp and paste that in like this: https://digitalhumanities.slack.com/archives/annotation/p1445863889000014


2015-10-30

timfinnegan
05:15:54 AM

twitter has lots of alleged joycefans, but precious little interest in closereading via online annotation projects. might it help to gamify the process of annotation so people start to see it as a shared responsibility?


timfinnegan
05:16:36 AM

(i’ve heard a dismissive term ‘party joyceans’ for people who’d rather drink than read)


timfinnegan
05:28:07 AM

we might distinguish joyce democrats (sharers) from joyce republicans (status seeking)


timfinnegan
05:34:54 AM

even rough estimates of how many/where annotations, like “infiniteulysses: 100, ulyssespages: 5000”


mia
06:21:51 AM

@suttonkoeser: thanks! I thought there must be something like that but it’s not obvious


timfinnegan
01:23:56 PM

if i wanted to write a script that visits every online ulysses project and counts all the annotations and who did them… is perl still state-of-the-art? would a site like http://genius.com automatically block it?


timfinnegan
03:13:24 PM

dug out my old python book (o’reilly rat 2nd ed)


suttonkoeser
04:31:43 PM

@timfinnegan: if you’re doing screen scraping in python, beautifulsoup is pretty nice - http://www.crummy.com/software/BeautifulSoup/


edsu
04:39:11 PM

@timfinnegan: are you planning to scrape http://genius.com then?


edsu
04:39:18 PM

@timfinnegan: or other places too?


timfinnegan
05:37:21 PM

i’m thinking genius and amanda’s and mine and a couple others, if possible noting dates and authors and ratings so i can acknowledge their consistent contributors


2015-11-02

mwidner
01:55:59 PM

Given the licensing for annotations on @literature_geek ‘s site, I bet she might just provide you the data. A lot simpler than trying to scrape it all.


timfinnegan
01:02:25 AM

okay, after lots of bleeding, i’m getting some screenscraping progress via bs4 with Requests (is Requests a good choice?) i’m on windows 10 so nothing quite works the way the docs promise


timfinnegan
01:23:42 AM

will screenscraping turn out to be too slow or blocked once i figure out bs4?


timfinnegan
01:28:11 AM

i want joyceans to see online annotation as a group responsibility


2015-11-03

timfinnegan
03:52:39 AM

joyce built his prose out of ambiguities that can only be addressed via annotation


fmcc
05:03:05 AM

@timfinnegan: Requests is a good choice - I’ve got no idea what the current situation is with Python on Win 10 - certainly remember it being painful in the past on earlier versions of windows


literature_geek
08:56:01 AM

Infinite Ulysses currently has an RSS feed of annotations, and I’m interested in offering other ways to reuse the content (for Twitter bots, other Ulysses sites, etc). The 1.0 site will probably offer JSON. @timfinnegan and others, what would your ideal annotation/annotator info export look like (for any site letting you annotate)? Do you have a preference as to file type (e.g. CSV)? I’m thinking both about reuse and not getting in the way of preservation (e.g. how can I let users’ annotations be best transferable to other/future platforms like Hypothesis?)


timfinnegan
09:42:24 AM

an export-format wd be awesome– page, line, highlightedtext, author, date, annotation, tags? gifford-or-not status, ratings?


timfinnegan
10:16:52 AM

a thriving online database for finnegans wake annotations: http://fweet.org/pages/fw_srch.php (this started by transcribing mchugh’s book, which collated many others by page and line)


suttonkoeser
10:16:52 AM

What is IU using for annotation implementation, and how are annotations stored? If you were using annotator.js I would wonder about using the annotator store api to make them available, but perhaps not all of the information you want included is part of the annotation exactly (although the data model is flexible and can include any extra data fields you want)


timfinnegan
10:19:45 AM

just view-selection-sourced a random one: “<span data-annotation-id=”2891” class=”annotator-hl” href=”“>Universally </span>” http://www.infiniteulysses.com/ulysses/366


timfinnegan
10:28:30 AM

cf http://genius.com: “<a data-id=”4143452” href=”/4143452” data-editorial-state=”accepted” data-classification=”accepted”>princely presence</a>” http://genius.com/James-joyce-ulysses-chap-2-nestor-annotated


timfinnegan
10:46:07 AM

Reeve embeds the annotation as a title-popup in a (linkless) anchor: “Fleshpots of Egy<a href=”#name0” title=”refers to Exodus, in Bible; Jews complain to Moses they were better off in Egypt” onmouseover=”self.status=’‘;return true” onmouseout=”window.status=’’“><u>pt</u></a>” http://jonreeve.com/ulysses/ch05.html


timfinnegan
10:48:25 AM

Hunt: “<a style=”color: rgb(245, 150, 39);” id=”050005walkedsoberly” class=”box-images” href=”notes/050005walkedsoberly.htm”>Mr Bloom walked soberly</a>” http://hs.umt.edu/joyce/index.php?chapter=lotus


timfinnegan
11:00:27 AM

Wikibooks credits annotation-authors but doesn’t use embedded hyperlinks: https://en.wikibooks.org/wiki/Annotations_to_James_Joyce's_Ulysses/Telemachus/003 Only Genius and Amanda are crediting annotation-authors from inside the text.


timfinnegan
11:16:45 AM

counting/comparing number-of-notes-per-episode will be my relatively easy first challenge


literature_geek
12:24:36 PM

@suttonkoeser: It’s weird because I’m using Annotator.js, but with annotation stored as nodes in the Drupal db (thanks to @mwidner!) so I can easily tie them into Views etc. But I bet I could expose them that way too, and just have my site continue using what’s stored as nodes—that would be a good longterm plan.


literature_geek
12:35:57 PM

@timfinnegan: Attributing authors next to the annotations is really important to me—otherwise it isn’t clear to the casual reader who’s doing the work. Maybe the biggest problem in my survey of other Ulysses digital prototypes was unclear attribution (usually meaning wholesale using Gifford/Blamires without citing either). I’m thinking about putting major annotators on the masthead of the 1.0 site, but I’ll contact everyone first to make sure they’re okay with it and if they want their username attributed or something else (e.g. link to personal site or other project)


timfinnegan
12:37:27 PM

could the masthead be like a leaderboard with tallies? genius does this but they also reward people with editor powers which i found dangerous because quantity isn’t quality


literature_geek
12:44:59 PM

Hm, maybe! I’ll probably also have a leaderboard with tallies for the top ten all-time annotators and/or annotators in the last month or week on the front page, so either that will be separate and a little lower, or I could play around with masthead designs like “Infinite Ulysses [logo] General editor Amanda Visconti, Key annotators: timefinnegan (470), amandavisconti (249), bbogle (159)”. Especially if the leaderboard will be by week/month (since some use it to encourage current reading/annotating) and not all-time, there should be recognition for all-time prolific annotators on the front. I’ll need to think about the cutoff of # annotations to get listed on the masthead, since there’s other helpful site activity not captured by # annotations authored (e.g. marking typos for me to fix, tagging).


timfinnegan
01:03:31 PM

in the longer run, building a database of paraphrases of gifford/thornton/slote/johnson that everyone could freely add or not (maybe resembling http://fweet.org)


timfinnegan
01:04:40 PM

(is 470 for real?)


mwidner
02:24:10 PM

@literature_geek: The Drupal version also uses the Annotator API, so it’s already available as JSON if you want to expose it that way. We’ve also created some custom Views for Lacuna Stories that export annotations with more human-friendly information, like title of text, excerpt, annotation, etc.


literature_geek
02:45:08 PM

@timfinnegan: (470 is what I’m seeing—very exciting. I have to check, but that probably isn’t counting typos you’ve noted and I’ve fixed—I need a way to include that kind of activity but separate from regular annotations. Sorry, it’s on my task list to get this and other stats like what pages your annotations are the greatest % of the annotations on that page, etc. up on your user profile so you can see these every day yourself! My happiness to export data for you and display things like this is only, for better or worse, limited by trying to make time for Infinite Ulysses work… )


literature_geek
02:46:24 PM

@mwidner: Nice! I think I did have it as JSON through Views JSON briefly but it was fiddly, so I’ll check that out. Your annotations = nodes magic makes so many cool things possible with Views!


mwidner
02:49:06 PM

That’s why I did it! :simple_smile:


mwidner
02:49:50 PM

Here’s the Annotator API output for your site: http://www.infiniteulysses.com/annotation/api


mwidner
02:50:44 PM

Actually, this is it:



mwidner
02:50:57 PM

if you’re not logged in, you won’t see much except the node ids


mwidner
02:52:04 PM

But, that’s enough for someone to grab the text of every annotation just by visiting the urls for each node.


literature_geek
02:52:29 PM

@mwidner: Awesome! Thanks, I totally forgot that was a possibility


2015-11-04

timfinnegan
05:41:28 AM

well, i haven’t figured out how to use ‘data-*’ attributes in bs4, so for genius i just used the python string count. by episode: 200, 76, 244, 52, 36, 103, 113, 81, 284, 6, 109, 38, 24, 70, 13, 32, 11, 106 = 1598 total


timfinnegan
05:46:12 AM

the 284 in *scylla are almost all from michael bible, who also did 2/3 of the 244 for proteus, and 3/4 of the 200 for telemachus


timfinnegan
05:49:07 AM

running the code for all 18 pages took less than a minute


timfinnegan
09:01:45 AM

Reeve: 304, 91, 272, 117, 186, 227, 334, 472, 737, 355, 254, 235, 140, 32, 335, 0, 0, 349 = 4440


timfinnegan
09:11:20 AM

Hunt: 200, 108, 207, 22, 23, 60, 39, 35, 46, 29, 19, 46, 23, 69, 128, 26, 50, 37 = 1167


timfinnegan
10:56:40 AM

IU: 103, 62, 34, 45, 41, 39, 14, 6, 16, 141, 15, 38, 20, 31, 11, 6, 54, 10 = 686? (my loop-indexes may be off)


edsu
10:58:42 AM

@timfinnegan: requests is really good for python ; i’d be curious to know what isn’t working on windows


timfinnegan
11:02:33 AM

mostly ‘tar.gz’ and ‘PATH’ (and resistance to RTFM)


edsu
11:03:03 AM

oh, getting it installed?


edsu
11:03:20 AM

where it = requests ?


timfinnegan
11:14:39 AM

i did beautiful soup first so requests went smoother


edsu
11:15:09 AM

@timfinnegan: i think python on windows comes with pip right?


edsu
11:15:20 AM

pip install requests ?


edsu
11:17:13 AM

that should download and install everything


timfinnegan
11:22:30 AM

i never got pip or easyinstall to work at all


edsu
11:23:31 AM

@timfinnegan: was pip available to you at the command line when you installed on windows?


fmcc
11:25:21 AM

@edsu @timfinnegan : It doesn’t seem like pip is available if it was python 2 that was installed



edsu
11:26:38 AM

i thought python >= Python 2.7.9 came with pip


fmcc
11:27:07 AM

I thought so too, but I’m not familiar with the windows installer so…


edsu
11:28:12 AM

oh hmm, that kind of terrible - i wonder if it’s some variation of http://stackoverflow.com/questions/28621436/pip-not-working-on-windows-python-2-7-9


edsu
11:28:26 AM

python2.exe -m pip install requests


edsu
11:28:28 AM

maybe?


fmcc
11:29:55 AM

No, you’re right about 2.7.9 onwards



timfinnegan
11:32:06 AM

it was python 3.5 …and 2to3.py for bs4 was also torturous


timfinnegan
11:33:13 AM

i never use commandline in windows so as a beginner i didn’t know when to use python’s vs windows’ commandline


fmcc
11:33:20 AM

@timfinnegan: because you installed it manually rather than using pip?


fmcc
11:34:19 AM

bs4 will automatically convert it’s codebase to python3 when you install it with pip


edsu
11:34:21 AM

there’s no need to run 2to3 for bs4



edsu
11:35:11 AM

oh, i take that back


edsu
11:35:15 AM

that does look convoluted


fmcc
11:35:31 AM

(I’m surprised to read it as well - always just pip installed it and never thought about it)


edsu
11:35:45 AM

maybe i’ll just go back to my windows free universe and keep my mouth shut :smile:


fmcc
11:39:33 AM

I’ve never tried to use Python on windows - I only recall trying to help someone with Postgres setup on a windows machine and ducking out on it once it started to get to these ported psycopg installers



fmcc
11:39:48 AM

dragons all the way down


timfinnegan
11:46:36 AM

win10 hides python at: C:\Users\tim\AppData\Local\Programs\Python\Python35


fmcc
12:00:12 PM

right, but that should just be the exe or alias that your account can run


timfinnegan
12:05:12 PM

but modules need to be installed there (no?) and trying to find where to run 2to3 from took a million tries


fmcc
12:06:15 PM

no - you need pip installed and working and shouldn’t have to run 2to3 - you’re stuck doing it the hard way at the moment


mwidner
12:06:23 PM

So, one route that might be more reliable is to get VirtualBox, set up something like an Ubuntu virtual machine to play around with, then use all the package management tools to install python and all the libraries. It’d be command-line, but you’d probably find a lot more tutorials for that online than Windows and things would just work.


timfinnegan
12:12:51 PM

it’s working now, mostly, for my purposes


timfinnegan
12:13:44 PM

this was how i scraped infinite: import requests start = [3, 24, 37, 53, 68, 84, 112, 144, 176, 210, 245, 280, 331, 366, 408, 569, 619, 690] end = [24, 37, 51, 68, 84, 112, 144, 176, 210, 245, 280, 331, 366, 408, 567, 619, 690, 733] for episode in range(0, 18): temp = 0 for page in range( start[episode], end[episode]): url = “http://www.infiniteulysses.com/ulysses/” + str(page) r = requests.get(url) temp = temp + r.text.count(‘field-text’) print(temp)


timfinnegan
12:15:53 PM

next is my own site, which i’ll try to use bs4 on because nothing is wellbehaved there (messy blogger urls, messy blogger markup)


timfinnegan
12:26:28 PM

i should be able to trim away everything that’s not annotations, and then count linebreaks, ignoring multiples, for a first approximation


2015-11-05

literature_geek
08:49:57 AM

@timfinnegan: Not sure if this helps, but the feed of Infinite Ulysses annotations (updates automatically as they’re authored) is at http://www.infiniteulysses.com/annotations.xml (clunky table view that will be improved on 1.0 site: http://www.infiniteulysses.com/all-annotations-feed). I put the latest (11/5/2015) export of raw annotation data up at https://raw.githubusercontent.com/amandavisconti/infinite-ulysses-public/master/Annotations/node_export.txt.


literature_geek
08:50:47 AM

@timfinnegan: I also made an RSS feed for just your annotations (http://www.infiniteulysses.com/timfinnegan-annotations.xml) and a page you can visit to see a table of all your annotations (sortable by Ulysses page number, date authored, quote, text): http://www.infiniteulysses.com/timfinnegan-annotations


literature_geek
08:56:21 AM

@timfinnegan: I’ll try to add some more stats/cleaner export options to that soon


timfinnegan
12:27:20 PM

looks stunning! (for some reason the default by-page sort puts a couple of 34s before the 28s?) and wouldn’t the most useful default view be newest-first?


timfinnegan
12:28:23 PM

i just ran my ‘nestor’ pages and got: notes 214 links 126 images 22 maps 0


shawngraham
10:07:26 PM

…so. How would one annotate a video game? Video of a playthrough w/ youtube’s tools?


2015-11-06

timfinnegan
03:40:49 AM

(any good examples of youtube’s tools?) here’s a vr ulysses project that’s supposed to get annotations eventually: https://inulysses.wordpress.com/


timfinnegan
04:56:27 AM

columnar comparison of preliminary ulysses notecounts: https://files.slack.com/files-pri/T0CELH6PR-F0E0P3FKR/preliminary_note_counts.txt


timfinnegan
05:02:39 AM

one surprise is that 86% of my notes (last 4 columns) have a link or an image (3605+947 = 4552 = 5312-760)


timfinnegan
05:04:39 AM

i guess this is because images and links are the most fun places to start, so that ratio will drop as more speculative interpretations get added


timfinnegan
05:14:01 AM

i forgot to count links to youtubes of mentioned songs, which should be about 300


timfinnegan
10:28:20 AM

is there any consensus on what user-comment system works best? (since in the end every annotation is a potential flamewar)


literature_geek
01:33:24 PM

@shawngraham: Interesting question! Wondering whether there’s a way to caption (as annotation) screenshots taken with hot key while in a Steam game (while in-game=don’t think so; while on Steam profile=maybe?) I can test when Fallout 4 drops next week : D


mwidner
02:15:40 PM

@literature_geek: the open source release of Lacuna Stories 2.0 will probably drop next week, too.


timfinnegan
02:36:43 PM

the common form of video annotation is a commentary track; an alternate would freeze playback and maybe shrink it to a corner while the screen is taken over by a commentator


timfinnegan
02:46:45 PM

(i’m imagining a hyperlinked set of wandering-rocks animations on youtube where you can click to jump to any parallel timeline…?)


timfinnegan
02:52:45 PM

((start with just the audiotracks?))


literature_geek
06:22:16 PM

@mwidner: I am excited for the release! Congratulations!


literature_geek
06:23:44 PM

@timfinnegan: by user-comment system, do you mean platforms like disqus, or like best practices for moderation?


literature_geek
06:29:59 PM

@timfinnegan: That comparison file is really cool. I’ve currently got Infinite Ulysses’ annotation at 1,043 total, though, rather than 686—could you tell me how you got that count so I could investigate? I’ve got a table of annotations per page here (http://www.infiniteulysses.com/most-annotated-book-pages), but I’ll work on getting the counts per chapter (not sure of an easy way to tell Drupal to group by ranges of pages in specific chapters but I’ll figure it out…). (Changed your annotation view page to default-sort by newest first, by the way: http://www.infiniteulysses.com/timfinnegan-annotations. Will add a total annotations count next)


literature_geek
06:43:39 PM

@timfinnegan: Though I just added up the annotation counts by page on http://www.infiniteulysses.com/most-annotated-book-pages and got 1137… that might be including the small number of annotations marked as private? (e.g. annotations of typos to fix)


timfinnegan
07:46:41 PM

2015-11-08

timfinnegan
03:50:11 PM

my count for sirens is 15, yours is 25– could it be that my ‘field-text’ search is skipping the typos?


2015-11-09

timfinnegan
04:23:55 AM

imagine a ulysses e-reader that pulls in all the notes from all these sites and lets you like/dislike them individually, learning which sources you prefer but also compiling your own custom annotated edition


timfinnegan
04:38:07 AM

with ulysses and even more with finnegans wake, publishing annotations in a paper book has become impractical– there’s too many possible insights, and links and images and maps and songs. so progress is effectively stalled until some such community e-reader gets off the ground


timfinnegan
04:41:31 AM

http://fweet.org is one individual’s annotated edition, so far without links or images or genetic layering (manuscript variants)


timfinnegan
04:48:20 AM

(is it possible to agree on a set of formats for tagging notes, so they can be shared, no matter if the edition embeds them in the text, or embeds a link to them on the same or another page, or presents them interlinearly?)


timfinnegan
05:10:46 AM

((and imagine if your bots could detect updates on every site, like a smart rss for annotations?))


timfinnegan
05:17:14 AM

(((has there ever been a commenting system that lets each commentor host their own comments, but tracks others’ replies?)))


literature_geek
08:32:44 AM

I remember seeing something where you self-hosted content and that was linked out to other social platforms (e.g. Twitter) if you wanted. It might have been Diaspora? https://diasporafoundation.org (I remember the “decentralized web” was a thing it discussed.)


literature_geek
08:37:17 AM
Comment: Parts of my dissertation whitepaper on design and code for participatory digital editions () may be of interest to this channel. I focused on online annotation as a means of making the humanities (literature in particular) more open and participatory to the public. There’s some DH and textual scholarship theory as well as design discussion and user studies analysis.

literature_geek
08:38:59 AM

@timfinnegan: Section 2.5 (“Ulysses under hypertextualization and hyperannotation”) compares various digital Ulysses prototypes for pros/cons and what they seem to value (you mentioned Genius and Infinite Ulysses as being the only sites with inline attribution to annotators, and that’s one of the things I thought about there)


2015-11-10

2015-11-11

2015-11-13

2015-11-14