Skip to main content
← Building
Focus Reader app icon: an orange open book with a wave across the pages and one highlighted line
Product Design · iPadOS and iOS2026In testing

Focus Reader: Reading With a Pencil in Hand

SwiftUIPDFKitPencilKitVisionFoundation ModelsTestFlight
Focus Reader on an iPad and an iPhone, both open to page 4 of my 2024 Focus assignment. On the iPad, two sentences about the persona Mikaela are highlighted on the page, and the canvas beside it holds their cards with citations and times, plus a picture card snipped from the experience map on page 5 with a typed note. The iPhone shows the same two highlights as cards in its notes view.
Focus Reader on iPad and iPhone, open to page 4 of my 2024 Focus assignment. Screens are from the simulators.

Where it comes from

In fall 2024 I wrote a class reflection on reading. It opens, "I am a voracious reader," and later says, "I have not used a reader device simply because I have not needed one." I listed what would make one worth using: having it read aloud, looking up words, following related topics, and "being able to mark up the copy with highlights and notes."

That semester I designed Focus in two UX courses at Kent State: a reader that keeps everything you read and helps you connect it. The persona I wrote for it, a graduate student named Mikaela, "needs to be able to mark up and edit this material, quote it, and take notes." I called Focus "something that I am in favor of developing myself."

On October 31, 2026, I typed this to Claude, and the app was running on my iPad that afternoon: "we should build a free reader app for ipad that lets me highlight, and then it takes the text from the highlight and saves it."

Hand-drawn storyboard: a distracted learner engages Focus mode, notifications and noise are eliminated, and the learner retains more information
The first Focus storyboard, October 2024.

Highlighting

I land the Pencil on the first word I want and draw to the last. Everything between them is highlighted, line after line, and the card appears beside the page while I am still drawing. If I highlight half a sentence and then finish it, the two strokes join into one highlight with one note.

A word joins the highlight once the tip is a third of the way into it, so a stroke can stop at the end of a sentence without catching the next word. Handles at both ends adjust a highlight afterward, and tapping a highlight brings them back.

Cards stack in the order their passages appear in the text until I move one, or in the order I made them if I choose. Each card shows when it was made. When I tap a highlight on the page, its card lights up and the canvas scrolls to it, and the last highlight I made keeps a faint outline so I can find my place. Each card cites its source in APA 7, MLA 9 or Chicago, with the page number. If the app cannot find a PDF's page numbers, it counts from page 1. Markdown, text and Word files have no fixed pages, so their highlights cite the paragraph, and in APA the section heading.

Focus Reader showing page 4 of my 2024 Focus assignment, the Mikaela persona. A yellow highlight reads mark up and edit this material, quote it, and take notes, and its card on the right cites Dishman, 2024, page 4. A pen underline runs under Mikaela reads a lot of material for school and, and Apple's Pencil palette sits along the bottom.
A highlight and its card, a pen underline, and Apple's Pencil tools. Screens are from the iPad simulator.

Marking up the page

The Pencil tools are Apple's own palette, the one in Notes, with one tool of mine added: Highlight text. A marker stroke can also pick up the words under it, so freehand highlighting still makes a card.

Highlights and pen marks are saved into the PDF as standard markup, with each note attached as a comment, and they show in Acrobat. When the file came from Google Drive, the marked-up copy replaces the original in Drive. The app saves after each change, when I leave it and when I close a document, and it writes to the file only if highlights, notes or marks changed.

It works the other way too. Highlights I save in Acrobat become cards when I open the file here, with any comment as the note, and they take the closest of the app's five colors. Before each save the app checks the Drive file's date and size, and reads it again only if another app or device changed it, so a save here keeps those marks. A highlight I delete in Acrobat stays deleted unless it has a note.

The canvas

On the first day I said it should work "in an infinite canvas kind of setting": an open workspace beside the page where highlights and notes can sit anywhere. It has three layouts: reader and canvas side by side, the document as a card on the canvas, or the reader alone with the canvas one tap away.

My first try turned handwriting into text boxes as I wrote. They appeared too fast for me to finish a thought, so I dropped it. Now handwriting stays as ink until I tap Convert and circle it, and it becomes one text card. Dropping one text card on another merges them.

A long reading can produce dozens of cards. A swipe across them scrolls the canvas, and touching and holding a card moves it. I can select some or all of them, drag them together, and arrange them in columns, down then right, or in rows, across then down. They stay in the order of the text, new cards follow the same layout, and cards overlap only where I put them on top of each other. A typed note joins the order after the last highlight up to the page I am reading.

Tapping a card opens it large in the middle of the screen, where I can read it at full size and write or draw in it. Holding a card and letting go brings up Copy, Duplicate and Delete, and holding empty canvas brings up Paste, the same edit menu as the rest of iOS. Text and pictures copied from other apps paste in as cards.

For charts and figures, I draw a box on the page with the Snip tool and the picture inside becomes a card with its page number.

The same PDF shown as a card on a dark canvas, with the highlight card beside it.
The document as a card on the canvas.
A picture card opened large on the iPad: part of the experience map from page 5 of my 2024 Focus assignment, cited Dishman, 2024, page 5, with a Note field being typed in and a Drawing area below it.
A picture card opened to write in. I snipped it from the experience map on page 5.

Files and notes

Files come from Google Drive or anywhere else in the Files app: PDF, Word, Markdown and plain text. Scanned PDFs cannot be highlighted yet, because they have no text for the app to pick up. Markdown shows as formatted text with headings, lists, quotes and tables. I can edit text files in the app, and each document reopens where I left off. In a Markdown file, highlights save as ==marks==, which the notes app Obsidian shows as highlights.

Word files keep their headings, lists, tables and pictures. They open read-only, and their highlights stay in the app. Older .doc files do not open.

Export writes a Markdown file for each document, with any sketches and snips as images: every highlight with its note and citation, my notes and pictures, and the reference. If I choose a folder in Settings, the app writes this for every document a moment after each change, along with the same notes as data that other apps and AI tools can read.

My 2024 reflection on reading, opened as a Markdown file. The phrase being able to mark up the copy with highlights and notes is highlighted, and its card cites Dishman, 2024, paragraph 6.
My 2024 reflection on readers, with that phrase highlighted.

On the iPhone

The iPhone shows one thing at a time. I touch and hold a word, then drag to highlight, and an ordinary swipe scrolls. One button at the top switches between the page and my notes, away from the hand holding the phone. The other commands are in a menu at the top.

Highlights and their notes travel between devices inside the file, so any drive works: standard markup in a PDF, ==marks== in Markdown. I add each file once on each device. A highlight I delete on one device goes away on the other, unless it has a note. Typed notes, card positions and Word highlights stay on the device where I made them.

Two iPhones. The first shows page 4 of my 2024 Focus assignment with two highlighted sentences and a Notes button at the top. The second shows the notes view, where the two highlights are cards with their citations, and the button at the top reads Reader.
The page and my notes on the iPhone. The button at the top switches between them.

Apple Intelligence

On devices that support Apple Intelligence, two features use Apple's on-device model. Explain describes a highlighted passage in a few sentences, using the text around it. Draft details fills empty citation fields and drops anything not printed on the first page. It can still pick the wrong name or year, so I check it. Nothing leaves the device. On devices without Apple Intelligence these features do not appear.

What carried over from 2024

The reader lets me scroll or swipe, because in my 2024 paper prototype test one person could not imagine swiping the page and the other never tried to scroll.

In 2024 I wrote of the O'Reilly reader, "I do not like the fact that there are no page numbers showing on the page." Here the page number is always on screen.

A reading dashboard

For a graduate course on AI in education, I had to design a learning analytics dashboard. I designed mine around Focus Reader, for the person doing the reading. The app now keeps a private log of where I go in a document: time on each page, the pages I come back to, and which highlights and notes I open again. The dashboard turns that log into four panels and one card written by an AI on the device.

Coverage shows every page of a reading as a tile, marked as read closely, read lightly, skimmed or never opened. Time on page and highlights by section show where my attention went. Came back to lists the pages I returned to and how often I reopened my highlights. Each panel ends with a line on what it cannot show. Time open is not time reading, and a page I keep returning to may have mattered or may have confused me.

The flag card is the AI part. It says what it saw in the log, what it infers, and what it cannot see, then leaves the decision to me. From there it can ask three questions about the pages I skipped and compare my answers with the text, list readings from my library that cover those pages, or let me dismiss the flag because I skipped them on purpose.

The log stays on the device. An instructor sees only a summary the reader chooses to send, with a box for each part: coverage, question results, time on each page, and highlights and notes.

The dashboard is a prototype in Figma, and the screens below use made-up data for a sample student.

Reading dashboard for a sample student. Four panels: coverage as a row of page tiles, a bar chart of minutes per page, highlights per page by section, and pages returned to with visit counts. Each panel ends with a limit. On the right, the AI flag card lists what it saw, what it infers, what it can't see, and the reader's choices: check me on the gaps, a reading list for the gaps, send a receipt, or dismiss.
The dashboard with the flag card open.
The flag card after Check me on the gaps: three questions, each citing the pages it came from, with the reader's answers and the AI's comparison with the text. The pages each question covered are outlined as checked in the coverage panel.
Questions on the skipped pages. The AI compares each answer with the page, and the reader can overrule it.
The summary for the instructor: a count of pages marked or visited and questions answered, with checkboxes for coverage summary, question results, time on each page, and highlights and notes. Only the first two are ticked.
The summary for the instructor. The reader picks what goes in it.

Status

Focus Reader is in testing on my iPad and iPhone.

Still rough: dragging a card can lag, dragging a highlight past the screen edge does not scroll the page, and the end of a Markdown file can sit under the bottom edge of the iPhone.

Still to come: the reading dashboard, EPUB books, web articles, the Focus modes from the 2024 prototype, and links between ideas across documents.

Claude wrote most of the code to my design and built the dashboard prototype in Figma. It drafted this page and the build log from the commit history and my reports, and I tested each build.

Build log

  1. October 31, 2026

    First build on the iPad that afternoon: PDF reading, highlights saved as cited cards, the canvas and Markdown export.

    Four more builds that day added text and Markdown files, Google Drive through Apple's Files picker, Apple's Pencil palette, markup saved into the PDF, undo and redo, and Apple Intelligence.

  2. November 2

    Added Word files, read-only. They had run only in the iPad simulator.

    Found that strokes could pick up text earlier than the Pencil's position. The fix waited for the next upload.

  3. November 4, morning

    First long test: a 106-page PDF for class. Highlights kept starting at the beginning of the line instead of the word under the Pencil. On that PDF the old lookup picked earlier text for about 90 percent of words. The fix went out with Word files, and the report back was better but still a little clunky.

    Also reported: cards piled on top of each other and fell out of order, and notes and highlights could not be removed. A test reproduced the pile: any swipe on a card dragged it out of its column.

  4. November 4, mid-morning

    Highlighting changed from marking only the words under the stroke to marking everything from the first word to the tip, with a smooth preview. The report back: much smoother.

    Highlights saved in Acrobat now become cards, and the app's highlights show in Acrobat. Both were confirmed on the iPad.

    Added card selection, columns and rows. A swipe now scrolls the canvas, and touching and holding moves a card. Columns had run only in the simulator. Dragging some cards lagged, cause not confirmed.

  5. November 4, evening

    Reported: zoomed out, strokes grabbed the first word of the next sentence, and highlights were hard to adjust afterward.

    A word now joins a highlight only when the tip is a third of the way into it. Tested on that PDF at its 1,143 sentence endings, with the tip just inside the next word: the old code took that word every time. The new code never did at 70, 100 or 150 percent zoom, and did 36 times at 50 percent. Those 36 have not been examined.

    Added handles at both ends of a highlight, and the first iPhone version.

    Highlights now travel between devices inside the file. Before this, a save on one device would have erased the other's highlights.

    Autosave now runs after a change, on leaving the app and on closing a document. Moving a card no longer writes to Drive.

    All of this was tested only in simulators before the upload.

  6. November 5

    First day on a real iPhone. The class PDF came in from Google Drive and its 20 iPad cards arrived as 26, because some highlights from older builds had skipped words and split into pieces. The report: it works.

    Reported: at the end of a Markdown file, the last lines sit under the bottom edge of the phone, more than on the iPad. A simulator with the same phone model, system version and file shows the whole ending, so the cause is still open.

  7. November 6

    Reported: an accidental card move could not be undone, and the undo sent the reader back to the start of the document. In the simulator, undo took a card move back and kept the page in all three iPad layouts and on the iPhone, for a PDF and a Markdown file, so that jump was not reproduced. A way for it to happen was found while testing: when the text is laid out again, the scroll position can move. The text reader now keeps the same words at the top of the screen through any relayout, and highlight colors change in place instead of reloading the text.

    Reported: a handwritten note was lost by closing the editor without tapping Done. Notes, handwriting and typed cards now save as they are written. Closing the editor any way keeps them, and one undo takes the whole edit back.

    While selecting cards, dragging any picked card now moves the whole selection together, as one undo step.

    Tested in simulators only before the upload.

  8. November 7

    Added the Snip tool: a box drawn on the page with the Pencil, or on the iPhone with a finger, turns the picture inside into a card that cites its page.

    Tapping a card now opens it large in the middle of the screen, with the note, drawing and color inside it. Copy, Duplicate and Delete come up when a card is held and let go, and Paste when empty canvas is held. Every card shows when it was made, and the cards can be ordered by their place in the text or by time.

    Notes can now be written automatically to a chosen folder, such as one in Google Drive: each document as Markdown, as data other apps can read, and its pictures.

    Added a private reading log for the reading dashboard: time on each page, return visits, and which highlights and notes were opened again. It stays on the device and goes into the export folder only when one is chosen.

    Requested: the card of the highlight chosen on the page should show it, and the last highlight should stay marked so the reader keeps their place. The chosen highlight's card now lights up and the canvas scrolls to it, and the most recent highlight keeps a faint outline.

    Reported: saves kept failing with “Couldn’t read the original file.” Before each save the app downloaded the whole PDF from Google Drive again, and Drive was often too slow to hand over a 3.3 MB file. The app now checks the file’s date and size first and downloads it only if another app or device changed it. A failed save shows one message and then retries on its own.

    Three uploads that day, each tested in simulators before upload.

  9. November 11

    Reported while reading a chart: a single page could not be turned without the whole screen flipping. Also reported: no way to jump to a page, and highlights that sat close together blended into one.

    Added a Page menu for PDFs with Go to page and Rotate this page. Go to page tries the printed page number first. A rotated page stays rotated in the app, and the file is not changed.

    Touching highlights now join only when they are the same color.

    Reported: Google Drive was greyed out when choosing a folder for automatic export. The notes went to a folder in iCloud Drive instead, and they arrived on the Mac as Markdown, data and pictures.

    Choosing an export folder now writes every document that has notes. Before, only documents changed afterward were written.

    Tested in the iPad simulator only before the upload.

  10. November 12

    Google Drive does not let another app keep a folder chosen in the Files app. The app now signs in to Google itself and writes the notes to a Focus Reader folder in Drive. It uploads only the files that changed.

    The sign-in page opens in the simulator. As of November 13, a real sign-in and upload have not been run.

  11. November 13

    Decided how to use Apple's on-device AI: for finding and matching. It is not strong enough yet for writing quiz questions or deciding where a note belongs.

    Highlights, typed notes and documents now show up in Spotlight, the system search on iPad and iPhone, and can be found and opened through Siri and Shortcuts. Finding matches exact words. Spotlight was checked in the iPad simulator, and the Siri phrases have not been tried.

    Fixed: a document left on a page that had been turned reopened on the next page.

    Reported: new notes were landing in the wrong place. The iPad's own record showed all 23 cards in one document had been moved together, which took every card out of reading order, so the next highlight started alone at the top. Moving every card at once now moves the whole layout and keeps the order.

    That fix was checked with unit tests only before the upload.