osxphotos: Shared photo paths are incorrect on Ventura (was: Missing photos, not actually missing?)
For the last day or so, I have been unable to handle the missing photos issue.
Describe the bug
osxphotos is reporting that I am missing photos, even after… I tried:
- Running
--retry 3 --download-missing - Exporting and reviewing errors
- Manually verifying and loading each of them
- Manually verify that they in fact were not exported
- Deleting them, re-uploading them
- Deleting them, repairing my Apple Photos, re-uploading them
- Upgrading
osxphotos
This is the command I am running:
osxphotos export "/Volumes/Extreme SSD/osxphotos" --exiftool --exiftool-merge-keywords --album-keyword --retry 3 --download-missing --directory "{created.year}/" --touch-file --update --cleanup --skip-edited --report export.csv
In investigating this, I also discovered that it wasn’t adding the photos to a “missing” album. That feature didn’t work for these photos either which I thought was strange. It did work for some other photos which I managed to resolve; however, for these photos it just didn’t work at all.
To Reproduce
I am not sure how to reproduce it on another computer without uploading my entire library.
Expected behavior
These photos are present; I can download and re-import them. I am trying to figure out how to resolve this.
Desktop (please complete the following information):
OS: macOS Ventura Version 13.1 (22C65)
% osxphotos --version
osxphotos, version 0.55.5
Additional context
Here is the verbose log:
% osxphotos export "/Volumes/Extreme SSD/osxphotos" --exiftool --exiftool-merge-keywords --album-keyword --retry 3 --download-missing --directory "{created.year}/" --touch-file --update --skip-edited --report export.csv --missing --verbose
osxphotos version 0.55.5
exiftool path: /opt/homebrew/bin/exiftool
Using last opened Photos library: /Users/michaelpetrochuk/Pictures/Photos Library.photoslibrary
Using export database /Volumes/Extreme SSD/osxphotos/.osxphotos_export.db
Processing database /Users/michaelpetrochuk/Pictures/Photos Library.photoslibrary/database/photos.db
Processing database /Users/michaelpetrochuk/Pictures/Photos Library.photoslibrary/database/Photos.sqlite
Processing database.
Database version: 6000, 8.
Processing persons in photos.
Processing detected faces in photos.
Processing albums.
Processing keywords.
Processing photo details.
Processing import sessions.
Processing additional photo details.
Processing face details.
Processing photo labels.
Processing EXIF details.
Processing computed aesthetic scores.
Processing comments and likes for shared photos.
Processing moments.
Done processing details from Photos library.
Exporting 21 photos to /Volumes/Extreme SSD/osxphotos...
Exporting IMG_4804.HEIC (6AED2C77-58FC-4104-B73F-7AC55749EB75.JPG) (1/21)
Skipping missing original photo IMG_4804.HEIC (6AED2C77-58FC-4104-B73F-7AC55749EB75)
Exporting IMG_4807.HEIC (8FF24096-4709-400F-B97C-2470B2F93DC2.JPG) (2/21)
Skipping missing original photo IMG_4807.HEIC (8FF24096-4709-400F-B97C-2470B2F93DC2)
Exporting IMG_4806.HEIC (4353809B-6C3A-4E25-9E9D-D10A6D41107D.JPG) (3/21)
Skipping missing original photo IMG_4806.HEIC (4353809B-6C3A-4E25-9E9D-D10A6D41107D)
Exporting IMG_4793.HEIC (DEF6E36C-061B-42F4-B11B-1B5B6F85E4BE.JPG) (4/21)
Skipping missing original photo IMG_4793.HEIC (DEF6E36C-061B-42F4-B11B-1B5B6F85E4BE)
Exporting IMG_4812.HEIC (62403E43-816E-44C8-A39B-58755DBB17B0.JPG) (5/21)
Skipping missing original photo IMG_4812.HEIC (62403E43-816E-44C8-A39B-58755DBB17B0)
Exporting IMG_4810.HEIC (19C5853B-9579-4FDB-B4F5-6627CE77C857.JPG) (6/21)
Skipping missing original photo IMG_4810.HEIC (19C5853B-9579-4FDB-B4F5-6627CE77C857)
Exporting IMG_4811.HEIC (7677DBF7-9C0B-4ADC-9EFD-45B47A74ED3B.JPG) (7/21)
Skipping missing original photo IMG_4811.HEIC (7677DBF7-9C0B-4ADC-9EFD-45B47A74ED3B)
Exporting IMG_4795.HEIC (023D8DD6-1660-46A4-8993-75C957C9CFE8.JPG) (8/21)
Skipping missing original photo IMG_4795.HEIC (023D8DD6-1660-46A4-8993-75C957C9CFE8)
Exporting IMG_4794.HEIC (66BF4740-048A-4081-82C8-6CCABC4A99DF.JPG) (9/21)
Skipping missing original photo IMG_4794.HEIC (66BF4740-048A-4081-82C8-6CCABC4A99DF)
Exporting IMG_4797.HEIC (20E1E1B9-875B-4200-98A8-4DDB3F2A521B.JPG) (10/21)
Skipping missing original photo IMG_4797.HEIC (20E1E1B9-875B-4200-98A8-4DDB3F2A521B)
Exporting IMG_4802.HEIC (EB2F6BB7-53E2-493F-940C-179B19FBBF33.JPG) (11/21)
Skipping missing original photo IMG_4802.HEIC (EB2F6BB7-53E2-493F-940C-179B19FBBF33)
Exporting IMG_4800.HEIC (146C32BF-A93C-44A8-A19C-DD2FA7D740BE.JPG) (12/21)
Skipping missing original photo IMG_4800.HEIC (146C32BF-A93C-44A8-A19C-DD2FA7D740BE)
Exporting IMG_4808.HEIC (6D1A0AFD-5D5B-467D-9C88-FCFDBCC0207A.JPG) (13/21)
Skipping missing original photo IMG_4808.HEIC (6D1A0AFD-5D5B-467D-9C88-FCFDBCC0207A)
Exporting IMG_4801.HEIC (F3DC9A8A-96E7-4F49-B4AF-58ED49AA22B3.JPG) (14/21)
Skipping missing original photo IMG_4801.HEIC (F3DC9A8A-96E7-4F49-B4AF-58ED49AA22B3)
Exporting IMG_4796.HEIC (8098DD87-F5E7-4EE9-A359-26CC64761F7A.JPG) (15/21)
Skipping missing original photo IMG_4796.HEIC (8098DD87-F5E7-4EE9-A359-26CC64761F7A)
Exporting IMG_4809.HEIC (AD49464C-9878-491A-896E-E69A13845F55.JPG) (16/21)
Skipping missing original photo IMG_4809.HEIC (AD49464C-9878-491A-896E-E69A13845F55)
Exporting IMG_4803.HEIC (82D45994-3D5E-4071-9090-86EF43D07D38.JPG) (17/21)
Skipping missing original photo IMG_4803.HEIC (82D45994-3D5E-4071-9090-86EF43D07D38)
Exporting IMG_4799.HEIC (3D890EF6-9A8D-4A3E-BF60-C2424899EBDD.JPG) (18/21)
Skipping missing original photo IMG_4799.HEIC (3D890EF6-9A8D-4A3E-BF60-C2424899EBDD)
Exporting IMG_4792.HEIC (0EC6E0A1-1445-4010-8022-72B60369593A.JPG) (19/21)
Skipping missing original photo IMG_4792.HEIC (0EC6E0A1-1445-4010-8022-72B60369593A)
Exporting IMG_4805.HEIC (20FDB02B-B9F8-434F-B997-434E126A7D9E.JPG) (20/21)
Skipping missing original photo IMG_4805.HEIC (20FDB02B-B9F8-434F-B997-434E126A7D9E)
Exporting IMG_4798.HEIC (A472728D-021F-4315-87AB-DC770116C911.JPG) (21/21)
Skipping missing original photo IMG_4798.HEIC (A472728D-021F-4315-87AB-DC770116C911)
Exporting 21 photos ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 100% 0:00:00
Processed: 21 photos, exported: 0, updated: 0, skipped: 0, updated EXIF data: 0, missing: 21, error: 0, touched date: 0
Elapsed time: 0:00:04
Wrote export report to export.csv
About this issue
- Original URL
- State: open
- Created 2 years ago
- Comments: 17 (17 by maintainers)
Commits related to this issue
- Fix for incorrect path for shared photos on Ventura, #883 — committed to RhetTbull/osxphotos by RhetTbull a year ago
- Fix for incorrect path for shared photos on Ventura, #883 (#893) Fixes PhotoInfo.path to return the correct path for shared photos on Ventura (#883) — committed to RhetTbull/osxphotos by RhetTbull a year ago
- Fix for incorrect path for shared photos on Ventura, #883 (#893) Fixes PhotoInfo.path to return the correct path for shared photos on Ventura (#883) — committed to RhetTbull/osxphotos by RhetTbull a year ago
@PetrochukM I believe this should be fixed in v0.55.7. Please upgrade (
pipx upgrade osxphotosassuming you installed with pipx) and let me know if you’re still experiencing the problem.OH, I figured it out. I have photos with the same exact name in a shared album, that was shared with me! I think I have been downloading and re-importing the wrong photos because the names were the same!
I think I’ve figured this out. All the affected photos are shared photos in a shared iCloud album (the old-style shared album, not iCloud shared library). The path for these photos has apparently changed – in previous versions of macOS they were in
Photos Library.photoslibrary/resources/cloudsharing/...but they’re now inPhotos Library.photoslibrary/scopes/cloudsharing/...and osxphotos wasn’t aware of this so could not find the files. I’ve just recently gotten a machine with Ventura so hadn’t tested this before. Now that I know where Ventura is storing the files I can implement a fix.This is possible related to #626 but I’ll need to check on a machine running with shared iCloud albums on Monterey (which I don’t have access to).