Commit Graph

5682 Commits

Author SHA1 Message Date
emoose 9f9a0d2bcc [VFS] Skip reading from STFS hash table if file has contiguous flag.
If this flag is set there shouldn't be any need to read from the hash tables, we can just read from each subsequent block number.
We'll only trust this flag if the package is read-only (LIVE/PIRS) though, in CON packages we'll always read from hash tables.
2020-01-19 22:59:37 +00:00
emoose 17324c3081 [VFS] Check hash of STFS hash tables (& cache them) when reading, fallback if invalid.
This'll try salvaging any corrupt packages loaded in: normally we find the block numbers belonging to a file by reading them from the hash table.
Seems there's some packages out there (eg. Mass Effect 2 demo) that have corrupt hash tables though, so using the block numbers from there just results in a crash.
By verifying the hash of each hash table we can detect if this is the case, and if so we can try just using current_block_number + 1 instead of use any invalid block number.
(we also let the user know about the corrupt table in the log file)

In LIVE/PIRS packages this should hopefully let us get the correct data, since files are usually stored inside consecutive blocks in those package types.
It's doubtful that it'd help much with CON ones though, since those are pretty much a living filesystem.
The older & more used a CON package is, the more likely blocks will be fragmented throughout the file...
Reading from the hash table is the only way to properly read data from these, using current_block + 1 likely won't help much (we'd be going wxPirs-mode, in a way :P)

CON packages do have something that might help with this though: redundant hash blocks, where each hash table is actually made up of two blocks.
Maybe in future we can find a way to automatically use the secondary block whenever the primary one is invalid.
2020-01-19 21:55:57 +00:00
emoose db515ac4c1 [VFS] Fix StfsContainerDevice::total_allocation_units() 2020-01-19 21:46:46 +00:00
emoose a4aa4d8edc [XAM] Fix Halo 3 aborting save load after XamShowDeviceSelectorUI call
Should let Halo 3 savegames work now (Resume Solo Game...)

This changes XamShowDeviceSelectorUI code to pretty much the same code as xenia-master, with some param checks added from XAM.
Looks like it was 0xB notification which made Halo 3 abort (looks like thats for when storage devices are added/removed)
I guess Halo doesn't like to see that notify just after it was told the device it could make use of?

I reverted the function to master since I don't really think the threading stuff is needed any more.
AFAIK the threads just turned out to be a band-aid fix for the issue in https://github.com/xenia-project/xenia/pull/1417, where games could only ever see a single notification for a given ID.
(Since we'd send the first notify in one thread, then wait a little while before sending in another thread, that'd gave it enough time to see both notifys - but now with the fix from that PR this band-aid isn't needed)
If there's actually any regressions from removing the threading code we can easily put it back in (I'd be really interested in any games that might require this kind of thing too)

The way these functions are handled (and really everything that uses XOVERLAPPED) isn't really correct tho, since they'll cause blocking in the caller thread while it does the work which the actual XAM impls don't do AFAIK.
There probably should be a seperate thread that handles all that, completing the overlapped etc, but I really don't think the way I did it with this band-aid fix was the best way for it...
2020-01-13 04:04:42 +00:00
emoose dea24e2fcb [XAM] Use correct path for STFS headers 2020-01-13 04:02:10 +00:00
emoose 44c2f72a30 [VFS] Add StfsHashEntry struct to view hash entry flags in more detail
+ small adds to StfsHeader
2020-01-11 19:40:51 +00:00
emoose 4f7bc2f946 [VFS] Fix sketchy ReadMagic function...
Haven't been able to test yet though - hope it's reading in the correct endian!
2020-01-11 19:04:31 +00:00
emoose 7eccee25fb [Kernel/VFS] Add maximum size for thumbnails read from headers 2020-01-11 18:47:06 +00:00
emoose 178aca3648 [Kernel] Support XCONTENTFLAG flags inside CreateContent 2020-01-11 18:44:14 +00:00
emoose a7b2abb53d [Kernel/VFS] Write more fields in STFS headers when creating 2020-01-11 18:40:40 +00:00
emoose 6ca721d40a [Kernel] Use user_language value as the slot to retrieve STFS strings from 2020-01-11 18:35:10 +00:00
emoose ec06bd16ad [Core] Add add kPolish & kRussian to XLanguage 2020-01-11 18:27:24 +00:00
emoose b96929d125 [Kernel] Fix travis errors in XContentMetadata? 2020-01-11 18:25:55 +00:00
emoose d3065fd694 [Kernel] CreateContent: create headers.bin file with the content info 2020-01-11 18:22:13 +00:00
emoose 15307fae4d [VFS] Add set_* functions (eg. set_display_name) to XContentMetadata 2020-01-11 18:19:54 +00:00
emoose f693ff78cf [Kernel/VFS] Improve STFS/XContent structures
Mostly the same as 6a3c712aad
2020-01-11 18:15:59 +00:00
emoose d985ab3b58 [VFS] Some more STFS code improvements
Reverted to older BlockToOffsetSTFS code (with some improvements, now named STFSDataBlockToBackingBlock)
Split the To*Offset functions into ToBackingBlock & To*Offset funcs, for later use when we need the actual block numbers instead of the offsets.
Store the num blocks per hash table & block step count in the device instance, instead of calculating it each time.
Add read_only_package() & root_table_secondary() getters to the STFS descriptor struct (note: will be replaced with better stuff once stfs-headers is eventually merged)
2020-01-11 15:57:41 +00:00
Gliniak 212a85d0cb [XAM/Party] Added stub for: XamPartyGetUserListInternal
It will allow to run dashboard with signin_state = 2

Should we create different xam file for XamParty functions?

ToDo: Finish struct that store user info
2020-01-11 13:17:57 +01:00
emoose 6ce797dd3b [VFS] Add some STFS magic numbers, skip hash table checks for read only packages 2020-01-11 10:46:09 +00:00
emoose 5d49b202d3 [VFS] Fix GetHashEntry for level 2 entries... 2020-01-11 09:59:51 +00:00
emoose 9f63ece2a3 [VFS] Fix BlockToHashBlockOffset's level 2 case (blockStep0 -> blockStep1)
& changed code to switch statement instead.
2020-01-11 09:31:31 +00:00
emoose 2ff7c268ea [VFS] Improve STFS GetBlockHash function - now gets hash from correct hash table.
This should hopefully allow Xenia to be more compatible with larger / more made-use-of profiles.

Each hash table actually consists of two hash tables for redundancy, which table is used is decided by the hash table level above it.
Previously there was some code to try swapping which table to use if a flag isn't set, but the code ended up being commented out & unused...

After looking at some other X360 mod tools sources I've managed to come up with this solution, which visits each hash-level it can to retrieve the correct table number to use.
Really this is probably a little inefficient, the code I based this on would actually cache each table in memory to make these visits a lot quicker, maybe should look into doing the same here.
For packages with read_only_package() == true, this maybe isn't even necessary too - but it's probably worth keeping it as-is just in case though.
2020-01-11 09:09:54 +00:00
emoose d5bd7a8c8b [XAM] Add some proper error codes to a few XamUser functions
It might be worth finding games/apps that use these functions and see what error codes they check against...
2020-01-10 23:43:27 +00:00
emoose 82ada32647 [XAM] Simplify XamShowDeviceSelectorUI, update an old device ID
Storing the content type inside the device ID from DeviceSelectorUI shouldn't be needed now.
AFAIK it was only used so that we could extract it later inside XamContentGetDeviceData, but that wasn't actually how GetDeviceData was meant to work.
2020-01-10 23:23:49 +00:00
emoose ea2adc9d77 [Kernel] Fix wide-printf functions not processing %ws format correctly
This would break strings like memory://%.*ws, because the %ws would set FF_IsWide, but FF_IsWide is actually treated as an "is opposite encoding" flag.
Since the function is already wide, that flag would make it think it's opposite encoding and it'd try reading the param as ASCII instead of Unicode...
2020-01-10 22:55:19 +00:00
emoose 213f7b9a6a [Kernel] *FormatData: make peek() match get() endian, fix skip() not advancing pointer 2020-01-10 22:52:34 +00:00
Gliniak f607a9d977 Removed useless file that survived rebase 2020-01-10 20:06:42 +01:00
Gliniak 453b90e653 [Log] Added information about implementation state 2020-01-10 15:17:54 +01:00
Gliniak 6e538300c1 Revert "[XAM/User] Added title_id == 0 check for few User functions"
This reverts commit 05433007c5.
2020-01-10 15:17:54 +01:00
Gliniak 2749ab1284 [XAM/User] Added title_id == 0 check for few User functions
Games like to report title_id as 0 (it is expected behaviour).
0 in this case means currently opened title
2020-01-10 15:17:54 +01:00
Gliniak 7d9e8fba2c [GPU] InitializeRingBuffer - Clear buffer space to prevent random data readout 2020-01-10 15:17:53 +01:00
emoose 0ffe2e712d [XAM] Add XamShowCreateProfileUI & XamProfileCreate impl.
Seems to kinda work, xshell uses XamProfileCreate and says that it's successful at least.
Dash uses the ShowUI function, but doesn't seem to login to the created profile correctly for some reason... restarting with the toml configured for the new profile does seem to work though.
2020-01-10 15:17:53 +01:00
emoose 1ebd47dc0f [VFS] Oops, fix wrong BlockToOffset result for non-CON packages 2020-01-10 15:17:53 +01:00
emoose 9fbc85796a [Kernel] Fix XamReadTile not returning profile pic, breaking dash profile...
This caused dash not to load profile anymore, since dash passes user_index == kNone...
The new method should be closer to how things are actually meant to work.
2020-01-10 15:17:53 +01:00
emoose 58632f2a21 [VFS] Port new BlockToOffsetSTFS algo from stfs-headers
65ca664fdb
This should give better compatibility with CON packages - ie. profiles taken from actual consoles should hopefully extract properly without errors, now there's shouldn't be any need for extracting them with Velocity/Horizon first.
2020-01-10 15:17:52 +01:00
emoose 42c5890c5e [XMP] Add extra checks from XAM to help prevent dash host crash 2020-01-10 15:17:52 +01:00
emoose cb2fbb51bd [User] Add some extra checks from XAM to Read/WriteProfileSettings exports 2020-01-10 15:17:52 +01:00
emoose 073d2ed75b [XAM/User] Fix wrong error code given when ReadProfileSettings buffer is too small
Strange, seems ReadProfileSettings returns this error as the result code instead of the xoverlapped error code - it could be possible other Xam functions do the same too.
This fixes Crackdown loading (thanks Gliniak for the tip about buffer size), hope it doesn't break any other games though.
2020-01-10 15:17:52 +01:00
emoose 94bc499400 [XAM/User] Fix dashboard GPD overwrite when loading new game 2020-01-10 15:17:51 +01:00
emoose d6367e36d4 [XAM/User] Allow titles to actually access title-specific settings
Would only allow access to dash GPD previously...
I'm not sure if we need to setup the XPROFILE_TITLE_SPECIFIC settings in advance or not though, really it should be on the games to do this themselves, but not sure whats actually needed...

This should probably fix games that would save progress to profile (Halo 3 progression, etc.), haven't actually noticed any changes myself yet though.
2020-01-10 15:17:51 +01:00
emoose 5483c4ea92 [User/XAM] Oops, fix null pointer deref 2020-01-10 15:17:51 +01:00
emoose 56d4a7aa20 [XAM/User] Try logging in to any available profile when XUID isn't set
Now the XUID doesn't need to be set at all for Xenia to try logging into an available profile (as long as signin_state != 0, previously this needed XUID to be set to '1')

So from a default install, you should be able to just drop an X360 profile into the right profiles dir, and when you run Xenia it'll login to it automatically for you, no config changes needed!

This applies to all 4 user slots, just set their signin states, drop 4 profiles in and it should log them all into each one seperately, then you can edit the config with specific profile XUIDs for each user.

Xenia should now only generate a default XeniaUser profile when no profiles are available for a user.
2020-01-10 15:17:51 +01:00
emoose e3aff6d335 [XAM/User] Add UserIndex enum, handle special UserIndexes inside KernelState::user_profile 2020-01-10 15:17:51 +01:00
emoose ffed5eda3a [XAM/User] Add support for multiple signed-in users/profiles
This adds support for multiple profiles to Xenia, profiles can be configured with the [Profiles] user_*_xuid / user_*_state config settings.
If state is non-zero (1 = offline, 2 = LIVE), the profile will be counted as logged-on - either with a generated XeniaUser gamertag, or if the XUID is set to 1 the first available profile will be loaded.
The XUID can also be set to the offline-XUID (E000...) of an existing profile, to sign in the user as that profile.
(Profiles should be stored in the Xenia content/FFFE07D1/00010000/ folder, either as an STFS package or an extracted folder)

All the XamUser* functions have been updated to support multiple user_index's provided to them too.
(there's still issues with weird indexes like 0xFF, 0x7FF9... being given though, still dunno what's with that, the KernelState::user_profile() code will treat 0xFF as 0)

I'm not really sure if this is the most ideal way to do things though, but it does appear to work fine, at least Halo 3 does detect the profiles with state > 0 fine.

TODO: look into changing up xam_content to make use of user_index & profiles.
It shouldn't be too difficult now to emulate the same content paths X360 uses (seperating content by XUID etc)
Would probably be a good idea, since it'd probably be needed for us to support multiple profiles properly, so that they don't all share savegames etc...
2020-01-10 15:17:50 +01:00
emoose dbaa00cef0 [HID] Allow winkey driver to use the first unused user index
This removes the user_index == 0 requirement from the InputSystem code, and updates WinKeyInputDriver to use the first non-connected user index if it can.

Eg. if you had 2 XInput controllers plugged in, those two will take up user index 0 and 1, and keyboard will take user index 2.
If all four indexes are taken up already, the WinKey driver will be disabled.

(This is done by passing already-setup drivers to each drivers Setup function: since WinKey is the last to be setup, this'll let it query the XInput driver and find which user_index it should handle)
2020-01-10 15:15:32 +01:00
emoose 39f8ec655b [Xam/Content] Remove unused ResolveGameUserContentPath func
(not needed since we store this stuff inside GPD now)
2020-01-10 15:15:32 +01:00
emoose 12674aa529 [XAM] Allow loading profile from STFS (extracts package automatically!)
Profiles can now be placed as either an extracted folder with GPDs, or an STFS package, inside the Documents\Xenia\content\FFFE07D1\00010000\ directory
eg. Documents\Xenia\content\FFFE07D1\00010000\E0000E07FA53D7F1
(this roughly matches the same location as X360 stores it)

If loading an STFS package the package will first get extracted to <path>.dir/, and then the profile is loaded/saved into that directory.
(originally was going to mount the package and read everything in-memory, but then realized how hard adding new files/modifying/etc would be.. VFS doesn't allow mixing two devices into the same mount_path afaik)

Code for extraction is taken from xenia-vfs-dump (as StfsContainerDevice::ExtractToFolder)

A [XAM]profile_xuid config option is added too, which should let you pick which profile to load from the FFFE07D1\00010000\ folder if you have multiple there.
(at least I hope it should - something like "profile_xuid = 0xE0000E07FA53D7F1" will work I hope... cpptoml might have issues with hex digits though, not sure, will investigate later...)
If profile_xuid isn't set (left at -1), Xenia will just load whatever the first file/folder inside there is.
2020-01-10 15:15:32 +01:00
emoose 41b94145e2 [Base] Change DEFINE_uint64 -> DEFINE_int64, cpptoml seems to have issues with uint64..
Tried setting a uint64 setting to -1 (FFFF FFFF FFFF FFFF), which made it throw a out of range exception when loading the toml...
Internally it uses int64 to parse numbers, so I guess it doesn't work well with converting to uint64?
Changing everything from uint64->int64 seems to solve it though, now -1 works fine.
2020-01-10 15:15:31 +01:00
emoose bc129c2c4d [VFS] Fix STFS file table info being read in wrong endian 2020-01-10 15:15:31 +01:00
emoose f472b859f6 [XAM/User] Fix AchievementPlatform definitions...
big oof
2020-01-10 15:15:31 +01:00