policy: Fix IteratorChainsByPrefix #84

Merged
fyrchik merged 2 commits from aarifullin/frostfs-contract:fix/policy_map_key into master 2024-09-04 19:51:18 +00:00
Member
  • If numeric mapping does not exists, then assign id to 0. No explicit assignment led to exception because of Null/Integer conversion when there were no chains yet.
  • Add check to unit-test.
  • Regenerate rpcclient for Policy.
* If numeric mapping does not exists, then assign id to 0. No explicit assignment led to exception because of `Null/Integer` conversion when there were no chains yet. * Add check to unit-test. * Regenerate rpcclient for Policy.
aarifullin added the
bug
label 2024-04-03 13:56:25 +00:00
aarifullin requested review from storage-core-committers 2024-04-03 13:58:12 +00:00
aarifullin requested review from storage-core-developers 2024-04-03 13:58:20 +00:00
aarifullin changed title from policy: Fix mapToNumeric helper to WIP: policy: Fix mapToNumeric helper 2024-04-03 14:19:17 +00:00
aarifullin force-pushed fix/policy_map_key from d412991452 to 465d0b10f1 2024-04-03 14:45:04 +00:00 Compare
aarifullin changed title from WIP: policy: Fix mapToNumeric helper to policy: Fix mapToNumeric helper 2024-04-03 14:46:23 +00:00
aarifullin changed title from policy: Fix mapToNumeric helper to policy: Fix IteratorChainsByPrefix 2024-04-03 14:49:12 +00:00
acid-ant reviewed 2024-04-03 18:40:05 +00:00
@ -246,1 +246,3 @@
id, _ := mapToNumeric(ctx, entity, []byte(entityName))
id, mappingExists := mapToNumeric(ctx, entity, []byte(entityName))
if !mappingExists {
// All exising numeric mappings starts with 1. So, if id is set to 0, then
Member

exising -> existing

exising -> existing
Member

Please fix commit message.

Please fix commit message.
aarifullin force-pushed fix/policy_map_key from 465d0b10f1 to 4ab2e59333 2024-04-04 07:26:43 +00:00 Compare
acid-ant approved these changes 2024-04-04 07:40:06 +00:00
fyrchik reviewed 2024-04-04 08:00:46 +00:00
@ -244,3 +244,3 @@
func IteratorChainsByPrefix(entity Kind, entityName string, prefix []byte) iterator.Iterator {
ctx := storage.GetReadOnlyContext()
id, _ := mapToNumeric(ctx, entity, []byte(entityName))
id, mappingExists := mapToNumeric(ctx, entity, []byte(entityName))
Owner

Why can we return 0 in the first place?

Why can we return `0` in the first place?
Owner

Why can we return 0 from mappingExists in the first place?

Why can we return 0 from `mappingExists` in the first place?
Author
Member

mappingExists returns false, if entityType + entityName was never mapped.

When we deploy contract

	storage.Put(ctx, counterKey, 0)

When we create a mapping

func mapToNumericCreateIfNotExists(ctx storage.Context, kind Kind, name []byte) int {
	mKey := mapKey(kind, name)
	numericID := storage.Get(ctx, mKey)
	if numericID == nil {
		counter := storage.Get(ctx, counterKey).(int)
		counter++
		storage.Put(ctx, counterKey, counter)
		storage.Put(ctx, mKey, counter)
		return counter
	}
	return numericID.(int)
}

So, as you can see, all mappings start from 1 <- counter++. Here I use 0 to intentionally fail iteration: we suppose mapping to 0 does not exist -> no chains for 0 -> iteration over empty list

`mappingExists` returns false, if `entityType + entityName` was never mapped. When we deploy contract ```go storage.Put(ctx, counterKey, 0) ``` When we create a mapping ```go func mapToNumericCreateIfNotExists(ctx storage.Context, kind Kind, name []byte) int { mKey := mapKey(kind, name) numericID := storage.Get(ctx, mKey) if numericID == nil { counter := storage.Get(ctx, counterKey).(int) counter++ storage.Put(ctx, counterKey, counter) storage.Put(ctx, mKey, counter) return counter } return numericID.(int) } ``` So, as you can see, all mappings start from `1` <- `counter++`. Here I use `0` to intentionally *fail* iteration: we suppose mapping to `0` does not exist -> no chains for `0` -> iteration over empty list
Owner

Again, 4ab2e59333/policy/policy_contract.go (L118) here we could return 0, false explicitly

Null/Integer conversion is most likely a bug in the compiler, explicit returns should fix this.

Again, https://git.frostfs.info/TrueCloudLab/frostfs-contract/src/commit/4ab2e593336cd76c17e3d8dae12e9320ccdb8891/policy/policy_contract.go#L118 here we could return `0, false` explicitly `Null/Integer` conversion is most likely a bug in the compiler, explicit returns should fix this.
Author
Member

Okay. Before, I did it like you said but then I concluded it is better to explain with a comment that iterating over 0 is fine.

Null/Integer conversion is most likely a bug in the compiler, explicit returns should fix this.

Yes. That's correct. So, it really makes sense to return changes to prevent occurring of this bug

Okay. Before, I did it like you [said](https://git.frostfs.info/TrueCloudLab/frostfs-contract/commit/d41299145270d01d1e90eb9d1dc93f36ca145cd3) but then I concluded it is better to explain with a comment that iterating over `0` is fine. > Null/Integer conversion is most likely a bug in the compiler, explicit returns should fix this. Yes. That's correct. So, it really makes sense to return changes to prevent occurring of this bug
Author
Member

I returned back the change (but made it return 0, false instead explicit assignment at the very beginning). Please, check this out

I returned back the change (but made it `return 0, false` instead explicit assignment at the very beginning). Please, check this out
Owner

Will be fixed, but not soon https://github.com/nspcc-dev/neo-go/pull/3401

Will be fixed, but not soon https://github.com/nspcc-dev/neo-go/pull/3401
aarifullin force-pushed fix/policy_map_key from 4ab2e59333 to 694daebb19 2024-04-04 12:43:32 +00:00 Compare
aarifullin requested review from acid-ant 2024-04-04 12:46:01 +00:00
acid-ant approved these changes 2024-04-05 09:46:44 +00:00
fyrchik approved these changes 2024-04-05 11:21:21 +00:00
fyrchik merged commit 694daebb19 into master 2024-04-05 11:21:33 +00:00
Sign in to join this conversation.
No reviewers
TrueCloudLab/storage-core-developers
No milestone
No project
No assignees
3 participants
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: TrueCloudLab/frostfs-contract#84
No description provided.