[NPUW] Serialization tests #29077
[NPUW] Serialization tests #29077
Conversation
github-actions
bot
added
category: NPU
| void ov::npuw::s11n::read(std::istream& stream, ov::npuw::compiled::Spatial& var) { | ||
| using ov::npuw::s11n::read; | ||
|
|
||
| ov::npuw::compiled::Spatial spat; | ||
| std::size_t params_size = 0; | ||
| read(stream, params_size); | ||
| for (std::size_t i = 0; i < params_size; ++i) { | ||
| ov::npuw::compiled::Spatial::Param p; | ||
| read(stream, p.idx); | ||
| read(stream, p.dim); | ||
| spat.params.push_back(p); | ||
| var.params.push_back(p); | ||
| } | ||
| read(stream, spat.range); | ||
| read(stream, spat.nway); | ||
| read(stream, spat.out_dim); | ||
| read(stream, spat.nway_iters); | ||
| read(stream, spat.tail_size); | ||
| read(stream, var.range); | ||
| read(stream, var.nway); | ||
| read(stream, var.out_dim); | ||
| read(stream, var.nway_iters); | ||
| read(stream, var.tail_size); | ||
| } |
There was a problem hiding this comment.
Looks like our AOT spatial blobs didn't work till this very moment :)
There was a problem hiding this comment.
It did. Only SPATIAL config was broken
| int tmp = 42; | ||
| ov::Any var(tmp); | ||
| ov::Any res; | ||
|
|
||
| std::stringstream ss; | ||
|
|
||
| write_any(ss, var); | ||
| read_any(ss, res); | ||
|
|
||
| EXPECT_EQ(var.as<int>(), res.as<int>()); |
There was a problem hiding this comment.
should it have more types? at least two more?
| TEST(SerializationTest, BasicTypes_array) { | ||
| using namespace ov::npuw::s11n; | ||
|
|
||
| std::array<uint8_t, 6> res; |
There was a problem hiding this comment.
it must have its own type. at least a typedef
| write_weightless(ss, {var}, ctx); | ||
| read_weightless(ss, res, nullptr); |
There was a problem hiding this comment.
Yeah, but there is no way to test proper weightless mode - we don't have a model - thus no weights. write_weightsless does support both cases - it tries to write as weightless, but if it's not possible - it will serialize full Tensor
I agree, but I had to remove several tests due to API and lack of model limitations. I can't test weights bank or LazyTensor as a separate entity. I will try to add a test on dummy model export/import |
Not possible to add dummy model test on LLMCompiledModel due to internal passes and CompiledModel doesn't support export. I suggest it to be added separately in the next PR |
No description provided.