tests: littlefs: add 18 tested NXP boards to testcase.yaml

[butok]

Adds 18 tested NXP boards to the littlefs testcase.yaml

[hakehuang]

@butok I run all testing and one platform fails

*** Booting Zephyr OS build v4.1.0-2382-g06af5fcc26be ***
Running TESTSUITE littlefs
===================================================================
START - test_fs_mkfs_custom
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
I: LittleFS version 2.10, disk version 2.1
I: FS at w25q64jvssiq@0:0x7f0000 is 16 0x1000-byte blocks with 512 cycle
I: partition sizes: rd 16 ; pr 16 ; ca 64 ; la 32
W: WEST_TOPDIR/modules/fs/littlefs/lfs.c:2112: Superblock 0x1 has become unwritable
E: format failed (LFS -28)
E: mkfs error (-28)

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/testfs_mkfs.c:65: littlefs_test_fs_mkfs_custom: (ret not equal to 0)
Expected success (ret=-28)
 FAIL - test_fs_mkfs_custom in 0.338 seconds
===================================================================
START - test_fs_mkfs_ops_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount to prepare tests
I: LittleFS version 2.10, disk version 2.1
I: FS at w25q64jvssiq@0:0x7f0000 is 16 0x1000-byte blocks with 512 cycle
I: partition sizes: rd 16 ; pr 16 ; ca 64 ; la 32
Create some file
W: WEST_TOPDIR/modules/fs/littlefs/lfs.c:2112: Superblock 0x1 has become unwritable
E: file open error (-5)

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mkfs.c:64: test_fs_mkfs_ops: (ret not equal to 0)
Expected success fs_open(FS_O_CREATE) (-5)
 FAIL - test_fs_mkfs_ops_lfs in 0.275 seconds
===================================================================
START - test_fs_mkfs_simple_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount with flag no format
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mkfs.c:29: test_fs_mkfs_simple: (ret not equal to -EFAULT)
Expected EFAULT got -16
 FAIL - test_fs_mkfs_simple_lfs in 0.195 seconds
===================================================================
START - test_fs_mount_flags_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!
Mount unformatted with FS_MOUNT_FLAG_NO_FORMAT set
E: file system already mounted!!
Mount unformatted with FS_MOUNT_FLAG_READ_ONLY set
E: file system already mounted!!
Mount again to format volume

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mount_flags.c:40: test_fs_mount_flags: (ret not equal to 0)
Expected success
 FAIL - test_fs_mount_flags_lfs in 0.214 seconds
===================================================================
START - test_fs_open_flags_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/testfs_open_flags.c:20: mount: (fs_mount(mp) not equal to 0)
Failed to mount partition
 FAIL - test_fs_open_flags_lfs in 0.196 seconds
===================================================================
START - test_lfs_basic
clearing partition /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_basic.c:371: test_fs_basic: (fs_mount(fs_basic_test_mp) not equal to 0)
mount failed
 FAIL - test_lfs_basic in 0.201 seconds
===================================================================
START - test_lfs_dirops
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_dirops.c:296: test_fs_dirops: (fs_mount(fs_dirops_test_mp) not equal to 0)
mount failed
 FAIL - test_lfs_dirops in 0.197 seconds
===================================================================
START - test_lfs_perf
clearing /sml for small 8x1K dflt write/read test
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!
Mount /sml failed: -16

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/test_lfs_perf.c:229: littlefs_test_lfs_perf: (write_read("small 8x1K dflt", &testfs_small_mnt, 1024, 8) not equal to TC_PASS)
failed
 FAIL - test_lfs_perf in 0.316 seconds
===================================================================
START - test_util_path_extend
 PASS - test_util_path_extend in 0.001 seconds
===================================================================
START - test_util_path_extend_overrun
 PASS - test_util_path_extend_overrun in 0.001 seconds
===================================================================
START - test_util_path_extend_up
 PASS - test_util_path_extend_up in 0.001 seconds
===================================================================
START - test_util_path_init_base
 PASS - test_util_path_init_base in 0.001 seconds
===================================================================
START - test_util_path_init_extended
 PASS - test_util_path_init_extended in 0.001 seconds
===================================================================
START - test_util_path_init_overrun
 PASS - test_util_path_init_overrun in 0.001 seconds
===================================================================
TESTSUITE littlefs failed.

------ TESTSUITE SUMMARY START ------

SUITE FAIL -  42.86% [littlefs]: pass = 6, fail = 8, skip = 0, total = 14 duration = 1.938 seconds
 - FAIL - [littlefs.test_fs_mkfs_custom] duration = 0.338 seconds
 - FAIL - [littlefs.test_fs_mkfs_ops_lfs] duration = 0.275 seconds
 - FAIL - [littlefs.test_fs_mkfs_simple_lfs] duration = 0.195 seconds
 - FAIL - [littlefs.test_fs_mount_flags_lfs] duration = 0.214 seconds
 - FAIL - [littlefs.test_fs_open_flags_lfs] duration = 0.196 seconds
 - FAIL - [littlefs.test_lfs_basic] duration = 0.201 seconds
 - FAIL - [littlefs.test_lfs_dirops] duration = 0.197 seconds
 - FAIL - [littlefs.test_lfs_perf] duration = 0.316 seconds
 - PASS - [littlefs.test_util_path_extend] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_extend_overrun] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_extend_up] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_base] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_extended] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_overrun] duration = 0.001 seconds

------ TESTSUITE SUMMARY END ------

===================================================================
RunID: 617410edaf21d155ed974683d9c8c9d5
PROJECT EXECUTION FAILED

and

*** Booting Zephyr OS build v4.1.0-2382-g06af5fcc26be ***
Running TESTSUITE littlefs
===================================================================
START - test_fs_mkfs_custom
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
I: LittleFS version 2.10, disk version 2.1
I: FS at w25q64jvssiq@0:0x7f0000 is 16 0x1000-byte blocks with 512 cycle
I: partition sizes: rd 16 ; pr 16 ; ca 64 ; la 32
W: WEST_TOPDIR/modules/fs/littlefs/lfs.c:2112: Superblock 0x1 has become unwritable
E: format failed (LFS -28)
E: mkfs error (-28)

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/testfs_mkfs.c:65: littlefs_test_fs_mkfs_custom: (ret not equal to 0)
Expected success (ret=-28)
 FAIL - test_fs_mkfs_custom in 0.411 seconds
===================================================================
START - test_fs_mkfs_ops_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount to prepare tests
I: LittleFS version 2.10, disk version 2.1
I: FS at w25q64jvssiq@0:0x7f0000 is 16 0x1000-byte blocks with 512 cycle
I: partition sizes: rd 16 ; pr 16 ; ca 64 ; la 32
Create some file
W: WEST_TOPDIR/modules/fs/littlefs/lfs.c:2112: Superblock 0x1 has become unwritable
E: file open error (-5)

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mkfs.c:64: test_fs_mkfs_ops: (ret not equal to 0)
Expected success fs_open(FS_O_CREATE) (-5)
 FAIL - test_fs_mkfs_ops_lfs in 0.346 seconds
===================================================================
START - test_fs_mkfs_simple_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount with flag no format
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mkfs.c:29: test_fs_mkfs_simple: (ret not equal to -EFAULT)
Expected EFAULT got -16
 FAIL - test_fs_mkfs_simple_lfs in 0.277 seconds
===================================================================
START - test_fs_mount_flags_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!
Mount unformatted with FS_MOUNT_FLAG_NO_FORMAT set
E: file system already mounted!!
Mount unformatted with FS_MOUNT_FLAG_READ_ONLY set
E: file system already mounted!!
Mount again to format volume

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_mount_flags.c:40: test_fs_mount_flags: (ret not equal to 0)
Expected success
 FAIL - test_fs_mount_flags_lfs in 0.271 seconds
===================================================================
START - test_fs_open_flags_lfs
Clean /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
Mount /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/testfs_open_flags.c:20: mount: (fs_mount(mp) not equal to 0)
Failed to mount partition
 FAIL - test_fs_open_flags_lfs in 0.268 seconds
===================================================================
START - test_lfs_basic
clearing partition /sml
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_basic.c:371: test_fs_basic: (fs_mount(fs_basic_test_mp) not equal to 0)
mount failed
 FAIL - test_lfs_basic in 0.268 seconds
===================================================================
START - test_lfs_dirops
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/common/test_fs_dirops.c:296: test_fs_dirops: (fs_mount(fs_dirops_test_mp) not equal to 0)
mount failed
 FAIL - test_lfs_dirops in 0.268 seconds
===================================================================
START - test_lfs_perf
clearing /sml for small 8x1K dflt write/read test
Erasing 65536 (0x10000) bytes
Wiped flash area 5 for /sml
E: file system already mounted!!
Mount /sml failed: -16

    Assertion failed at WEST_TOPDIR/zephyr/tests/subsys/fs/littlefs/src/test_lfs_perf.c:229: littlefs_test_lfs_perf: (write_read("small 8x1K dflt", &testfs_small_mnt, 1024, 8) not equal to TC_PASS)
failed
 FAIL - test_lfs_perf in 0.367 seconds
===================================================================
START - test_util_path_extend
 PASS - test_util_path_extend in 0.001 seconds
===================================================================
START - test_util_path_extend_overrun
 PASS - test_util_path_extend_overrun in 0.001 seconds
===================================================================
START - test_util_path_extend_up
 PASS - test_util_path_extend_up in 0.001 seconds
===================================================================
START - test_util_path_init_base
 PASS - test_util_path_init_base in 0.001 seconds
===================================================================
START - test_util_path_init_extended
 PASS - test_util_path_init_extended in 0.001 seconds
===================================================================
START - test_util_path_init_overrun
 PASS - test_util_path_init_overrun in 0.001 seconds
===================================================================
TESTSUITE littlefs failed.

------ TESTSUITE SUMMARY START ------

SUITE FAIL -  42.86% [littlefs]: pass = 6, fail = 8, skip = 0, total = 14 duration = 2.482 seconds
 - FAIL - [littlefs.test_fs_mkfs_custom] duration = 0.411 seconds
 - FAIL - [littlefs.test_fs_mkfs_ops_lfs] duration = 0.346 seconds
 - FAIL - [littlefs.test_fs_mkfs_simple_lfs] duration = 0.277 seconds
 - FAIL - [littlefs.test_fs_mount_flags_lfs] duration = 0.271 seconds
 - FAIL - [littlefs.test_fs_open_flags_lfs] duration = 0.268 seconds
 - FAIL - [littlefs.test_lfs_basic] duration = 0.268 seconds
 - FAIL - [littlefs.test_lfs_dirops] duration = 0.268 seconds
 - FAIL - [littlefs.test_lfs_perf] duration = 0.367 seconds
 - PASS - [littlefs.test_util_path_extend] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_extend_overrun] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_extend_up] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_base] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_extended] duration = 0.001 seconds
 - PASS - [littlefs.test_util_path_init_overrun] duration = 0.001 seconds

------ TESTSUITE SUMMARY END ------

===================================================================
RunID: 23f0648333dcba32640ee499adad7742
PROJECT EXECUTION FAILED

[butok]

Thank you @hakehuang
The w25q64jvssiq flash is populated on MIMXRT1040-EVK and FRDM-MCXN947.
MIMXER1040-EVK has passed, but something happen with the FRDM-MCXN947 last month.

Flash tests, as anything writing to its storage partition, are broken for the FRDM-MCXN947.
I will look at it, and will fix it asap.

[butok]

So the issue has been reported: #88654
It's caused by : 7ed7cd1

[hakehuang]

board test pass