You should see it in the taskbar by default. If not, you can access it from the Start menu. You'll find the File Explorer ...

Also, choose “Underline icon titles only when I point at them ... and select “Unpin From Quick Access.” Switch File Explorer ...

KB5055625 brings some huge changes to Windows 11, allowing them to improve the design of their taskbar in the OS.